Design of --header when using --pipe

2011-11-23 Thread Ole Tange
I have seen others ask for it and now I have even had use for it myself: A way to repeat a header for each block when using --pipe If you are processing a big CSV-file and the first line is the column names you want this line to be repeated for each block passed to a parallel process. The simple

RE: Design of --header when using --pipe

2011-11-23 Thread Cook, Malcolm
Ole, Great directions. I've used --pipe now a few times with .fasta files, using '^>' as record seperator. I think you cover that cases that I've thought about so far. Also, I've wanted to be able to define blocks in terms of number of lines. For instance, fastq format has new record every

Re: record as a number of lines

2011-11-23 Thread Ole Tange
On Wed, Nov 23, 2011 at 9:59 PM, Cook, Malcolm wrote: > Also, I've wanted to be able to define blocks in terms of number of lines.   > For instance, fastq format has new record every 4 lines.  Is there a way to > block on line number. (candidate blocks are where the line number is > divisible b