Re: processing csv files

2022-03-06 Thread Ole Tange
On Sat, Mar 5, 2022 at 2:46 AM Saint Michael wrote: > > I have a bunch of *.csv files. > I need to process each line of the separately, so I do > function() { any process } > export -f function > cat *.csv | parallel --colsep ',' function "{1} {2} {3} {4} {5} {6} {7}" > > The question is: is this

Re: Question

2022-03-06 Thread Ole Tange
On Sat, Mar 5, 2022 at 2:56 AM Saint Michael wrote: > > I have a case where I need the output to be written out to stdout as soon as > it's received, no ordering needed, just spit it out. > Is there an option to disable reordering or any manipulation of the output? Look at --ungroup and --line-b

Re: processing csv files

2022-03-06 Thread Saint Michael
So how would I submit the contents of many files to parallel, without concatenating them? The function neds to process each file line by line. I am sure there must be a better way. Why concatenate them at all? There is no relationship between a line and the next line. Maybe a new feature? On Sun,