Re: GNU Parallel Bug Reports Randomising Job Distribution

2012-03-22 Thread Ole Tange
On Wed, Mar 21, 2012 at 12:58 PM, Alastair Andrew wrote: > Is there any way to tell GNU parallel to randomly assign the jobs to machines > rather than just chunking them in sequence? [...] There is no random assignment. > If 4 of the biggest jobs get placed on the same machine they starve eac

Re: Feature request - {..} remove two level of extensions

2012-03-22 Thread Jay Hacker
I would also like this feature. On Fri, Mar 16, 2012 at 4:00 PM, Martin Møller Skarbiniks Pedersen wrote: > Hi, >  I have a feature request for GNU parallel. >  The option could be {..} or maybe {.2} and should > remove the extension from a filename two times eg. > > $ ls track07.cdda.wav | paral

Re: Slow start to cope with load

2012-03-22 Thread Jay Hacker
Perhaps this is a bit simplistic, but what if you took your idea and also kept a running estimate of the amount of load added by each job? Start out assuming each job adds 1 unit of load, and then measure: "Okay, I started 4 jobs last time, and the load went up by 8, so I estimate each job causes 2

Re: Slow start to cope with load

2012-03-22 Thread Ole Tange
On Thu, Mar 22, 2012 at 4:48 PM, Jay Hacker wrote: > Perhaps this is a bit simplistic, but what if you took your idea and > also kept a running estimate of the amount of load added by each job? > Start out assuming each job adds 1 unit of load, and then measure: > "Okay, I started 4 jobs last tim

GNU Parallel 20120322 ('#518696') released

2012-03-22 Thread Ole Tange
GNU Parallel 20120322 ('#518696') has been released. It is available for download at: http://ftp.gnu.org/gnu/parallel/ This is a bugfix release with no new features. Probably a good release for stable long-term use. New in this release: * Parallel Process Database D