Re: Problem with thousands of small jobs.

2015-02-07 Thread xmoon 2000
On 6 February 2015 at 20:42, Ole Tange wrote: >>> On Fri, 6 Feb 2015 23:20 xmoon 2000 wrote: I need to run about 4,000 jobs that each take around 20 seconds to complete > : On my 32 core machine works OK, BUT there is a "lull" in processing every few seconds as new jobs

Re: Problem with thousands of small jobs.

2015-02-07 Thread Ole Tange
On Sat, Feb 7, 2015 at 10:11 AM, xmoon 2000 wrote: > On 6 February 2015 at 20:42, Ole Tange wrote: >> On Fri, Feb 6, 2015 at 3:56 PM, xmoon 2000 wrote: >> >> My experience with Cygwin is limited, but I seem to remember that >> spawning is expensive (in the order of 0.1 second), which is one of >