Re: [Math] Little thought about multi-threading

2012-07-31 Thread J.Pietschmann
Am 22.07.2012 23:19, schrieb Gilles Sadowski: > I agree. I.e. let's make a list of the algorithms that would certainly > benefit from parallelization, and for which the parallelization would be > pretty simple (the devilish details notwithstanding...). Integration, root solving or minimizing a fun

Re: [Math] Little thought about multi-threading

2012-07-29 Thread Sébastien Brisard
Hi, 2012/7/30 Gilles Sadowski : >> > [...] >> >>> Well, you probably don't want to switch to Java 7 now, [...] >> >> >> >> Oh, yes, please! 8-P >> > >> > I would be in favor of this too, but we could also target it for the 4.0 >> > release together with the parallelization stuff. >> > >> > Thomas

Re: [Math] Little thought about multi-threading

2012-07-29 Thread Gilles Sadowski
> > [...] > >>> Well, you probably don't want to switch to Java 7 now, [...] > >> > >> Oh, yes, please! 8-P > > > > I would be in favor of this too, but we could also target it for the 4.0 > > release together with the parallelization stuff. > > > > Thomas > > > I would also be in favor of Java 7,

Re: [Math] Little thought about multi-threading

2012-07-28 Thread Sébastien Brisard
Hello, 2012/7/23 Thomas Neidhart : > On 07/22/2012 11:25 PM, Gilles Sadowski wrote: >> [...] Threaded execution, on the other hand, can be very, very helpful for a number of math algorithms and thread management inside commons math is a very reasonable option in those cases. T

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Thomas Neidhart
On 07/22/2012 11:25 PM, Gilles Sadowski wrote: > >>> [...] >>> Threaded execution, on the other hand, can be very, very helpful for a >>> number of math algorithms and thread management inside commons math is a >>> very reasonable option in those cases. This would provide a performance >>> boost

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Phil Steitz
On 7/22/12 2:14 PM, Gilles Sadowski wrote: > On Sun, Jul 22, 2012 at 09:27:17AM -0700, Phil Steitz wrote: >> On 7/21/12 6:17 AM, Gilles Sadowski wrote: >>> Hi. >>> >>> My previous post (with subject "Synchronisation") made me think (again) that >>> it might be useful to start considering how to tak

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Gilles Sadowski
> > [...] > >Threaded execution, on the other hand, can be very, very helpful for a > >number of math algorithms and thread management inside commons math is a > >very reasonable option in those cases. This would provide a performance > >boost with very little complexity for the user of math. Ma

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Gilles Sadowski
On Sun, Jul 22, 2012 at 12:01:01PM -0700, Ted Dunning wrote: > I don't believe that there are any commons math algorithms that would > benefit from execution in a Hadoop map-reduce style. The issue is that > iterative algorithms are essentially incompatible with the very large > startup costs of m

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Gilles Sadowski
On Sun, Jul 22, 2012 at 09:27:17AM -0700, Phil Steitz wrote: > On 7/21/12 6:17 AM, Gilles Sadowski wrote: > > Hi. > > > > My previous post (with subject "Synchronisation") made me think (again) that > > it might be useful to start considering how to take advantage of > > multi-threading in Commons

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Oliver Heger
Am 22.07.2012 21:01, schrieb Ted Dunning: I don't believe that there are any commons math algorithms that would benefit from execution in a Hadoop map-reduce style. The issue is that iterative algorithms are essentially incompatible with the very large startup costs of map-reduce programs under

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Ted Dunning
I don't believe that there are any commons math algorithms that would benefit from execution in a Hadoop map-reduce style. The issue is that iterative algorithms are essentially incompatible with the very large startup costs of map-reduce programs under Hadoop. Some algorithms can be recast to ma

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Phil Steitz
On 7/21/12 6:17 AM, Gilles Sadowski wrote: > Hi. > > My previous post (with subject "Synchronisation") made me think (again) that > it might be useful to start considering how to take advantage of > multi-threading in Commons Math. > Indeed, it seems that some parts of the library might end up not

Re: [Math] Little thought about multi-threading

2012-07-22 Thread Luc Maisonobe
On 22/07/2012 02:29, Gilles Sadowski wrote: > On Sat, Jul 21, 2012 at 11:41:45AM -0700, Ted Dunning wrote: >> The easy way to get much of this benefit is to simply use multi-threaded >> versions of Atlas via jblas. Probably not viable given the no dependency >> posture of commons math. >> > > Whe

Re: [Math] Little thought about multi-threading

2012-07-21 Thread Gilles Sadowski
On Sat, Jul 21, 2012 at 11:41:45AM -0700, Ted Dunning wrote: > The easy way to get much of this benefit is to simply use multi-threaded > versions of Atlas via jblas. Probably not viable given the no dependency > posture of commons math. > When referring to multi-threading, I was not specificall

Re: [Math] Little thought about multi-threading

2012-07-21 Thread Ted Dunning
The easy way to get much of this benefit is to simply use multi-threaded versions of Atlas via jblas. Probably not viable given the no dependency posture of commons math. On Sat, Jul 21, 2012 at 6:17 AM, Gilles Sadowski < gil...@harfang.homelinux.org> wrote: > Hi. > > My previous post (with subj

[Math] Little thought about multi-threading

2012-07-21 Thread Gilles Sadowski
Hi. My previous post (with subject "Synchronisation") made me think (again) that it might be useful to start considering how to take advantage of multi-threading in Commons Math. Indeed, it seems that some parts of the library might end up not being used anymore because their performance simply ca