Re: [Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Bruce Southey
Hi, Why tuples as your g() function is one floats and h() is on strings with g() and h() independent? You should be able vectorize this very easily since everything just depends on the tuple value (you need to write g() and/or h() in matrix/vector notation first). But you need to supply either the

[Numpy-discussion] degree to which numpy releases threads

2007-04-07 Thread Anne Archibald
On 07/04/07, Fernando Perez <[EMAIL PROTECTED]> wrote: > You are correct. If g,h in the OP's description satisfy: > > a) they are bloody expensive > > b) they release the GIL internally via the proper C API calls, which > means they are promising not to modify any shared python objects > > the pu

Re: [Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Fernando Perez
On 4/7/07, Stefan van der Walt <[EMAIL PROTECTED]> wrote: > On Sat, Apr 07, 2007 at 02:48:47PM -0400, Anne Archibald wrote: > > If none of those algorithmic improvements are possible, you can look > > at other possibilities for speeding things up (though the speedups > > will be modest). Parallelis

Re: [Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Stefan van der Walt
On Sat, Apr 07, 2007 at 02:48:47PM -0400, Anne Archibald wrote: > If none of those algorithmic improvements are possible, you can look > at other possibilities for speeding things up (though the speedups > will be modest). Parallelism is an obvious one - if you've got a > multicore machine you may

Re: [Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Anne Archibald
On 07/04/07, Steve Staneff <[EMAIL PROTECTED]> wrote: Hi, I'm looking for a better solution to managing a very large calculation. Set A is composed of tuples a, each of the form a = [float, string]; set B is composed of tuples of similar structure (b = [float, string]). For each possible combin

Re: [Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Charles R Harris
On 4/7/07, Steve Staneff <[EMAIL PROTECTED]> wrote: Hi, I'm looking for a better solution to managing a very large calculation. Set A is composed of tuples a, each of the form a = [float, string]; set B is composed of tuples of similar structure (b = [float, string]). For each possible combina

[Numpy-discussion] newbie question - large dataset

2007-04-07 Thread Steve Staneff
Hi, I'm looking for a better solution to managing a very large calculation. Set A is composed of tuples a, each of the form a = [float, string]; set B is composed of tuples of similar structure (b = [float, string]). For each possible combination of a and b I'm calculating c, of the form c = f(a