Re: [Numpy-discussion] Vector/matrix with 3200975422129 elements

2011-05-03 Thread Dan Halbert
On 5/3/2011 9:34 PM, Dan Halbert wrote: > On 5/3/2011 7:52 PM, Gaston Fiore wrote: >> I'm trying to create a vector (or a matrix, could be either) with >> 3200975422129 elements but I'm not being successful > In words, that's about 3.2 trillion float32's, so

Re: [Numpy-discussion] Vector/matrix with 3200975422129 elements

2011-05-03 Thread Dan Halbert
On 5/3/2011 7:52 PM, Gaston Fiore wrote: > I'm trying to create a vector (or a matrix, could be either) with > 3200975422129 elements but I'm not being successful In words, that's about 3.2 trillion float32's, so about 24 trillion bytes, > 2^41. So, yes, you are running out of memory, by a factor

Re: [Numpy-discussion] numpy.load truncates read from network file on XP

2011-04-29 Thread Dan Halbert
On Thursday, April 28, 2011 5:22pm, "Dan Halbert" said: > I'm having trouble loading a large remote .npy file on Windows XP. This is on > numpy-1.3.0 on Windows XP SP3: > > numpy.load(r'\\myserver\mydir\big.npy') > > will fail with this sort of

[Numpy-discussion] numpy.load truncates read from network file on XP

2011-04-28 Thread Dan Halbert
I'm having trouble loading a large remote .npy file on Windows XP. This is on numpy-1.3.0 on Windows XP SP3: numpy.load(r'\\myserver\mydir\big.npy') will fail with this sort of error being printed: "14328000 items requested but only 54 read" and then I get this with a backtrace: "Val

Re: [Numpy-discussion] What Requires C and what is just python

2011-03-20 Thread Dan Halbert
On Sunday, March 20, 2011 11:08am, "Ben Smith" said: > ... What I'd like to do is > limit myself to just the functions that are implemented in python, package it > with > py2exe and hand that to anyone that needs it. So, my question, if anyone > knows, > what's implemented in python and what de

Re: [Numpy-discussion] rewriting NumPy code in C or C++ or similar

2011-03-07 Thread Dan Halbert
On 3/7/2011 9:25 PM, Nathaniel Smith wrote: > On Mon, Mar 7, 2011 at 3:36 PM, Dan Halbert wrote: >> Or is there some higher-level compiled array language that looks something >> like NumPy code? > > You might want to try Eigen: >http://eigen.tuxfamily.org/ Thanks

Re: [Numpy-discussion] rewriting NumPy code in C or C++ or similar

2011-03-07 Thread Dan Halbert
On 3/7/2011 9:13 PM, Sturla Molden wrote: > Den 08.03.2011 00:36, skrev Dan Halbert: >> Do you all have some recommendations about tools, libraries, or languages >> that you have used to rewrite NumPy code easily into something that's more >> self-contained and calla

Re: [Numpy-discussion] rewriting NumPy code in C or C++ or similar

2011-03-07 Thread Dan Halbert
On 3/7/2011 6:48 PM, Christopher Barker wrote: > On 3/7/11 3:36 PM, Dan Halbert wrote: >> We currently have some straightforward NumPy code that indirectly implements >> a C API defined by a third party. We built a Cython layer that directly >> provides the API in a .a li

[Numpy-discussion] rewriting NumPy code in C or C++ or similar

2011-03-07 Thread Dan Halbert
We currently have some straightforward NumPy code that indirectly implements a C API defined by a third party. We built a Cython layer that directly provides the API in a .a library, and then calls Python. The layering looks like this: C main program -> API in Cython -> Python -> NumPy This i