Re: [Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread eat
Hi, On Tue, Mar 27, 2012 at 12:12 PM, Nicole Stoffels < nicole.stoff...@forwind.de> wrote: > ** > Dear all, > > I get the following memory error while running my program: > > *Traceback (most recent call last): > File "/home/nistl/Software/Netzbetreiber/FLOW/src/MemoryError_Debug.py", > line 9,

Re: [Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread Olivier Delalleau
Le 27 mars 2012 06:04, Nicole Stoffels a écrit : > ** > Hi Pierre, > > thanks for the fast answer! > > I actually have timeseries of 24 hours for 459375 gridpoints in Europe. > The timeseries of every grid point is stored in a column. That's why in my > real program I already transposed the data,

Re: [Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread Richard Hattersley
> Both work on my computer, while your example indeed leads to a MemoryError > (because shape 459375*459375 would be a decently big matrix...) Nicely understated :) For 32-bit values "decently big" => 786GB ___ NumPy-Discussion mailing list NumPy-Discus

Re: [Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread Nicole Stoffels
Hi Pierre, thanks for the fast answer! I actually have timeseries of 24 hours for 459375 gridpoints in Europe. The timeseries of every grid point is stored in a column. That's why in my real program I already transposed the data, so that the correlation is made column by column. What I finall

Re: [Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread Pierre Haessig
Hi Nicole, Le 27/03/2012 11:12, Nicole Stoffels a écrit : > *if __name__ == '__main__': > > data_records = random.random((459375, 24)) > correlation = corrcoef(data_records)* May I assume that your data_record is made of 24 different variables of which you have 459375 observations ?

[Numpy-discussion] Numpy Memory Error with corrcoef

2012-03-27 Thread Nicole Stoffels
Dear all, I get the following memory error while running my program: *Traceback (most recent call last): File "/home/nistl/Software/Netzbetreiber/FLOW/src/MemoryError_Debug.py", line 9, in correlation = corrcoef(data_records) File "/usr/lib/python2.7/dist-packages/numpy/lib/function_