Re: [Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Charles R Harris
On 11/29/06, Mathew Yeates <[EMAIL PROTECTED]> wrote: whoa. I just found out that A=A.transpose() does nothing but change A's flags from C_CONTIGUOUS to F_CONTIGUOUS!! Okay, so heres the question .. I am reading data into the columns of a matrix. In order to speed this up, I want to read va

Re: [Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Charles R Harris
On 11/29/06, Mathew Yeates <[EMAIL PROTECTED]> wrote: whoa. I just found out that A=A.transpose() does nothing but change A's flags from C_CONTIGUOUS to F_CONTIGUOUS!! Okay, so heres the question .. I am reading data into the columns of a matrix. In order to speed this up, I want to read va

Re: [Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Mathew Yeates
whoa. I just found out that A=A.transpose() does nothing but change A's flags from C_CONTIGUOUS to F_CONTIGUOUS!! Okay, so heres the question .. I am reading data into the columns of a matrix. In order to speed this up, I want to read values into the rows of a matrix and when I am all done,

Re: [Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Mathew Yeates
Hmm I'm trying to duplicate the behavior with a simple program - import numpy datasize=5529000 numrows=121 fd=open("biggie","w") fd.close() big=numpy.memmap("biggie",mode="readwrite", shape=(numrows,datasize),dtype=numpy.float32) c=numpy.ones(shape=(datasize,),dtype=numpy.float32) for r

Re: [Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Robert Kern
Mathew Yeates wrote: > Hi > > I have a line in my program that looks like > outarr[1,:] = computed_array > where outarr is a memory mapped file. This takes forever. > > I checked and copying the data using "cp" at the command line takes 1 > or 2 seconds. So the problem can't be attributed simp

[Numpy-discussion] insanely slow writing to memory mapped array

2006-11-29 Thread Mathew Yeates
Hi I have a line in my program that looks like outarr[1,:] = computed_array where outarr is a memory mapped file. This takes forever. I checked and copying the data using "cp" at the command line takes 1 or 2 seconds. So the problem can't be attributed simply to disk i/o. Is it because the el