Re: [Numpy-discussion] Importing a list into a structured numpy array, what is my error?

2011-05-18 Thread Jonathan March
On Wed, May 18, 2011 at 8:56 PM, Robert Love wrote: > > my_list = [[1960, 'W0'],[2001, 'D5']] > > my_arr = np.array(my_list, dtype=('uint', '|S2')) > > gives me an error I don't understand: > > ValueError: mismatch in size of old and new data-descriptor > > What are the old and new? I get t

[Numpy-discussion] Importing a list into a structured numpy array, what is my error?

2011-05-18 Thread Robert Love
my_list = [[1960, 'W0'],[2001, 'D5']] my_arr = np.array(my_list, dtype=('uint', '|S2')) gives me an error I don't understand: ValueError: mismatch in size of old and new data-descriptor What are the old and new? I get the same problem if try np.asarray() If I make the dtype ('|S4', '

Re: [Numpy-discussion] How can Import DATA from a Fortran file

2011-05-18 Thread Derek Homeier
On 19.05.2011, at 12:47AM, Aradenatorix Veckhom Vacelaevus wrote: > I have a file in simple text with information obtained in Fortran 77 and I > need to use the data inside for visualize with Mayavi. I was fighting for a > while with the VTK simple legacy format. Finally I could run an small >

Re: [Numpy-discussion] How can Import DATA from a Fortran file

2011-05-18 Thread Olivier Delalleau
Seems like something the following would work (it's not particularly efficient nor elegant though, and there may be some stupid bug since I didn't actually try it). Also, there may be some more appropriate numpy structure to handle named columns (the example below computes separately a basic numpy

Re: [Numpy-discussion] Memory leak/fragmentation when using np.memmap

2011-05-18 Thread Pauli Virtanen
On Wed, 18 May 2011 16:36:31 -0700, G Jones wrote: [clip] > As a followup, I managed to install tcmalloc as described in the article > I mentioned. Running the example I sent now shows a constant memory foot > print as expected. I am surprised such a solution was necessary. > Certainly others must

Re: [Numpy-discussion] Memory leak/fragmentation when using np.memmap

2011-05-18 Thread G Jones
Hello, I have seen the effect you describe, I had originally assumed this was the case, but in fact there seems to be more to the problem. If it were only the effect you mention, there should not be any memory error because the OS will drop the pages when the memory is actually needed for something

Re: [Numpy-discussion] Memory leak/fragmentation when using np.memmap

2011-05-18 Thread Pauli Virtanen
On Wed, 18 May 2011 15:09:31 -0700, G Jones wrote: [clip] > import numpy as np > > x = np.memmap('mybigfile.bin',mode='r',dtype='uint8') print x.shape # > prints (42940071360,) in my case ndat = x.shape[0] > for k in range(1000): > y = x[k*ndat/1000:(k+1)*ndat/1000].astype('float32') #The ast

[Numpy-discussion] How can Import DATA from a Fortran file

2011-05-18 Thread Aradenatorix Veckhom Vacelaevus
Hi everybody: I have a file in simple text with information obtained in Fortran 77 and I need to use the data inside for visualize with Mayavi. I was fighting for a while with the VTK simple legacy format. Finally I could run an small example, but now I need to select specific information from th

[Numpy-discussion] Memory leak/fragmentation when using np.memmap

2011-05-18 Thread G Jones
Hello, I need to process several large (~40 GB) files. np.memmap seems ideal for this, but I have run into a problem that looks like a memory leak or memory fragmentation. The following code illustrates the problem import numpy as np x = np.memmap('mybigfile.bin',mode='r',dtype='uint8') print x.s

[Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Wieland Brendel
> Glad you solved it. Can you tell us the details of your setup (gcc > version, Cygwin version)? I used the latest mingw 20110316. I can't find out how to get the gcc and cygwin version number though... what are the commands in windows? Cheers Wieland ___

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Bruce Southey
On 05/18/2011 03:28 PM, Ralf Gommers wrote: On Wed, May 18, 2011 at 8:42 PM, Wieland Brendel mailto:wielandbren...@gmx.net>> wrote: I succeeded now in installing the latest Numpy version. There was some problem in mingw32ccompiler.py. I had to change the lines elif

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Ralf Gommers
On Wed, May 18, 2011 at 8:42 PM, Wieland Brendel wrote: > I succeeded now in installing the latest Numpy version. There was some > problem in mingw32ccompiler.py. I had to change the lines > > elif self.gcc_version < "4.": > self.set_executables(compiler='gcc -mno-cyg

[Numpy-discussion] [ANN] Courses in Colorado: "Introduction to Python and Python for Scientists and Engineers" - one day left for early bird rate

2011-05-18 Thread Mike Müller
Python Course in Golden, CO, USA **There is only one day left to take advantage of the early bird rate.** Introduction to Python and Python for Scientists and Engineers -- June 3 - 4, 2011 Introduc

[Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Wieland Brendel
I succeeded now in installing the latest Numpy version. There was some problem in mingw32ccompiler.py. I had to change the lines elif self.gcc_version < "4.": self.set_executables(compiler='gcc -mno-cygwin -O2 -Wall', compiler

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Aradenatorix Veckhom Vacelaevus
Hi Wieland: I see you have troubles isnide windows... mmm I don't enjoy to work with that OS but perhaps you should clean the Registry before reinstall your packages. I suggest you tu download and install the last version of Ccleaner, clean your PC and your Registry before try again. I hope it hel

[Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Wieland Brendel
I have deinstalled scipy, numpy and Python(x,y), reinstalled a newer version of Python (x,y) and run the python install again - same result. However, maybe the build cache was still not cleaned? I used the build command > python setup.py config --compiler=mingw32 build --compiler=mingw32 inst

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Charles R Harris
On Wed, May 18, 2011 at 11:50 AM, Ralf Gommers wrote: > > > On Wed, May 18, 2011 at 7:38 PM, Wieland Brendel > wrote: > >> Dear Ralf, >> thanks for you suggestion - the SVN was of course only the numpy master >> branch. I switched to the latest 1.6.x branch but the compilation stops >> with >> >>

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Ralf Gommers
On Wed, May 18, 2011 at 7:38 PM, Wieland Brendel wrote: > Dear Ralf, > thanks for you suggestion - the SVN was of course only the numpy master > branch. I switched to the latest 1.6.x branch but the compilation stops > with > > > ValueError: invalid version number '4.' > You have a time machine!

[Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Wieland Brendel
Dear Ralf, thanks for you suggestion - the SVN was of course only the numpy master branch. I switched to the latest 1.6.x branch but the compilation stops with > ValueError: invalid version number '4.' in line 107, C:\Python26\lib\distutils\version.py (before was line 40, self.parse(vstring)).

Re: [Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Ralf Gommers
On Wed, May 18, 2011 at 7:17 PM, Wieland Brendel wrote: > Hello, > I am glad Mark was able to resolve the bug in einsum very fast since I > am heavily relying on this function. I am working on a Windows 7 64 bit > system with latest Python 2.6. I tried to build numpy from SVN following > along > >

[Numpy-discussion] Windows dev-build Numpy 1.6.1

2011-05-18 Thread Wieland Brendel
Hello, I am glad Mark was able to resolve the bug in einsum very fast since I am heavily relying on this function. I am working on a Windows 7 64 bit system with latest Python 2.6. I tried to build numpy from SVN following along http://www.scipy.org/Build_for_Windows After installing numpy I r

Re: [Numpy-discussion] strange dimension-dependent behaviour of einsum

2011-05-18 Thread Charles R Harris
On Wed, May 18, 2011 at 8:57 AM, Mark Wiebe wrote: > On Tue, May 17, 2011 at 8:53 PM, Charles R Harris < > charlesr.har...@gmail.com> wrote: > >> On Tue, May 17, 2011 at 7:46 PM, Wieland Brendel >> wrote: >> >>> > The equality being that the expression should be ~0? >>> >>> Exactly. >>> >>> > I

Re: [Numpy-discussion] strange dimension-dependent behaviour of einsum

2011-05-18 Thread Mark Wiebe
On Tue, May 17, 2011 at 8:53 PM, Charles R Harris wrote: > On Tue, May 17, 2011 at 7:46 PM, Wieland Brendel > wrote: > >> > The equality being that the expression should be ~0? >> >> Exactly. >> >> > I see the problem when the last index is in the range 235 - 390. >> >> Good to see I am not the

Re: [Numpy-discussion] cPickle.load says 'invalid signature'

2011-05-18 Thread Olivier Delalleau
It's a wild guess, but try to save your pickle with 'wb' as argument of open, and protocol=-1. Then open it with 'rb'. It helped me fix some cross-platform issues in the past. -=- Olivier 2011/5/18 Neal Becker > The file is pickle saved on i386 and loaded on x86_64. It contains a numpy > array

Re: [Numpy-discussion] cPickle.load says 'invalid signature'

2011-05-18 Thread Pauli Virtanen
Wed, 18 May 2011 07:39:18 -0400, Neal Becker wrote: > The file is pickle saved on i386 and loaded on x86_64. It contains a > numpy array (amoungst other things). > > On load it says: > > RuntimeError: invalid signature There's no such message in Numpy source code, so the error does not come dir

[Numpy-discussion] cPickle.load says 'invalid signature'

2011-05-18 Thread Neal Becker
The file is pickle saved on i386 and loaded on x86_64. It contains a numpy array (amoungst other things). On load it says: RuntimeError: invalid signature Is binary format not portable? ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org h