Re: [Numpy-discussion] Dates and times and Datetime64 (again)

2014-03-27 Thread Sankarshan Mudkavi
Hi all,Apologies for the delay in following up, here is an expanded version of the proposal, which hopefully clears up most of the details. I have not included specific implementation details for the code, such as which functions to modify etc. since I think those are not traditionally included in

Re: [Numpy-discussion] [SciPy-Dev] Windows wheels using MKL?

2014-03-27 Thread Matthew Brett
On Thu, Mar 27, 2014 at 2:04 PM, Robert Kern wrote: > On Thu, Mar 27, 2014 at 7:10 PM, Matthew Brett > wrote: >> Hi, >> >> On Thu, Mar 27, 2014 at 3:18 AM, Robert Kern wrote: > >>> It would be confusing to distribute these non-BSD wheels on the same >>> PyPI page that declares most prominently

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread Eelco Hoogendoorn
Id recommend taking a look at pytables as well. It has support for out-of-core array computations on large arrays. On Thu, Mar 27, 2014 at 9:00 PM, RayS wrote: > Thanks for all of the suggestions; we are migrating to 64bit Python soon > as well. > The environments are Win7 and Mac Maverics. >

Re: [Numpy-discussion] f2py links extensions to incorrect python installation on OSX / Anaconda

2014-03-27 Thread Alex Goodman
Hi Robert, That did the trick, thanks! Alex On Thu, Mar 27, 2014 at 3:02 PM, Robert Kern wrote: > On Thu, Mar 27, 2014 at 8:50 PM, David Cournapeau > wrote: > > > > On Thu, Mar 27, 2014 at 8:30 PM, Alex Goodman < > alex.good...@colostate.edu> > > wrote: > >> > >> Hi all, > >> > >> I have used

Re: [Numpy-discussion] [SciPy-Dev] Windows wheels using MKL?

2014-03-27 Thread Robert Kern
On Thu, Mar 27, 2014 at 7:10 PM, Matthew Brett wrote: > Hi, > > On Thu, Mar 27, 2014 at 3:18 AM, Robert Kern wrote: >> It would be confusing to distribute these non-BSD wheels on the same >> PyPI page that declares most prominently that numpy is BSD-licensed. >> Adding some text elsewhere on the

Re: [Numpy-discussion] f2py links extensions to incorrect python installation on OSX / Anaconda

2014-03-27 Thread Robert Kern
On Thu, Mar 27, 2014 at 8:50 PM, David Cournapeau wrote: > > On Thu, Mar 27, 2014 at 8:30 PM, Alex Goodman > wrote: >> >> Hi all, >> >> I have used f2py in the past on a Linux machine with virtually no issues. >> However on my Mac, I get the following error when importing an f2py >> generated ext

Re: [Numpy-discussion] f2py links extensions to incorrect python installation on OSX / Anaconda

2014-03-27 Thread David Cournapeau
On Thu, Mar 27, 2014 at 8:30 PM, Alex Goodman wrote: > Hi all, > > I have used f2py in the past on a Linux machine with virtually no issues. > However on my Mac, I get the following error when importing an f2py > generated extension: > > Fatal Python error: PyThreadState_Get: no current thread > A

[Numpy-discussion] f2py links extensions to incorrect python installation on OSX / Anaconda

2014-03-27 Thread Alex Goodman
Hi all, I have used f2py in the past on a Linux machine with virtually no issues. However on my Mac, I get the following error when importing an f2py generated extension: Fatal Python error: PyThreadState_Get: no current thread Abort trap: 6 After doing some research I found out that the extensi

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread RayS
Thanks for all of the suggestions; we are migrating to 64bit Python soon as well. The environments are Win7 and Mac Maverics. carray sounds like what you said Chris - more I just found at http://kmike.ru/python-data-structures/ - Ray Schumacher At 12:31 PM 3/27/2014, you wrote: On Thu, Mar

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread Chris Barker
On Thu, Mar 27, 2014 at 7:42 AM, RayS wrote: > I find this interesting, since I work with medical data sets of 100s > of MB, and regularly run into memory allocation problems when doing a > lot of Fourrier analysis, waterfalls etc. The per-process limit seems > to be about 1.3GB on this 6GB quad-

Re: [Numpy-discussion] Windows wheels using MKL?

2014-03-27 Thread Matthew Brett
Hi, On Thu, Mar 27, 2014 at 12:10 PM, Matthew Brett wrote: > Hi, > > On Thu, Mar 27, 2014 at 3:18 AM, Robert Kern wrote: >> On Thu, Mar 27, 2014 at 12:29 AM, Matthew Brett >> wrote: >>> Hi, >>> >>> On Wed, Mar 26, 2014 at 4:48 PM, Matthew Brett >>> wrote: Hi, Can I check what

Re: [Numpy-discussion] Windows wheels using MKL?

2014-03-27 Thread Matthew Brett
Hi, On Thu, Mar 27, 2014 at 3:18 AM, Robert Kern wrote: > On Thu, Mar 27, 2014 at 12:29 AM, Matthew Brett > wrote: >> Hi, >> >> On Wed, Mar 26, 2014 at 4:48 PM, Matthew Brett >> wrote: >>> Hi, >>> >>> Can I check what is stopping us building official numpy binary wheels >>> for Windows using

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread Jerome Kieffer
On Thu, 27 Mar 2014 16:19:54 + "Aaron O'Leary" wrote: > > You might want to look at hdf5 if you're routinely running out of ram. > I'm using h5py with multi gigabyte data on an ssd right now. It is very > fast. You still have to be careful with your computations and try to > avoid creating c

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread Aaron O'Leary
You might want to look at hdf5 if you're routinely running out of ram. I'm using h5py with multi gigabyte data on an ssd right now. It is very fast. You still have to be careful with your computations and try to avoid creating copies though. hypy: www.h5py.org aaron On Thu 27 Mar, RayS wrote: >

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread RayS
I find this interesting, since I work with medical data sets of 100s of MB, and regularly run into memory allocation problems when doing a lot of Fourrier analysis, waterfalls etc. The per-process limit seems to be about 1.3GB on this 6GB quad-i7 with Win7. For live data collection routines I s

Re: [Numpy-discussion] Default builds of OpenBLAS development branch are now fork safe

2014-03-27 Thread josef . pktd
On Thu, Mar 27, 2014 at 9:59 AM, Olivier Grisel wrote: > 2014-03-27 14:55 GMT+01:00 : >> On Wed, Mar 26, 2014 at 5:17 PM, Olivier Grisel >> wrote: >>> My understanding of Carl's effort is that the long term goal is to >>> have official windows whl packages for both numpy and scipy published >>>

Re: [Numpy-discussion] Default builds of OpenBLAS development branch are now fork safe

2014-03-27 Thread Olivier Grisel
2014-03-27 14:55 GMT+01:00 : > On Wed, Mar 26, 2014 at 5:17 PM, Olivier Grisel > wrote: >> My understanding of Carl's effort is that the long term goal is to >> have official windows whl packages for both numpy and scipy published >> on PyPI with a builtin BLAS / LAPACK implementation so that use

Re: [Numpy-discussion] Default builds of OpenBLAS development branch are now fork safe

2014-03-27 Thread josef . pktd
On Wed, Mar 26, 2014 at 5:17 PM, Olivier Grisel wrote: > My understanding of Carl's effort is that the long term goal is to > have official windows whl packages for both numpy and scipy published > on PyPI with a builtin BLAS / LAPACK implementation so that users can > do `pip install scipy` under

Re: [Numpy-discussion] Default builds of OpenBLAS development branch are now fork safe

2014-03-27 Thread Olivier Grisel
2014-03-26 16:27 GMT+01:00 Olivier Grisel : > Hi Carl, > > I installed Python 2.7.6 64 bits on a windows server instance from > rackspace cloud and then ran get-pip.py and then could successfully > install the numpy and scipy wheel packages from your google drive > folder. I tested dot products and

Re: [Numpy-discussion] Windows wheels using MKL?

2014-03-27 Thread Robert Kern
On Thu, Mar 27, 2014 at 12:29 AM, Matthew Brett wrote: > Hi, > > On Wed, Mar 26, 2014 at 4:48 PM, Matthew Brett > wrote: >> Hi, >> >> Can I check what is stopping us building official numpy binary wheels >> for Windows using the Intel Math Kernel Library? >> >> * We'd need developer licenses, bu

Re: [Numpy-discussion] Is there a pure numpy recipe for this?

2014-03-27 Thread Slaunger
Chris Barker - NOAA Federal wrote > note that numpy arrays are not re-sizable, so np.append() and np.insert() > have to make a new array, and copy all the old data over. If you are > appending one at a time, this can be pretty darn slow. > > I wrote a "grow_array" class once, it was a wrapper aro