Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-24 Thread Mark Wiebe
On Wed, Aug 24, 2011 at 6:09 PM, Wes McKinney wrote: > > - Performance with skipna is a bit disappointing: > > In [52]: arr = np.random.randn(1e6) > In [54]: arr.flags.maskna = True > In [56]: arr[::2] = np.NA > In [58]: timeit arr.sum(skipna=True) > 100 loops, best of 3: 7.31 ms per loop > > th

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-24 Thread Mark Wiebe
On Wed, Aug 24, 2011 at 6:09 PM, Wes McKinney wrote: > On Wed, Aug 24, 2011 at 8:19 PM, Mark Wiebe wrote: > > On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey > wrote: > >> > >> Hi, > >> > >> > >> 2) Can the 'skipna' flag be added to the methods? > >> >>> a.sum(skipna=True) > >> Traceback (most

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-24 Thread Wes McKinney
On Wed, Aug 24, 2011 at 8:19 PM, Mark Wiebe wrote: > On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey wrote: >> >> Hi, >> >> >> 2) Can the 'skipna' flag be added to the methods? >> >>> a.sum(skipna=True) >> Traceback (most recent call last): >>  File "", line 1, in >> TypeError: 'skipna' is an i

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-24 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey wrote: > Hi, > > > 2) Can the 'skipna' flag be added to the methods? > >>> a.sum(skipna=True) > Traceback (most recent call last): > File "", line 1, in > TypeError: 'skipna' is an invalid keyword argument for this function > >>> np.sum(a,skipna

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-20 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 4:52 PM, Bruce Southey wrote: > On Fri, Aug 19, 2011 at 3:05 PM, Mark Wiebe wrote: > > On Fri, Aug 19, 2011 at 11:44 AM, Charles R Harris > > wrote: > >> > >> > >> > >> > >> My main peeve is that NA is upper case ;) I suppose that could use some > >> discussion. > > > >

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-20 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey wrote: > Hi, > Just some immediate minor observations that are really about trying to > be consistent: > > 1) Could you keep the display of the NA dtype be the same as the array? > For example, NA dtype is displayed as ' 'float64' as that is the arr

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On Fri, Aug 19, 2011 at 3:05 PM, Mark Wiebe wrote: > On Fri, Aug 19, 2011 at 11:44 AM, Charles R Harris > wrote: >> >> >> On Fri, Aug 19, 2011 at 12:37 PM, Bruce Southey >> wrote: >>> >>> Hi, >>> Just some immediate minor observations that are really about trying to >>> be consistent: >>> >>> 1)

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Thu, Aug 18, 2011 at 2:43 PM, Mark Wiebe wrote: > It's taken a lot of changes to get the NA mask support to its current > point, but the code ready for some testing now. You can read the > work-in-progress release notes here: > > > https://github.com/m-paradox/numpy/blob/missingdata/doc/releas

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 11:44 AM, Charles R Harris < charlesr.har...@gmail.com> wrote: > > > On Fri, Aug 19, 2011 at 12:37 PM, Bruce Southey wrote: > >> Hi, >> Just some immediate minor observations that are really about trying to >> be consistent: >> >> 1) Could you keep the display of the NA dty

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Ralf Gommers
On Fri, Aug 19, 2011 at 9:15 PM, Mark Wiebe wrote: > On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey wrote: > >> Hi, >> Just some immediate minor observations that are really about trying to >> be consistent: >> >> 1) Could you keep the display of the NA dtype be the same as the array? >> For exa

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 11:37 AM, Bruce Southey wrote: > Hi, > Just some immediate minor observations that are really about trying to > be consistent: > > 1) Could you keep the display of the NA dtype be the same as the array? > For example, NA dtype is displayed as ' 'float64' as that is the arr

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Charles R Harris
On Fri, Aug 19, 2011 at 12:37 PM, Bruce Southey wrote: > Hi, > Just some immediate minor observations that are really about trying to > be consistent: > > 1) Could you keep the display of the NA dtype be the same as the array? > For example, NA dtype is displayed as ' 'float64' as that is the arr

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
Hi, Just some immediate minor observations that are really about trying to be consistent: 1) Could you keep the display of the NA dtype be the same as the array? For example, NA dtype is displayed as '>> a=np.array([[1,2,3,np.NA], [3,4,np.nan,5]]) >>> a array([[ 1., 2., 3., NA], [ 3.,

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 11:07 AM, Charles R Harris < charlesr.har...@gmail.com> wrote: > > > On Fri, Aug 19, 2011 at 11:55 AM, Bruce Southey wrote: > >> On Fri, Aug 19, 2011 at 10:48 AM, Mark Wiebe wrote: >> > On Fri, Aug 19, 2011 at 7:15 AM, Bruce Southey >> wrote: >> >> >> >> On 08/18/2011 04:

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Charles R Harris
On Fri, Aug 19, 2011 at 11:55 AM, Bruce Southey wrote: > On Fri, Aug 19, 2011 at 10:48 AM, Mark Wiebe wrote: > > On Fri, Aug 19, 2011 at 7:15 AM, Bruce Southey > wrote: > >> > >> On 08/18/2011 04:43 PM, Mark Wiebe wrote: > >> > >> It's taken a lot of changes to get the NA mask support to its cu

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On Fri, Aug 19, 2011 at 10:27 AM, Ralf Gommers wrote: > > > On Fri, Aug 19, 2011 at 5:23 PM, Bruce Southey wrote: >> >> On 08/19/2011 10:04 AM, Ralf Gommers wrote: >> >> On Fri, Aug 19, 2011 at 4:55 PM, Bruce Southey wrote: >>> >>> Hi, >>> I had to rebuild my Python2.6 as a 'normal' version. >>>

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On Fri, Aug 19, 2011 at 10:48 AM, Mark Wiebe wrote: > On Fri, Aug 19, 2011 at 7:15 AM, Bruce Southey wrote: >> >> On 08/18/2011 04:43 PM, Mark Wiebe wrote: >> >> It's taken a lot of changes to get the NA mask support to its current >> point, but the code ready for some testing now. You can read t

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 7:15 AM, Bruce Southey wrote: > ** > On 08/18/2011 04:43 PM, Mark Wiebe wrote: > > It's taken a lot of changes to get the NA mask support to its current > point, but the code ready for some testing now. You can read the > work-in-progress release notes here: > > > https://

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Ralf Gommers
On Fri, Aug 19, 2011 at 5:23 PM, Bruce Southey wrote: > ** > On 08/19/2011 10:04 AM, Ralf Gommers wrote: > > > > On Fri, Aug 19, 2011 at 4:55 PM, Bruce Southey wrote: > >> Hi, >> I had to rebuild my Python2.6 as a 'normal' version. >> >> Anyhow, Python2.4, 2.5, 2.6 and 2.7 all build and pass t

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On 08/19/2011 10:04 AM, Ralf Gommers wrote: On Fri, Aug 19, 2011 at 4:55 PM, Bruce Southey > wrote: Hi, I had to rebuild my Python2.6 as a 'normal' version. Anyhow, Python2.4, 2.5, 2.6 and 2.7 all build and pass the numpy tests. Curiously, only

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Mark Wiebe
On Fri, Aug 19, 2011 at 7:55 AM, Bruce Southey wrote: > ** > On 08/18/2011 04:43 PM, Mark Wiebe wrote: > > It's taken a lot of changes to get the NA mask support to its current > point, but the code ready for some testing now. You can read the > work-in-progress release notes here: > > > https://

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Ralf Gommers
On Fri, Aug 19, 2011 at 4:55 PM, Bruce Southey wrote: > ** > > Hi, > I had to rebuild my Python2.6 as a 'normal' version. > > Anyhow, Python2.4, 2.5, 2.6 and 2.7 all build and pass the numpy tests. > > Curiously, only tests in Python2.7 give almost no warnings but all the > other Python2.x give

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On 08/18/2011 04:43 PM, Mark Wiebe wrote: It's taken a lot of changes to get the NA mask support to its current point, but the code ready for some testing now. You can read the work-in-progress release notes here: https://github.com/m-paradox/numpy/blob/missingdata/doc/release/2.0.0-notes.rst

Re: [Numpy-discussion] NA masks for NumPy are ready to test

2011-08-19 Thread Bruce Southey
On 08/18/2011 04:43 PM, Mark Wiebe wrote: It's taken a lot of changes to get the NA mask support to its current point, but the code ready for some testing now. You can read the work-in-progress release notes here: https://github.com/m-paradox/numpy/blob/missingdata/doc/release/2.0.0-notes.rst

[Numpy-discussion] NA masks for NumPy are ready to test

2011-08-18 Thread Mark Wiebe
It's taken a lot of changes to get the NA mask support to its current point, but the code ready for some testing now. You can read the work-in-progress release notes here: https://github.com/m-paradox/numpy/blob/missingdata/doc/release/2.0.0-notes.rst To try it out, check out the missingdata bran