Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 3. okt. 2012, at 18:22, Chris Barker wrote: > On Wed, Oct 3, 2012 at 9:05 AM, Paul Anton Letnes > wrote: > >>> I'm not sure the problem you are trying to solve -- accumulating in a >>> list is pretty efficient anyway -- not a whole lot overhead. >> >> Oh, there's significant overhead, since

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Chris Barker
On Wed, Oct 3, 2012 at 9:05 AM, Paul Anton Letnes wrote: >> I'm not sure the problem you are trying to solve -- accumulating in a >> list is pretty efficient anyway -- not a whole lot overhead. > > Oh, there's significant overhead, since we're not talking of a list - we're > talking of a list-of

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 1. okt. 2012, at 21:07, Chris Barker wrote: > Paul, > > Nice to see someone working on these issues, but: > > I'm not sure the problem you are trying to solve -- accumulating in a > list is pretty efficient anyway -- not a whole lot overhead. Oh, there's significant overhead, since we're no

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Paul Anton Letnes
On 3. okt. 2012, at 17:48, Wes McKinney wrote: > On Monday, October 1, 2012, Chris Barker wrote: > Paul, > > Nice to see someone working on these issues, but: > > I'm not sure the problem you are trying to solve -- accumulating in a > list is pretty efficient anyway -- not a whole lot overhead.

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-03 Thread Wes McKinney
On Monday, October 1, 2012, Chris Barker wrote: > Paul, > > Nice to see someone working on these issues, but: > > I'm not sure the problem you are trying to solve -- accumulating in a > list is pretty efficient anyway -- not a whole lot overhead. > > But if you do want to improve that, it may be b

Re: [Numpy-discussion] memory-efficient loadtxt

2012-10-01 Thread Chris Barker
Paul, Nice to see someone working on these issues, but: I'm not sure the problem you are trying to solve -- accumulating in a list is pretty efficient anyway -- not a whole lot overhead. But if you do want to improve that, it may be better to change the accumulating method, rather than doing the

Re: [Numpy-discussion] memory-efficient loadtxt

2012-09-30 Thread Paul Anton Letnes
For convenience and clarity, this is the diff in question: https://github.com/Dynetrekk/numpy-1/commit/5bde67531a2005ef80a2690a75c65cebf97c9e00 And this is my numpy fork: https://github.com/Dynetrekk/numpy-1/ Paul On Sun, Sep 30, 2012 at 4:14 PM, Paul Anton Letnes wrote: > Hello everyone, > >