Excerpts from Holger Herrlich's message of Tue Apr 03 09:06:09 -0400 2012:
>
> Hi, I plan to migrate core classes of an application from Python to C++
> using SWIG, while still the user interface being Python. I also plan to
> further use NumPy's ndarrays.
>
> The application's core classes will
Excerpts from Nathaniel Smith's message of Wed Feb 29 13:17:53 -0500 2012:
> On Wed, Feb 29, 2012 at 3:11 PM, Erin Sheldon wrote:
> > Excerpts from Nathaniel Smith's message of Tue Feb 28 17:22:16 -0500 2012:
> >> > Even for binary, there are pathological
Excerpts from Erin Sheldon's message of Wed Feb 29 10:11:51 -0500 2012:
> Actually, for numpy.memmap you will read the whole file if you try to
> grab a single column and read a large fraction of the rows. Here is an
That should have been: "...read *all* the rows".
-e
--
Erin Scott Sheldon
Broo
Excerpts from Nathaniel Smith's message of Tue Feb 28 17:22:16 -0500 2012:
> > Even for binary, there are pathological cases, e.g. 1) reading a random
> > subset of nearly all rows. 2) reading a single column when rows are
> > small. In case 2 you will only go this route in the first place if you
Hi All -
I've added the relevant code to my numpy fork here
https://github.com/esheldon/numpy
The python module and c file are at /numpy/lib/recfile.py and
/numpy/lib/src/_recfile.c Access from python is numpy.recfile
See below for the doc string for the main class, Recfile. Some example
Excerpts from Nathaniel Smith's message of Mon Feb 27 12:07:11 -0500 2012:
> On Mon, Feb 27, 2012 at 2:44 PM, Erin Sheldon wrote:
> > What I've got is a solution for writing and reading structured arrays to
> > and from files, both in text files and binary files. I
Excerpts from Jay Bourque's message of Mon Feb 27 00:24:25 -0500 2012:
> Hi Erin,
>
> I'm the one Travis mentioned earlier about working on this. I was planning on
> diving into it this week, but it sounds like you may have some code already
> that
> fits the requirements? If so, I would be ava
Excerpts from Erin Sheldon's message of Sun Feb 26 17:35:00 -0500 2012:
> Excerpts from Warren Weckesser's message of Sun Feb 26 16:22:35 -0500 2012:
> > Yes, thanks! I'm working on a mmap version now. I'm very curious to see
> > just how much of an improvement it can give.
>
> FYI, memmap is g
Excerpts from Warren Weckesser's message of Sun Feb 26 16:22:35 -0500 2012:
> Yes, thanks! I'm working on a mmap version now. I'm very curious to see
> just how much of an improvement it can give.
FYI, memmap is generally an incomplete solution for numpy arrays; it
only understands rows, not co
Excerpts from Wes McKinney's message of Sat Feb 25 15:49:37 -0500 2012:
> That may work-- I haven't taken a look at the code but it is probably
> a good starting point. We could create a new repo on the pydata GitHub
> org (http://github.com/pydata) and use that as our point of
> collaboration. I w
Excerpts from Travis Oliphant's message of Thu Feb 23 15:08:52 -0500 2012:
> This is actually on my short-list as well --- it just didn't make it to the
> list.
>
> In fact, we have someone starting work on it this week. It is his
> first project so it will take him a little time to get up to s
Excerpts from Wes McKinney's message of Thu Feb 23 16:07:04 -0500 2012:
> That's pretty good. That's faster than pandas's csv-module+Cython
> approach almost certainly (but I haven't run your code to get a read
> on how much my hardware makes a difference), but that's not shocking
> at all:
>
> In
Excerpts from Wes McKinney's message of Thu Feb 23 15:45:18 -0500 2012:
> Reasonably wide CSV files with hundreds of thousands to millions of
> rows. I have a separate interest in JSON handling but that is a
> different kind of problem, and probably just a matter of forking
> ultrajson and having i
Excerpts from Wes McKinney's message of Thu Feb 23 15:24:44 -0500 2012:
> On Thu, Feb 23, 2012 at 3:23 PM, Erin Sheldon wrote:
> > I designed the recfile package to fill this need. It might be a start.
> Can you relicense as BSD-compatible?
If required, that would be
Wes -
I designed the recfile package to fill this need. It might be a start.
Some features:
- the ability to efficiently read any subset of the data without
loading the whole file.
- reads directly into a recarray, so no overheads.
- object oriented interface, mimicking rec
Excerpts from Mark Wiebe's message of Sat Feb 04 18:24:58 -0500 2012:
> The names issue is a bit trickier. There has been some back and forth in
> some tickets, and I recall some discussion on the mailing list, but that
> may be long ago and without clear resolution. That this should be changed
> i
ue, also return the weighted standard deviation as a third
element in the tuple.
OUTPUTS:
wmean, werr: A tuple of the weighted mean and error. If sdev=True the
tuple will also contain sdev: wmean,werr,wsdev
REVISION HISTORY:
Converted from IDL: 2006-10-23. Erin Sh
Excerpts from Guillaume Chérel's message of Fri Sep 03 09:32:02 -0400 2010:
> Hello,
>
> I'd like to know if there is a convenient routine to write recarrays
> into cvs files, with the first line of the file being the name of the
> fields.
>
> Thanks,
> Guillaume
Yes, you can do this with th
Excerpts from Johann Bauer's message of Wed Aug 18 14:07:48 -0400 2010:
> Hi,
>
> is there a good method to find the index of the first element in a 1D
> array fulfilling a condition?
>
> The following does the job
>
> >>> import numpy
> >>> a = numpy.array([1,5,78,3,12,4])
> >>> numpy.where( a
er to row/column you
are interested in.
Note the accessor methods are not type safe, you still need to know what
type you need to cast the pointer to. This can be determined at runtime
from the type code, which you can get via the typecode() method. I've
considered adding "get" met
On Thu, Sep 17, 2009 at 6:12 PM, David Warde-Farley wrote:
> If I have a 1-dimensional array with a structured dtype, say str,
> float, float, float, float where all the float columns have their
> own names, and I just want to extract all the floats in the order they
> appear into a 2D matrix
Matthew, this is a very clear description of all the issues, and I now
see why it can be useful to keep the two methods separate. I think an
update to the doc string for byteswap() with this description would be
useful. Or perhaps a keyword to byteswap() in which one could specify
the behavior re
On 5/30/07, Erin Sheldon <[EMAIL PROTECTED]> wrote:
> On 5/30/07, Francesc Altet <[EMAIL PROTECTED]> wrote:
> > El dt 29 de 05 del 2007 a les 14:17 -0400, en/na Erin Sheldon va
> > escriure:
> > > Hi all -
> > >
> > > I have read som
On 5/30/07, Francesc Altet <[EMAIL PROTECTED]> wrote:
> El dt 29 de 05 del 2007 a les 14:17 -0400, en/na Erin Sheldon va
> escriure:
> > Hi all -
> >
> > I have read some big-endian data and I want to byte swap it to little
> > endian. If I use
> >
Hi all -
I have read some big-endian data and I want to byte swap it to little
endian. If I use
a.byteswap(True)
the bytes clearly get swapped, but the dtype is not updated to reflect
the new data type. e.g
[~]|1> a=N.array([2.5, 3.2])
[~]|2> a.dtype.descr
<2> [('', ' a.byteswap(True)
<
Hi all-
The types of objects are not preserved through mathematical operations
when numpy scalars are involved. This has been discussed on this list
before. I think the following error is problematic, however.
>>> x=N.array(0.1)
>>> type(x)
>>> y = N.cos(x)
# the type has changed
>>> type(y)
Hi all -
I'm writing an extension module and I have a PyArrayObject with fields
created with PyArray_Zeros from a PyArray_Descr object. In other
words, this is an array of non-homogeneous data records, for example:
dtype([('x', 'http://projects.scipy.org/mailman/listinfo/numpy-discussion
We also have a number of centos boxes here at NYU astronomy and we've
been in dependency hell trying to get everything to work without
failing tests (mainly scipy more than numpy). Any help greatly
appreciated.
Erin
On 5/3/07, Fabian Braennstroem <[EMAIL PROTECTED]> wrote:
> Hi Neal,
>
> * Neal
On 1/13/07, Robert Kern <[EMAIL PROTECTED]> wrote:
> > Import of pylab still fails. The failure is now different. Using gdb I get
> > --snip--
> > Reading symbols for shared libraries . done
> > Reading symbols for shared libraries .. done
> > 20:48:11: Debug: ../src/common/object.cpp(224): asser
On 1/13/07, Robert Kern <[EMAIL PROTECTED]> wrote:
--snip--
>
> Now, since the bug is actually in freetype, not matplotlib or numpy, I suggest
> finding a new build of freetype. I use MacPorts and have had absolutely no
> trouble with it.
I switched to using macports, and included your modificati
On 1/9/07, Robert Kern <[EMAIL PROTECTED]> wrote:
> Erin Sheldon wrote:
> > I'm finally getting to this, I'm on the road. Here is
> > what gdb gives me
> >
> > --snip--
> > Reading symbols for shared libraries . done
> > Reading symbols for
o perhaps some
paths got messed up. I don't know how to address
that type of issue on a Mac with no ld.so.conf type of file.
Erin
On 1/8/07, Robert Kern <[EMAIL PROTECTED]> wrote:
> Erin Sheldon wrote:
> > I just got a new MacBook Pro, core 2 duo. There is no
> > n
On 1/7/07, Robert Kern <[EMAIL PROTECTED]> wrote:
> belinda thom wrote:
>
> > There's other reasons --- mostly curiousity driven --- that motivate
> > me to try a "rawer" (e.g. source, non-pkg based) install:
> >
> > 1) My current kludge only supports TkAgg, so I can't play w/the wx
> > backend at
On 12/31/06, Christopher Barker <[EMAIL PROTECTED]> wrote:
> Erin Sheldon wrote:
> > You can do this quite simply with fink
>
> I've generally stayed away form fink, as it felt like kind of a separate
> system within OS-X, rather than integrated -- kind of like cygw
On 12/31/06, Jeff Whitaker <[EMAIL PROTECTED]> wrote:
> Erin Sheldon wrote:
> > Hi All -
> >
> > You can do this quite simply with fink if you have
> > the patience to wait for the compilations to finish.
> > This works on my ppc mac with
> > XCode an
Hi All -
You can do this quite simply with fink if you have
the patience to wait for the compilations to finish.
This works on my ppc mac with
XCode and fink installed (12/31/2006):
fink install scipy-py24
sudo apt-get install gettext-dev=0.10.40-25 gettext=0.10.40-25
fink install matplotl
On 12/3/06, Arild B. Næss <[EMAIL PROTECTED]> wrote:
>
>
> Den 3. des. 2006 kl. 17.00 skrev Gael Varoquaux:
>
> On Sun, Dec 03, 2006 at 04:56:49PM +0100, Arild B. Næss wrote:
> This gets me further, actually the installation seems to complete.
> However, when I type
>
> import Numeric
> in Python,
On 11/16/06, Travis Oliphant <[EMAIL PROTECTED]> wrote:
> John Hunter wrote:
>
> >>>>>> "Erin" == Erin Sheldon <[EMAIL PROTECTED]> writes:
> >>>>>>
> >>>>>
> >
> >Erin> The question I have be
Those preferences did not make it through. You
have to go back and re-check that preference.
Erin
On 11/17/06, Eric Emsellem <[EMAIL PROTECTED]> wrote:
> Hi,
> I am getting all the individual emails from the numpy discussion (and
> not the bundles), directly from their authors: something is wrong
Hi Francesc -
Unless I missed something, I think what you have
shown is that the combination of
(getting data from database into python lists) +
(converting to arrays)
is what is taking time. I would guess the first takes
significantly longer than the second.
Erin
On 11/16/06, Fran
40 matches
Mail list logo
