Re: [Numpy-discussion] checksum on numpy float array

2008-12-06 Thread Brennan Williams
OK so maybe I should (1) not add some sort of checksum type functionality to my read/write methods these read/write methods simply read/write numpy arrays to a binary file which contains one or more numpy arrays (and nothing else). (2) replace my binary files iwith either HDF5 or PyT

Re: [Numpy-discussion] genloadtxt : last call

2008-12-06 Thread Gael Varoquaux
On Fri, Dec 05, 2008 at 06:59:25PM -0500, Pierre GM wrote: > Here's the latest version of genloadtxt, with some recent corrections. With > just a couple of tweaking, we end up with some decent speed: it's still > slower than np.loadtxt, but only 15% so according to the test at the end of > the p

Re: [Numpy-discussion] checksum on numpy float array

2008-12-06 Thread Francesc Alted
A Friday 05 December 2008, Andrew Collette escrigué: > > Another possibility would be to use HDF5 as a data container. It > > supports the fletcher32 filter [1] which basically computes a > > chuksum for evey data chunk written to disk and then always check > > that the data read satifies the chec