OK so maybe I should
(1) not add some sort of checksum type functionality to my read/write
methods
these read/write methods simply read/write numpy arrays to a
binary file which contains one or more numpy arrays (and nothing else).
(2) replace my binary files iwith either HDF5 or PyT
On Fri, Dec 05, 2008 at 06:59:25PM -0500, Pierre GM wrote:
> Here's the latest version of genloadtxt, with some recent corrections. With
> just a couple of tweaking, we end up with some decent speed: it's still
> slower than np.loadtxt, but only 15% so according to the test at the end of
> the p
A Friday 05 December 2008, Andrew Collette escrigué:
> > Another possibility would be to use HDF5 as a data container. It
> > supports the fletcher32 filter [1] which basically computes a
> > chuksum for evey data chunk written to disk and then always check
> > that the data read satifies the chec