Re: [Numpy-discussion] ENH IncrementalWriter for .npy files

2014-09-02 Thread Jerome Kieffer
Hi, This feature is very similar to what is available in hdf5 and exposed under h5py using chunks and max_size ... Cheers, -- Jérôme Kieffer tel +33 476 882 445 ___ NumPy-Discussion mailing list NumPy-Discussion@scipy.org http://mail.scipy.org/mailm

[Numpy-discussion] ENH IncrementalWriter for .npy files

2014-09-01 Thread Gabor Kovacs
Dear All, I would like to add a class for writing one (possibly big) .npy file saving multiple (same dtype, compatible shape) arrays. My use case was the saving of slowly accumulating data regularly for a long time into one file. Please find a first implementation under https://github.com/numpy/n