Re: [Numpy-discussion] Memory mapping and NPZ files

2015-12-12 Thread Mathieu Dubois
Le 11/12/2015 11:22, Sturla Molden a écrit : Mathieu Dubois wrote: The point is precisely that, you can't do memory mapping with Npz files (while it works with Npy files). The operating system can memory map any file. But as npz-files are compressed, you will need to uncompress the con

Re: [Numpy-discussion] Memory mapping and NPZ files

2015-12-10 Thread Mathieu Dubois
On 10/12/2015 13:55, Sturla Molden wrote: Mathieu Dubois wrote: Does it make sense? No. Memory mapping should just memory map, not do all sorts of crap. The point is precisely that, you can't do memory mapping with Npz files (while it works with Npy files). Ma

Re: [Numpy-discussion] Memory mapping and NPZ files

2015-12-10 Thread Mathieu Dubois
On 10/12/2015 15:35, Sebastian Berg wrote: On Mi, 2015-12-09 at 15:51 +0100, Mathieu Dubois wrote: Dear all, If I am correct, using mmap_mode with Npz files has no effect i.e.: f = np.load("data.npz", mmap_mode="r") X = f['X'] will load all the data in memory.

[Numpy-discussion] Memory mapping and NPZ files

2015-12-09 Thread Mathieu Dubois
Dear all, If I am correct, using mmap_mode with Npz files has no effect i.e.: f = np.load("data.npz", mmap_mode="r") X = f['X'] will load all the data in memory. Can somebody confirm that? If I'm correct, the mmap_mode argument could be passed to the NpzFile class which could in turn perform t