On Mon, 2 Jul 2018 17:16:00 -0600
Charles R Harris wrote:
> Maybe somewhat off topic, but we have had trouble with a 2 GiB limit on
> file writes on OS X. See https://github.com/numpy/numpy/issues/3858. Does
> your implementation work around that?
No, it's not the same topic at all. I'd recomm
On Tue, Jul 03, 2018 at 09:42:08AM +0200, Andrea Gavana wrote:
> I’m happy if you feel better after your tirade.
Not really. I worry a lot that many users are going to be surprised when
Python 2 stops being supported, which is in a couple of years. I wrote
this tirade not to make me feel better, b
Hi,
On Tue, 3 Jul 2018 at 09.20, Gael Varoquaux
wrote:
> On Tue, Jul 03, 2018 at 08:54:51AM +0200, Andrea Gavana wrote:
> > This sound so very powerful... it’s such a pity that these type of gems
> won’t
> > be backported to Python 2 - we have so many legacy applications smoothly
> > running in
On Tue, Jul 03, 2018 at 08:54:51AM +0200, Andrea Gavana wrote:
> This sound so very powerful... it’s such a pity that these type of gems won’t
> be backported to Python 2 - we have so many legacy applications smoothly
> running in Python 2 and nowhere near the required resources to even start
> por
On Tue, 3 Jul 2018 at 07.35, Gael Varoquaux
wrote:
> On Mon, Jul 02, 2018 at 05:31:05PM -0600, Charles R Harris wrote:
> > ISTR that some parallel processing applications sent pickled arrays
> around to
> > different processes, I don't know if that is still the case, but if so,
> no copy
> > migh
On Mon, Jul 02, 2018 at 05:31:05PM -0600, Charles R Harris wrote:
> ISTR that some parallel processing applications sent pickled arrays around to
> different processes, I don't know if that is still the case, but if so, no
> copy
> might be a big gain for them.
Yes, most parallel code that's acro
On Mon, Jul 2, 2018 at 7:42 PM Andrew Nelson wrote:
>
>
> On Tue, 3 Jul 2018 at 09:31, Charles R Harris
> wrote:
>
>>
>> ISTR that some parallel processing applications sent pickled arrays
>> around to different processes, I don't know if that is still the case, but
>> if so, no copy might be a
On Tue, 3 Jul 2018 at 09:31, Charles R Harris
wrote:
>
> ISTR that some parallel processing applications sent pickled arrays around
> to different processes, I don't know if that is still the case, but if so,
> no copy might be a big gain for them.
>
That is very much correct. One example is u
On Mon, Jul 2, 2018 at 5:16 PM, Charles R Harris
wrote:
>
>
> On Mon, Jul 2, 2018 at 3:03 PM, Antoine Pitrou wrote:
>
>>
>> Hello,
>>
>> Some of you might know that I've been working on a PEP in order to
>> improve pickling performance of large (or huge) data. The PEP,
>> numbered 574 and title
On Mon, Jul 2, 2018 at 3:03 PM, Antoine Pitrou wrote:
>
> Hello,
>
> Some of you might know that I've been working on a PEP in order to
> improve pickling performance of large (or huge) data. The PEP,
> numbered 574 and titled "Pickle protocol 5 with out-of-band data",
> allows participating dat
Hello,
Some of you might know that I've been working on a PEP in order to
improve pickling performance of large (or huge) data. The PEP,
numbered 574 and titled "Pickle protocol 5 with out-of-band data",
allows participating data types to be pickled without any memory copy.
https://www.python.o
11 matches
Mail list logo
