Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-07 Thread Ryan Gonzalez
aniel Smith Cc: Nick Coghlan; Python Dev Subject: Re: [Python-Dev] A fast startup patch (was: Python startup time) On Fri, May 4, 2018 at 6:58 PM, Nathaniel Smith wrote: What are the obstacles to including "preloaded" objects in regular .pyc files, so that everyone can take advantage

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-07 Thread Steve Dower
? Top-posted from my Windows phone From: Carl Shapiro Sent: Monday, May 7, 2018 14:36 To: Nathaniel Smith Cc: Nick Coghlan; Python Dev Subject: Re: [Python-Dev] A fast startup patch (was: Python startup time) On Fri, May 4, 2018 at 6:58 PM, Nathaniel Smith wrote: What are the obstacles to including

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-07 Thread Carl Shapiro
On Fri, May 4, 2018 at 6:58 PM, Nathaniel Smith wrote: > What are the obstacles to including "preloaded" objects in regular .pyc > files, so that everyone can take advantage of this without rebuilding the > interpreter? > The system we have developed can create a shared object file for each comp

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Nick Coghlan
On 6 May 2018 at 05:34, Brett Cannon wrote: > > > On Sat, 5 May 2018 at 10:41 Eric Fahlgren wrote: > >> On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi >> wrote: >> >>> On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: >>> What are the obstacles to including "preloaded" objects in regu

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Brett Cannon
On Sat, 5 May 2018 at 10:41 Eric Fahlgren wrote: > On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi > wrote: > >> On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: >> >>> What are the obstacles to including "preloaded" objects in regular .pyc >>> files, so that everyone can take advantage of

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Terry Reedy
On 5/5/2018 2:33 PM, Toshio Kuratomi wrote: On Sat, May 5, 2018, 10:40 AM Eric Fahlgren > wrote: On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi mailto:a.bad...@gmail.com>>wrote: On Fri, May 4, 2018, 7:00 PM Nathaniel Smith mailto:n...@pobox.com>>

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Miro HronĨok
On 5.5.2018 21:00, Nathaniel Smith wrote: I think in the vast majority of cases currently .pyc files are built on the same architecture where they're used? On Fedora (and by extension also on RHEL and CentOS) this is not rue. When the package is noarch (no extension module shipped, only pure

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Glenn Linderman
On 5/5/2018 10:30 AM, Toshio Kuratomi wrote: On Fri, May 4, 2018, 7:00 PM Nathaniel Smith > wrote: What are the obstacles to including "preloaded" objects in regular .pyc files, so that everyone can take advantage of this without rebuilding the interpreter? W

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Nathaniel Smith
On Sat, May 5, 2018, 11:34 Toshio Kuratomi wrote: > > > On Sat, May 5, 2018, 10:40 AM Eric Fahlgren > wrote: > >> On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi >> wrote: >> >>> On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: >>> What are the obstacles to including "preloaded" objec

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Toshio Kuratomi
On Sat, May 5, 2018, 10:40 AM Eric Fahlgren wrote: > On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi > wrote: > >> On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: >> >>> What are the obstacles to including "preloaded" objects in regular .pyc >>> files, so that everyone can take advantage o

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Eric Fahlgren
On Sat, May 5, 2018 at 10:30 AM, Toshio Kuratomi wrote: > On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: > >> What are the obstacles to including "preloaded" objects in regular .pyc >> files, so that everyone can take advantage of this without rebuilding the >> interpreter? >> > > Would thi

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Toshio Kuratomi
On Fri, May 4, 2018, 7:00 PM Nathaniel Smith wrote: > What are the obstacles to including "preloaded" objects in regular .pyc > files, so that everyone can take advantage of this without rebuilding the > interpreter? > Would this make .pyc files arch specific? -Toshio __

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-05 Thread Nick Coghlan
On 5 May 2018 at 11:58, Nathaniel Smith wrote: > What are the obstacles to including "preloaded" objects in regular .pyc > files, so that everyone can take advantage of this without rebuilding the > interpreter? > > Off the top of my head: > > We'd be making the in-memory layout of those objects

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-04 Thread Nathaniel Smith
What are the obstacles to including "preloaded" objects in regular .pyc files, so that everyone can take advantage of this without rebuilding the interpreter? Off the top of my head: We'd be making the in-memory layout of those objects part of the .pyc format, so we couldn't change that within a

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-04 Thread Carl Shapiro
On Fri, May 4, 2018 at 5:14 AM, Nick Coghlan wrote: > This definitely seems interesting, but is it something you'd be seeing us > being able to take advantage of for conventional Python installations, or > is it more something you'd expect to be useful for purpose-built > interpreter instances? (

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-04 Thread Nick Coghlan
On 4 May 2018 at 06:13, Carl Shapiro wrote: > Hello, > > Yesterday Neil Schemenauer mentioned some work that a colleague of mine > (CCed) and I have done to improve CPython start-up time. Given the recent > discussion, it seems timely to discuss what we are doing and whether it is > of interest

Re: [Python-Dev] A fast startup patch (was: Python startup time)

2018-05-03 Thread Gregory P. Smith
+1 to the concept! On Thu, May 3, 2018 at 1:13 PM, Carl Shapiro wrote: > Hello, > > Yesterday Neil Schemenauer mentioned some work that a colleague of mine > (CCed) and I have done to improve CPython start-up time. Given the recent > discussion, it seems timely to discuss what we are doing and