Re: Performance problem with PyYAML

On 09/11/2019 00:10, Chris Johns wrote: On 9/11/19 10:02 am, Joel Sherrill wrote: On Fri, Nov 8, 2019 at 4:58 PM Chris Johns mailto:chr...@rtems.org>> wrote: On 9/11/19 9:52 am, Joel Sherrill wrote: > On Fri, Nov 8, 2019 at 4:26 PM Chris Johns mailto:chr...@rtems.org> >

Re: Performance problem with PyYAML

On 9/11/19 10:02 am, Joel Sherrill wrote: > > > On Fri, Nov 8, 2019 at 4:58 PM Chris Johns > wrote: > > On 9/11/19 9:52 am, Joel Sherrill wrote: > > On Fri, Nov 8, 2019 at 4:26 PM Chris Johns > >

Re: Performance problem with PyYAML

On Fri, Nov 8, 2019 at 4:58 PM Chris Johns wrote: > On 9/11/19 9:52 am, Joel Sherrill wrote: > > On Fri, Nov 8, 2019 at 4:26 PM Chris Johns > > wrote: > > > > On 9/11/19 2:57 am, Gedare Bloom wrote: > > > Ah, pickling makes sense. > > > > > > On Fri, Nov

Re: Performance problem with PyYAML

On 9/11/19 9:52 am, Joel Sherrill wrote: > On Fri, Nov 8, 2019 at 4:26 PM Chris Johns > wrote: > > On 9/11/19 2:57 am, Gedare Bloom wrote: > > Ah, pickling makes sense. > > > > On Fri, Nov 8, 2019 at 4:03 AM Sebastian Huber > >

Re: Performance problem with PyYAML

On Fri, Nov 8, 2019 at 4:26 PM Chris Johns wrote: > On 9/11/19 2:57 am, Gedare Bloom wrote: > > Ah, pickling makes sense. > > > > On Fri, Nov 8, 2019 at 4:03 AM Sebastian Huber > > wrote: > >> > >> Sorry, for the frequent updates. It turned out to be a very small > >> modification to add a build

Re: Performance problem with PyYAML

On 9/11/19 2:57 am, Gedare Bloom wrote: > Ah, pickling makes sense. > > On Fri, Nov 8, 2019 at 4:03 AM Sebastian Huber > wrote: >> >> Sorry, for the frequent updates. It turned out to be a very small >> modification to add a build specification item cache with pickle. I agree pickle and generati

Re: Performance problem with PyYAML

Ah, pickling makes sense. On Fri, Nov 8, 2019 at 4:03 AM Sebastian Huber wrote: > > Sorry, for the frequent updates. It turned out to be a very small > modification to add a build specification item cache with pickle. Python > is really a nice language. > > -- > Sebastian Huber, embedded brains G

Re: Performance problem with PyYAML

Sorry, for the frequent updates. It turned out to be a very small modification to add a build specification item cache with pickle. Python is really a nice language. -- Sebastian Huber, embedded brains GmbH Address : Dornierstr. 4, D-82178 Puchheim, Germany Phone : +49 89 189 47 41-16 Fax

Re: Performance problem with PyYAML

I experimented a bit with marshal, pickle, and ast.literal_eval. I think that using a cache file is the way to go. An update evaluation based on the mtime is quite fast. You need the YAML to X conversion only if a build specification file changed or upon first use. We don't have to store the ca

Re: Performance problem with PyYAML

Attached is a script to create the aggregated items with the marshal module. Loading it is quite fast (0.1s). -- Sebastian Huber, embedded brains GmbH Address : Dornierstr. 4, D-82178 Puchheim, Germany Phone : +49 89 189 47 41-16 Fax : +49 89 189 47 41-09 E-Mail : sebastian.hu...@embedde