Re: [Python-Dev] import too slow on NFS based systems

2012-06-21 Thread PJ Eby
On Thu, Jun 21, 2012 at 10:08 AM, Daniel Braniss wrote: > > On Thu, 21 Jun 2012 13:17:01 +0300 > > Daniel Braniss wrote: > > > Hi, > > > when lib/python/site-packages/ is accessed via NFS, open/stat/access > is very > > > expensive/slow. > > > > > > A simple solution is to use an in memory direct

Re: [Python-Dev] import too slow on NFS based systems

2012-06-21 Thread Antoine Pitrou
On Thu, 21 Jun 2012 17:08:09 +0300 Daniel Braniss wrote: > > There is such a thing in Python 3.3, although some stat() calls are > > still necessary to know whether the directory caches are fresh. > > Can you give it a try and provide some feedback? > > WOW! > with a sample python program: > > i

Re: [Python-Dev] import too slow on NFS based systems

2012-06-21 Thread Daniel Braniss
> On Thu, 21 Jun 2012 13:17:01 +0300 > Daniel Braniss wrote: > > Hi, > > when lib/python/site-packages/ is accessed via NFS, open/stat/access is very > > expensive/slow. > > > > A simple solution is to use an in memory directory search/hash, so I was > > wondering if this has been concidered in

Re: [Python-Dev] import too slow on NFS based systems

2012-06-21 Thread Antoine Pitrou
On Thu, 21 Jun 2012 13:17:01 +0300 Daniel Braniss wrote: > Hi, > when lib/python/site-packages/ is accessed via NFS, open/stat/access is very > expensive/slow. > > A simple solution is to use an in memory directory search/hash, so I was > wondering if this has been concidered in the past, if not

Re: [Python-Dev] import too slow on NFS based systems

2012-06-21 Thread Oleg Broytman
On Thu, Jun 21, 2012 at 01:17:01PM +0300, Daniel Braniss wrote: > when lib/python/site-packages/ is accessed via NFS, open/stat/access is very > expensive/slow. > > A simple solution is to use an in memory directory search/hash, so I was > wondering if this has been concidered in the past, if n

[Python-Dev] import too slow on NFS based systems

2012-06-21 Thread Daniel Braniss
Hi, when lib/python/site-packages/ is accessed via NFS, open/stat/access is very expensive/slow. A simple solution is to use an in memory directory search/hash, so I was wondering if this has been concidered in the past, if not, and I come with a working solution for Unix (at least Linux/Freebsd)