Re: [Numpy-discussion] Improving Python+MPI import performance

2012-01-13 Thread Langton, Asher
On 1/13/12 1:58 PM, Dag Sverre Seljebotn wrote: > >It's actually not too difficult to do something like > >LD_PRELOAD=myhack.so python something.py > >and have myhack.so intercept the filesystem calls Python makes (to libc) >and do whatever it wants. That's a solution that doesn't interfer with >ho

Re: [Numpy-discussion] Improving Python+MPI import performance

2012-01-13 Thread Langton, Asher
On 1/13/12 1:24 PM, Robert Kern wrote: >On Fri, Jan 13, 2012 at 21:20, Langton, Asher wrote: > >> 2) More generally, dealing with this as well as other library-loading >> issues at the system level, perhaps by putting a small disk near a node >>or >> small col

Re: [Numpy-discussion] Improving Python+MPI import performance

2012-01-13 Thread Langton, Asher
On 1/13/12 12:38 PM, Sturla Molden wrote: >Den 13.01.2012 21:21, skrev Dag Sverre Seljebotn: >> Another idea: Given your diagnostics, wouldn't dumping the output of >> "find" of every path in sys.path to a single text file work well? > >It probably would, and would also be less prone to synchroniza