Re: [Beowulf] Python libraries slow to load across Scyld cluster

2015-01-16 Thread Don Kirkby
Thanks for the suggestions, everyone. I've used them to find more information, but I haven't found a solution yet. It looks like the time is spent opening the Python libraries, but my attempts to change the Beowulf configuration files have not made it run any faster. Skylar asked: > Do any

Re: [Beowulf] Python libraries slow to load across Scyld cluster

2015-01-16 Thread Jeff White
If you are using these libraries often and they exist on a remote server (NFS or whatever) you may want to use the "libraries" or "prestage" directives in Scyld's config to put them on compute nodes instead. Jeff White - GNU+Linux Systems Administrator University of Pittsburgh - CSSD On 01/15/

Re: [Beowulf] Python libraries slow to load across Scyld cluster

2015-01-16 Thread John Hearns
When I run that with mpirun -host n0 python cached_imports_collections.py, it initially takes about 10 seconds to import. However, repeated runs take less time, until it takes less than 0.01 seconds to import. Please forgive me for saying this. If this is not an MPI code maybe you would be bett