On 08/03/16 05:43, Jeff Friedman wrote:
Hello all. I am just entering the HPC Sales Engineering role, and would like to focus my learning on the most relevant stuff. I have searched near and far for a current survey of some sort listing the top used “stacks”, but cannot seem to find one that is free.

https://sites.google.com/site/smallhpc/home, see "Files & Documents" section

I was breaking things down similar to this:

_OS disto_: CentOS, Debian, TOSS, etc? I know some come trimmed down, and also include specific HPC libraries, like CNL, CNK, INK?

_MPI options_: MPICH2, MVAPICH2, Open MPI, Intel MPI, ?

_Provisioning software_: Cobbler, Warewulf, xCAT, Openstack, Platform HPC, ?

_Configuration management_: Warewulf, Puppet, Chef, Ansible, ?

xCAT

Some sites (incl. the one I'm at) use Quattor (http://www.quattor.org/)

_Resource and job schedulers_: I think these are basically the same thing?

Not really, although there's some overlap.

Resource managers like Torque (PBS) are in charge of ... managing the resources.

Job schedulers (e.g. Maui, MOAB) decide which job gets to start next, and talk to the resource manager (i.e. poll for available resources, instruct which job should start next, etc.).

Torque, Lava, Maui, Moab, SLURM, Grid Engine, Son of Grid Engine, Univa, Platform LSF, etc… others?

_Shared filesystems_: NFS, pNFS, Lustre, GPFS, PVFS2, GlusterFS, ?

_Library management_: Lmod, ?

EasyBuild

(disclaimer: I'm the lead developer)


_Performance monitoring_: Ganglia, Nagios, ?

_Cluster management toolkits_: I believe these perform many of the functions above, all wrapped up in one tool? Rocks, Oscar, Scyld, Bright, ?


Does anyone have any observations as to which of the above are the most common? Or is that too broad? I believe most the clusters I will be involved with will be in the 128 - 2000 core range, all on commodity hardware.

See the "Small HPC Centers" survey I pointed to above.


K.

Thank you!

- Jeff






_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit 
http://www.beowulf.org/mailman/listinfo/beowulf

_______________________________________________
Beowulf mailing list, Beowulf@beowulf.org sponsored by Penguin Computing
To change your subscription (digest mode or unsubscribe) visit 
http://www.beowulf.org/mailman/listinfo/beowulf

Reply via email to