Re: [Beowulf] Gentoo in the HPC environment

On 01 Jul 2014, at 03:27, Christopher Samuel wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 26/06/14 05:08, Kilian Cavalotti wrote: > >> You can just use a very minimal OS on your compute nodes, then >> compile and install all the user facing bits in a shared location. >> You h

Re: [Beowulf] Gentoo in the HPC environment

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 01/07/14 13:48, Jonathan Aquilina wrote: > What kind of disk setup do you have on the master node? There is > only so much one master can take in terms of netbooting before you > see performance degridation All the nodes boot the same image file,

Re: [Beowulf] Gentoo in the HPC environment

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 06/30/2014 05:34 PM, Christopher Samuel wrote: > On 01/07/14 10:27, Christopher Samuel wrote: > >> then all the applications are in /usr/local > > To quickly qualify that, our naming scheme is: > > /usr/local/$application/$version-$compiler/ > >

Re: [Beowulf] Gentoo in the HPC environment

What kind of disk setup do you have on the master node? There is only so much one master can take in terms of netbooting before you see performance degridation > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 26/06/14 05:08, Kilian Cavalotti wrote: > >> You can just use a very minimal OS o

Re: [Beowulf] Gentoo in the HPC environment

This question probably sounds like a stupid one, but what difference in an HPC environment and to parallel written code does compiler version make? > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On 01/07/14 10:27, Christopher Samuel wrote: > >> then all the applications are in /usr/local >

Re: [Beowulf] Cluster Benchmarking

Matthew, Here is some HPL data on an old small cluster (Limulus Project) http://limulus.basement-supercomputing.com/wiki/NorbertLimulus I am sure I have some NAS parallel results as well, I have to look for them. What type of interconnect are you using? -- Doug > Hello, My name is Matthew B

Re: [Beowulf] Gentoo in the HPC environment

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 01/07/14 10:27, Christopher Samuel wrote: > then all the applications are in /usr/local To quickly qualify that, our naming scheme is: /usr/local/$application/$version-$compiler/ We name modules as: $application-$compiler/$version so someone c

Re: [Beowulf] Gentoo in the HPC environment

-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 26/06/14 05:08, Kilian Cavalotti wrote: > You can just use a very minimal OS on your compute nodes, then > compile and install all the user facing bits in a shared location. > You hand an environment modules system to the users and off they > go.

Re: [Beowulf] Cluster Benchmarking

What exactly are you trying to measure? You mention "NAS parallel benchmarks", so maybe something like these: https://computing.llnl.gov/?set=code&page=sio_downloads On Mon, Jun 30, 2014 at 11:28 AM, Brownell, Matthew wrote: > Hello, My name is Matthew Brownell and I am a physics undergrad stude

[Beowulf] Cluster Benchmarking

Hello, My name is Matthew Brownell and I am a physics undergrad student at BYU-Idaho. I have created a linux cluster for parallel computing so I can accomplish my senior research. We have eight computers from 2007 the school was willing to give me for free so I can prove the concept. I have run

Re: [Beowulf] Gentoo in the HPC environment

> "Joe" == Joe Landman writes: Joe> >> I second Gavin. Prentice> A lot of people have been mentioning LXC and Docker ans Prentice> cures to this problem, and to paraphrase The Princess Prentice> Bride, you keep using those words I don't think they mean Prentice> what you

Re: [Beowulf] Gentoo in the HPC environment

On 06/30/2014 12:42 PM, r...@q-leap.de wrote: "Joe" == Joe Landman writes: Joe> On 06/30/2014 11:27 AM, Prentice Bisbal wrote: >> I second Gavin. >> Prentice> A lot of people have been mentioning LXC and Docker ans Prentice> cures to this problem, and to paraphrase The

Re: [Beowulf] Gentoo in the HPC environment

> "Joe" == Joe Landman writes: Joe> On 06/30/2014 11:27 AM, Prentice Bisbal wrote: >> I second Gavin. >> Prentice> A lot of people have been mentioning LXC and Docker ans Prentice> cures to this problem, and to paraphrase The Princess Prentice> Bride, you keep using th

Re: [Beowulf] Gentoo in the HPC environment

Then cant you say the same about virtualization technologies such as kvm xen vmware and hyperV? > I second Gavin. > > A lot of people have been mentioning LXC and Docker ans cures to this > problem, and to paraphrase The Princess Bride, you keep using those > words I don't think they mean what you

Re: [Beowulf] Gentoo in the HPC environment

On 06/30/2014 11:27 AM, Prentice Bisbal wrote: I second Gavin. A lot of people have been mentioning LXC and Docker ans cures to this problem, and to paraphrase The Princess Bride, you keep using those words I don't think they mean what you think they mean. Docker and LXC are great for isolating

Re: [Beowulf] Gentoo in the HPC environment

I second Gavin. A lot of people have been mentioning LXC and Docker ans cures to this problem, and to paraphrase The Princess Bride, you keep using those words I don't think they mean what you think they mean. Docker and LXC are great for isolating running services: apache, DNS, etc. For the m

Re: [Beowulf] Gentoo in the HPC environment

Hi, Jonathan. If you have access to a RHEL or CentOS 6 system, you can see all the running kernel options in one of these files: /usr/src/kernels/`uname -r`/.config /boot/config-`uname -r` I get what your saying about optimization. I understand Gentoo touts the ability to recompile EVERYTHING wi

Re: [Beowulf] Gentoo in the HPC environment

Hi, Jonathan. Or you can just build software in a dedicated, version-named directory with the --prefix option. Many in HPC use the environment modules. Here is a good article about it: http://www.admin-magazine.com/HPC/Articles/Environment-Modules Cheers. On Sat 06/28/14 04:07PM +0200, Jonathan