[Beowulf] Brief OT: Open positions

2019-07-26 Thread Joe Landman
Hi folks   A brief note, one of my colleagues has 2 open positions in the US; one in Houston TX, the other in Vicksburg MS.  These are hardware/software maintenance on a number of mid sized supercomputers, clusters, and storage.   I have some cloud HPC needs (compute, storage, networking) in

Re: [Beowulf] Lustre on google cloud

2019-07-26 Thread John Hearns via Beowulf
) Terabyte scale data movement into or out of the cloud is not scary in 2019. You can move data into and out of the cloud at basically the line rate of your internet connection as long as you take a little care in selecting and tuning your firewalls and inline security devices. Pushing 1TB/day etc

Re: [Beowulf] Lustre on google cloud

2019-07-26 Thread Chris Dagdigian
Coming back late to this thread as yesterday was a travel/transit day ... some additional thoughts 1) I also avoid the word "cloud bursting" these days because it's been tarred by marketing smog and does not mean much. The blunt truth is that from a technical perspective having a hybrid prem

Re: [Beowulf] Lustre on google cloud

2019-07-26 Thread INKozin via Beowulf
I'm very much in favour of personal or team clusters as Chris has also mentioned. Then the contract between the user and the cloud is explicit. The data can be uploaded/ pre staged to S3 in advance (at no cost other than time) or copied directly as part of the cluster creation process. It makes no

Re: [Beowulf] Lustre on google cloud [EXT]

2019-07-26 Thread Tim Cutts
I try to avoid the phrase “cloud bursting” now, for precisely this reason. Many of my users have heard the phrase, and think it means they’ll be able to instantly start work in the cloud, just because the local cluster is busy. On the compute side, yes, it’s pretty quick but as you say, gettin