Re: [Beowulf] Application independent checkpoint/resume?

2019-03-05 Thread Blomqvist Janne
Hi, at a conference last year I asked one of the CRIU developers about IB RDMA support for live migrations, and he said it doesn't support it, and no plans either. In a way it makes sense, considering what CRIU does is basically a dump of the process memory + some support for kernel-managed ob

Re: [Beowulf] Large amounts of data to store and process

2019-03-05 Thread Lux, Jim (337K) via Beowulf
Jim Lux (818)354-2075 (office) (818)395-2714 (cell) -Original Message- From: Beowulf [mailto:beowulf-boun...@beowulf.org] On Behalf Of Joe Landman Sent: Tuesday, March 05, 2019 6:32 AM To: beowulf@beowulf.org Subject: Re: [Beowulf] Large amounts of data to store and process On 3/4/19

Re: [Beowulf] live free SGE descendent (for Centos 7)?

2019-03-05 Thread Skylar Thompson
Hi David, Not sure if you saw this, but Univa just announced that they will be selling support for the open source GE forks: http://www.univa.com/about/news/press_2019/02282019.php I don't know how much development time they will include, but as you note, at some point the open source forks will

Re: [Beowulf] live free SGE descendent (for Centos 7)?

2019-03-05 Thread INKozin via Beowulf
Or you can ping Dave Love who I'm sure will be happy to respond. On Tue, 5 Mar 2019, 18:43 Alex Chekholko via Beowulf, wrote: > Hi David, > > What is your goal? > > Anecdotally, every cluster I know has switched from SGE to SLURM. SchedMD > has an active user list and bug tracker. > > If you ar

Re: [Beowulf] live free SGE descendent (for Centos 7)?

2019-03-05 Thread Alex Chekholko via Beowulf
Hi David, What is your goal? Anecdotally, every cluster I know has switched from SGE to SLURM. SchedMD has an active user list and bug tracker. If you are willing to spend money; I hear Univa support is excellent. Regards, Alex On Tue, Mar 5, 2019 at 10:39 AM David Mathog wrote: > Are any

[Beowulf] live free SGE descendent (for Centos 7)?

2019-03-05 Thread David Mathog
Are any of the free SGE derived projects still alive? If so, buildable on Centos 7? Son of grid engine, for instance, has not had a release since 2016 https://arc.liv.ac.uk/downloads/SGE/releases/8.1.9/ and there isn't one for Centos 7. The last rocks release still has an SGE option, and

Re: [Beowulf] Large amounts of data to store and process

2019-03-05 Thread Joe Landman
On 3/4/19 8:00 PM, Lux, Jim (337K) via Beowulf wrote: I'm munging through not very much satellite telemetry (a few GByte), using sqlite3.. Here's some general observations: 1) if the data is recorded by multiple sensor systems, the clocks will *not* align - sure they may run NTP, but 2) Ty

Re: [Beowulf] Large amounts of data to store and process

2019-03-05 Thread John Hearns via Beowulf
Talking about missing values... Joe Landman is sure to school me again for this one (owwwccchhh) https://docs.julialang.org/en/v1/manual/missing/index.html Going back to the hardware, a 250Gbyte data size is not too large to hold in RAM. This might be a good use case for Intel Optane persistent