Re: [Beowulf] Rsync - checksums

2019-06-17 Thread Benjamin Redling
You mean like a COW filesystem with end-to-end checksums were you can send snapshots and don't care to much about MD5? I looked it up. Spectrum Scale fka. GPFS has end-to-end checksums, (global) snapshots and mmapplypolicy to get the list of files to backup -- at least Commvault according to their

Re: [Beowulf] Containers in HPC

2019-05-26 Thread Benjamin Redling
Good news. I'll try it out, again. Am 26. Mai 2019 13:57:05 MESZ schrieb INKozin : >for what it's worth, Singularity worked well for me last time I tried >it. >I think it was shortly after NVIDIA had announced support for it. > >On Sun, 26 May 2019 at 11:11, Benjamin Red

Re: [Beowulf] Containers in HPC

2019-05-26 Thread Benjamin Redling
On 23/05/2019 16.13, Loncaric, Josip via Beowulf wrote: > "Charliecloud" is a more secure approach to containers in HPC: I tried Singularity short before and during 2.3 with GPUs -- didn't work, documented issue, maybe solved. Stopped caring. Shortly afterwards I read about Charliecloud and tried

Re: [Beowulf] Large amounts of data to store and process

2019-03-15 Thread Benjamin Redling
On 15.03.19 06:28, Jonathan Aquilina wrote: > I think what I was getting at is why not include the current HPC practices to > every day desktops in the sense since we are reaching certain limits and have > to write code to take advantage of more and more cores. Why not use MPI and > the like to