Re: [R] doParallel cores HPC

2020-06-26 Thread Henrik Bengtsson
> On the other hand, [...], you can spawn 20 workers on each of the 10 hosts: > > makePSOCKcluster(names = rep(c('Host01', ..., 'Host10'), each = 20)) Unfortunately, this will most likely not work because it will require 200 open connections - one for each worker - but R limits you to 125 (see ?ba

Re: [R] doParallel cores HPC

2020-06-26 Thread Ivan Krylov
On Thu, 25 Jun 2020 00:29:42 + "Silva, Eder David Borges da" wrote: > I have the HPC, with 10 nodes, and each node with 20 cores in UNIX OS. > cl <- makePSOCKcluster(names=c('Host01', ... , 'Host10) > This code is the best way for use all machine power? The code as written will create one

[R] doParallel cores HPC

2020-06-25 Thread Silva, Eder David Borges da
Hi R team, I have the HPC, with 10 nodes, and each node with 20 cores in UNIX OS. my goal is a set cluster to use all machine power, and thy this code: library(doParallel) cl <- makePSOCKcluster(names=c('Host01', ... , 'Host10) registerDoParallel(cl=cl,cores=20) lP <- foreach(j = 1:100) %dopar