[R] Efficiently parallelize across columns of a data.table

2016-08-20 Thread Rebecca Payne
orker processes modify the table. > > HTH, > > Peter > > On Fri, Aug 19, 2016 at 11:22 AM, Rebecca Payne > wrote: > > I am trying to parallelize a task across columns of a data.table using > > foreach and doParallel. My data is large relative to my system memory >

[R] Efficiently parallelize across columns of a data.table

2016-08-19 Thread Rebecca Payne
I am trying to parallelize a task across columns of a data.table using foreach and doParallel. My data is large relative to my system memory (about 40%) so I'm avoiding making any copies of the full table. The function I am parallelizing is pretty simple, taking as input a fixed set of columns and