Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread Steve Lianoglou
Here's another datapoint using the multicore package -- which is what the foreach/doMC combo uses internally: I halved your A value to 50,000 because I was getting impatient :-) A=5 randvalues <- abs(rnorm(A)) minfn <- function( x, i ) { log(abs(x))+x^3+i/A+randvalues[i] } system.time(a1 <- l

Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread Uwe Ligges
On 02.07.2011 20:42, ivo welch wrote: hi uwe--I did not know what snow was. from my 1 minute reading, it seems like a much more involved setup that is much more flexible after the setup cost has been incurred (specifically, allowing use of many machines). the attractiveness of the doMC/foreac

Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread ivo welch
hi uwe--I did not know what snow was. from my 1 minute reading, it seems like a much more involved setup that is much more flexible after the setup cost has been incurred (specifically, allowing use of many machines). the attractiveness of the doMC/foreach framework is its simplicity of installat

Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread Uwe Ligges
On 02.07.2011 20:04, ivo welch wrote: thank you, uwe. this is a little disappointing. parallel processing for embarrassingly simple parallel operations--those needing no communication---should be feasible if the thread is not always created and released, but held. is there light-weight paral

Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread ivo welch
thank you, uwe. this is a little disappointing. parallel processing for embarrassingly simple parallel operations--those needing no communication---should be feasible if the thread is not always created and released, but held. is there light-weight parallel processing that could facilitate this?

Re: [R] %dopar% parallel processing experiment

2011-07-02 Thread Uwe Ligges
On 02.07.2011 19:32, ivo welch wrote: dear R experts--- I am experimenting with multicore processing, so far with pretty disappointing results. Here is my simple example: A<- 10 randvalues<- abs(rnorm(A)) minfn<- function( x, i ) { log(abs(x))+x^3+i/A+randvalues[i] } ## an arbitrary fun

[R] %dopar% parallel processing experiment

2011-07-02 Thread ivo welch
dear R experts--- I am experimenting with multicore processing, so far with pretty disappointing results. Here is my simple example: A <- 10 randvalues <- abs(rnorm(A)) minfn <- function( x, i ) { log(abs(x))+x^3+i/A+randvalues[i] }  ## an arbitrary function ARGV <- commandArgs(trailingOnly