So am I crazy or does read.csv block concurrent operations?
On Wed, Aug 28, 2013 at 11:28 AM, joe meiring wrote:
> Yeah it seems like read.csv is blocking concurrent reads, can anyone
> verify if that is true? If so, is there a better way to read in csv files
> into a data frame?
>
>
> On Wed, A
Yeah it seems like read.csv is blocking concurrent reads, can anyone verify
if that is true? If so, is there a better way to read in csv files into a
data frame?
On Wed, Aug 28, 2013 at 8:50 AM, joe meiring wrote:
> I'll be that one does give me 1 second. What I'm really trying to do is
> proces
I'll be that one does give me 1 second. What I'm really trying to do is
process a bunch of (~300) relatively large CSV files simultaneously.
Something like this:
testFunc <- function(fileName) {
print(fileName)
df <- process_raw_data(fname)
# process_raw_data just reads in CSV file and
SO what could possibly be causing this? Has anyone encountered this? This
is RedHat Enterprise 5.7.
On Tue, Aug 27, 2013 at 11:14 PM, Prof Brian Ripley
wrote:
> On 28/08/2013 06:54, joe meiring wrote:
>
>> This does speed up on an OsX install, so something must be wacky with the
>> linux install
On 28/08/2013 06:54, joe meiring wrote:
This does speed up on an OsX install, so something must be wacky with the
linux install. Any ideas as to what would cause this?
It does on a Linux platform ('install' has nothing to do with this):
> system.time(x <- lapply(test,function(x) loess.smooth(x
This does speed up on an OsX install, so something must be wacky with the
linux install. Any ideas as to what would cause this?
On Tuesday, August 27, 2013 4:19:31 PM UTC-7, joe meiring wrote:
>
> I can't seem to get mclapply to use more than a single core. I have a 64
> core server running Lin
I can't seem to get mclapply to use more than a single core. I have a 64
core server running Linux.
Fore example:
library(parallel)
test <- lapply(1:100,function(x) rnorm(1))
system.time(x <- lapply(test,function(x) loess.smooth(x,x)))
system.time(x <- mclapply(test,function(x) loess.smooth(
7 matches
Mail list logo
