Re: [R] Parallel Scan of Large File

Hi Ryan, the "Getting Started with doMC and foreach" manual tells me that you might have forgotten a registerDoMC() in the example you provided. Best, Mirko __ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE

Re: [R] Parallel Scan of Large File

Hi Jim, Thanks for your insight. I used Linux split to split my large file into smaller partitions. On the server I work on, multipath I/O access is enabled and we use RAID for storage; thus, I don't think I can put each partition on a spindle. I'm able to open multiple files at a time into stdin

Re: [R] Parallel Scan of Large File

You might be better off partitioning the file before processing with R. If you are planning on using "skip = n" to skip over records before processing, then the last thread you would start would have to read through 7/8 of the file before starting. The actual I/O, plus the looking for the line fe

Re: [R] Parallel Scan of Large File

> Date: Tue, 7 Dec 2010 17:22:57 -0800 > From: ryan.steven.gar...@gmail.com > To: r-help@r-project.org > Subject: [R] Parallel Scan of Large File > > > Is it possible to parallel scan a large file into a character vector in 1M > chunks using scan() wit