Re: [R] Processing 10^8 rows and 1^3 columns

2008-07-02 Thread Gabor Grothendieck
The sqldf package makes it easy to use DBI, RSQLite and sqlite to read a large file directly to an sqlite database without going through R and then read all or a portion of it into R using an arbitrary SQL statement. See example 6 on the home page: http://sqldf.googlecode.com On Wed, Jul 2, 2008

[R] Processing 10^8 rows and 1^3 columns

2008-07-02 Thread Daren Tan
With smaller tab-limited files, I could load them using read.table and the likes. Now I have a gigantic 10^8 rows and 1^3 columns tab-limited file for processsing, please throw some ideas how to handle it. Thanks _ Publish your ph