Re: [R] Large Data Set Help

2008-08-25 Thread Charles C. Berry
On Mon, 25 Aug 2008, Roland Rau wrote: Hi, Jason Thibodeau wrote: I am attempting to perform some simple data manipulation on a large data set. I have a snippet of the whole data set, and my small snippet is 2GB in CSV. Is there a way I can read my csv, select a few columns, and write it

Re: [R] Large Data Set Help

2008-08-25 Thread Roland Rau
Hi, Jason Thibodeau wrote: I am attempting to perform some simple data manipulation on a large data set. I have a snippet of the whole data set, and my small snippet is 2GB in CSV. Is there a way I can read my csv, select a few columns, and write it to an output file in real time? This is what

Re: [R] Large Data Set Help

2008-08-25 Thread jim holtman
Establish a "connection" with the file you want to read, read in 1,000 rows (or whatever you want). If you are using read.csv and there is a header, you might want to skip it initially since there will be no header when you read the next 1000 rows. Also put 'as.is=TRUE" so that character fields a