Re: [R] How to Read a Large CSV into a Database with R

Thanks On 11/16/2010 12:41 PM, Seth Falcon wrote: > Hi Abhijit, > > [I've cc'd R-help to keep the discussion on the list] > > On Tue, Nov 16, 2010 at 8:06 AM, Abhijit Dasgupta > wrote: > >> Seth, >> >> I was looking for something like this too. I've a question. If >> you're reading the data f

Re: [R] How to Read a Large CSV into a Database with R

Hi Abhijit, [I've cc'd R-help to keep the discussion on the list] On Tue, Nov 16, 2010 at 8:06 AM, Abhijit Dasgupta wrote: > Seth, > > I was looking for something like this too. I've a question. If > you're reading the data from a connection, does R start reading the > next chunk of data right a

Re: [R] How to Read a Large CSV into a Database with R

Hi Anthony, On Mon, Nov 15, 2010 at 7:07 AM, Anthony Damico wrote: > Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32.  I'm trying to > insert a very large CSV file into a SQLite database.  I'm pretty new to > working with databases in R, so I apologize if I'm overlooking something >

Re: [R] How to Read a Large CSV into a Database with R

On Mon, Nov 15, 2010 at 1:28 PM, Anthony Damico wrote: > Hi Gabor, > > Thank you for your willingness to help me through this.  The code you sent > works on my machine exactly the same way as it does on yours. > Unfortunately, when I run the same code on the 1.3GB file, it creates the > table stru

Re: [R] How to Read a Large CSV into a Database with R

On Mon, 15 Nov 2010 13:28:40 -0500, Anthony Damico wrote: > Do you have any other ideas as to how I might diagnose what's going on > here? Or, alternatively, is there some workaround that would get this giant > CSV into a database? If you think there's a reasonable way to use the > IMPORT comman

Re: [R] How to Read a Large CSV into a Database with R

> From: ajdam...@gmail.com > Date: Mon, 15 Nov 2010 13:28:40 -0500 > To: ggrothendi...@gmail.com; r-help@r-project.org > Subject: Re: [R] How to Read a Large CSV into a Database with R > > Hi Gabor, > > Thank you for you

Re: [R] How to Read a Large CSV into a Database with R

Hi Gabor, Thank you for your willingness to help me through this. The code you sent works on my machine exactly the same way as it does on yours. Unfortunately, when I run the same code on the 1.3GB file, it creates the table structure but doesn't read in a single line [confirmed with sqldf("sele

Re: [R] How to Read a Large CSV into a Database with R

On Mon, Nov 15, 2010 at 11:46 AM, Anthony Damico wrote: > Hi Gabor, > > Thank you for the prompt reply.  I definitely looked over all of the > examples on the code.google.com sqldf page before sending, which is why I > wrote the code > > read.csv.sql("ss09pusa.csv" , sql="create table ss09pusa as

Re: [R] How to Read a Large CSV into a Database with R

Hi Gabor, Thank you for the prompt reply. I definitely looked over all of the examples on the code.google.com sqldf page before sending, which is why I wrote the code read.csv.sql("ss09pusa.csv" , sql="create table ss09pusa as select * from file" , dbname="sqlite") directly pulled from their co

Re: [R] How to Read a Large CSV into a Database with R

On Mon, Nov 15, 2010 at 10:07 AM, Anthony Damico wrote: > Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32.  I'm trying to > insert a very large CSV file into a SQLite database.  I'm pretty new to > working with databases in R, so I apologize if I'm overlooking something > obvious here

Re: [R] How to Read a Large CSV into a Database with R

Anthony-107 wrote: > > Hi, I'm working in R 2.11.1 x64 on Windows x86_64-pc-mingw32. I'm trying > to > insert a very large CSV file into a SQLite database. > Better use an external utility if this is a one-time import for this job: http://sqlitebrowser.sourceforge.net/ Dieter -- View th