Check out read.csv.sql in the sqldf package. It reads a file directly
into sqlite without going through R and then from there into R. It
sets up the database and file layouts in the database for you and also
destroys the database when finished so reading is just a matter of one
line of R code. I
hello *, im running into two major bottlenecks an R script.
1. going through a 40mb file and reading in via readLines() 1 line at
a time is almost an order of magnitude slow than the equivalent in
python, im wondering if there are alternatives to readLines(), doing
more lines at a time helps a bit
2 matches
Mail list logo
