Re: [R] A question about the ff package

2010-01-08 Thread OS
Thank you Jens. I will try your solutions and post the solutions/problems I have. Cheers Peter 2010/1/7 Jens Oehlschlägel > Peter, > > ff objects are not allowed as subscripts to ff objects. You can take > several routes > > 1) use bit objects instead of logical or ff logical. This is fast and t

Re: [R] A question about the ff package

2010-01-07 Thread Jens Oehlschlägel
Peter, ff objects are not allowed as subscripts to ff objects. You can take several routes 1) use bit objects instead of logical or ff logical. This is fast and takes factor 32 less RAM than logicals (BTW bit objects can be coerced to ff via as.ff() and as.bit() but they convert to vmode "bool

[R] A question about the ff package

2010-01-07 Thread Peter Tait
Hi, I am using version 2.1-1 of the ff package. I have a data set with 80 million rows and I need to create a new ffdf object, subseting by values in one of the original ffdf's columns. Here is my code: bigData <- read.table.ffdf(file="/data/demodata/data/smallData.txt", next.rows=1e5, head=TRUE,