Hi, Yes, I am using the 32-bit version of R (version 2.10.0 RC). The OS used is Windows-7 32 bit.
And I preprocessed the airline csv file using the utilities provided on bigmemory.org. The R-environment is empty, with no other objects in memory. When I test the code provided by you, I am able to run it successfully the first time. But when I run it the next time, I get the error:- Error in filebacked.big.matrix(nrow = nrow, ncol = ncol, type = type, : Problem creating filebacked matrix. And this only runs for data of length 1000000. Any light on the issue I am having? Thanks and Regards, Harsh Yadav On Wed, Aug 11, 2010 at 5:00 PM, Jay Emerson <jayemer...@gmail.com> wrote: > > It seems very likely you are working on a 32-bit version of R, but it's a > little surprising still that you would have a problem with any single year. > Please tell us the operating system and version of R. Did you preprocess > the airline CSV file using the utilities provided on bigmemory.org? If > you don't, then anything character will be converted to NA. Is your R > environment empty, or did you have other objects in memory? > > It might help to just do some tests yourself: > > x <- big.matrix(nrow=1000000, ncol=10, ....... other options .....) > > Make sure it works, then increase the size until you get a failure. This > sort of exercise is extremely helpful in situations like this. > > Jay > > > Subject: [R] Bigmemory: Error Running Example > Message-ID: > > <aanlktint+xsxiuyainbcstmbdkedtawb--wfccgnr...@mail.gmail.com<aanlktint%2bxsxiuyainbcstmbdkedtawb--wfccgnr...@mail.gmail.com> > > > Content-Type: text/plain > > > Hi, > > I am trying to run the bigmemory example provided on the > http://www.bigmemory.org/ > > The example runs on the "airline data" and generates summary of the csv > files:- > > library(bigmemory) > library(biganalytics) > x <- read.big.matrix("2005.csv", type="integer", header=TRUE, > backingfile="airline.bin", > descriptorfile="airline.desc", > extraCols="Age") > summary(x) > > > This runs fine for the provided csv for year 1987 (size=121MB). However, > for > big files like for year 2005 (size=639MB), it gives following errors:- > > Error in filebacked.big.matrix(nrow = nrow, ncol = ncol, type = type, : > Problem creating filebacked matrix. > > Error: object 'x' not found > Error in summary(x) : > error in evaluating the argument 'object' in selecting a method for > function 'summary' > > Here is the output from running the memory.limit() :- > [1] 2047 > > Here is the output from running the memory.profile() :- > > NULL symbol pairlist closure environment promise > 1 9381 325570 6477 744 3710 > language special builtin char logical integer > 121940 178 1600 15068 9518 8981 > double complex character ... any list > 7983 17 47593 0 0 4073 > expression bytecode externalptr weakref raw S4 > 2 0 618 117 119 1838 > > > Anyone who has previously worked with bigmemory before could throw some > light on it. > Were you able to run the examples successfully? > > Thanks in advance. > > Harsh Yadav > > > -- > John W. Emerson (Jay) > Associate Professor of Statistics > Department of Statistics > Yale University > http://www.stat.yale.edu/~jay <http://www.stat.yale.edu/%7Ejay> > [[alternative HTML version deleted]] ______________________________________________ R-help@r-project.org mailing list https://stat.ethz.ch/mailman/listinfo/r-help PLEASE do read the posting guide http://www.R-project.org/posting-guide.html and provide commented, minimal, self-contained, reproducible code.
