Re: [R] Matrix Size

2010-07-15 Thread paul s
On 07/15/2010 05:07 AM, Peter Dalgaard wrote: paul s wrote: On 07/14/2010 06:15 PM, Peter Dalgaard wrote: A quick calculation reveals that a matrix of that size requires about 2.7 TERAbytes of storage, so I'm a bit confused as to how you might expect to fit it into 16GB of RAM... Ho

Re: [R] Matrix Size

2010-07-14 Thread paul s
On 07/14/2010 07:07 PM, Duncan Murdoch wrote: It is capable of handling large data, but not that large in a single matrix. The limit on the number of entries in any vector (and matrices are stored as vectors) is about 2^31 ~ 2 billion. Your matrix needs about 340 billion entries, so it's too big.

Re: [R] Matrix Size

2010-07-14 Thread paul s
On 07/14/2010 06:10 PM, Douglas Bates wrote: R stores matrices and other data objects in memory. A matrix of that size would require 2e+06*17*8/2^30 [1] 2533.197 great, that is my understanding as well.. probably easier, rethink your problem. yes. i am starting to do that now as i ha

Re: [R] Matrix Size

2010-07-14 Thread paul s
On 07/14/2010 06:15 PM, Peter Dalgaard wrote: A quick calculation reveals that a matrix of that size requires about 2.7 TERAbytes of storage, so I'm a bit confused as to how you might expect to fit it into 16GB of RAM... However, even with terabytes of memory, you would be running into the (cu

[R] Matrix Size

2010-07-14 Thread paul s
hi - i just started using R as i am trying to figure out how perform a linear regression on a huge matrix. i am sure this topic has passed through the email list before but could not find anything in the archives. i have a matrix that is 2,000,000 x 170,000 the values right now are arbitra