On 07/15/2010 05:07 AM, Peter Dalgaard wrote:
paul s wrote:
On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
A quick calculation reveals that a matrix of that size requires about
2.7 TERAbytes of storage, so I'm a bit confused as to how you might
expect to fit it into 16GB of RAM...
However, eve
paul s wrote:
>
> On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
>> A quick calculation reveals that a matrix of that size requires about
>> 2.7 TERAbytes of storage, so I'm a bit confused as to how you might
>> expect to fit it into 16GB of RAM...
>>
>> However, even with terabytes of memory, you
If the system is sparse and you have a really large cluster to play
with, then maybe (emphasis) PETSc/TAO is the right combination of tools
for your problem.
http://www.mcs.anl.gov/petsc/petsc-as/
Christos
On 07/14/2010 07:07 PM, Duncan Murdoch wrote:
It is capable of handling large data, but not that large in a single
matrix. The limit on the number of entries in any vector (and matrices
are stored as vectors) is about 2^31 ~ 2 billion. Your matrix needs
about 340 billion entries, so it's too big.
On 07/14/2010 06:10 PM, Douglas Bates wrote:
R stores matrices and other data objects in memory. A matrix of that
size would require
2e+06*17*8/2^30
[1] 2533.197
great, that is my understanding as well..
probably easier, rethink your problem.
yes. i am starting to do that now as i ha
On 07/14/2010 06:15 PM, Peter Dalgaard wrote:
A quick calculation reveals that a matrix of that size requires about
2.7 TERAbytes of storage, so I'm a bit confused as to how you might
expect to fit it into 16GB of RAM...
However, even with terabytes of memory, you would be running into the
(cu
On 14/07/2010 5:23 PM, paul s wrote:
hi -
i just started using R as i am trying to figure out how perform a linear
regression on a huge matrix.
i am sure this topic has passed through the email list before but could
not find anything in the archives.
i have a matrix that is 2,000,000 x 170
paul s wrote:
> hi -
>
> i just started using R as i am trying to figure out how perform a linear
> regression on a huge matrix.
>
> i am sure this topic has passed through the email list before but could
> not find anything in the archives.
>
> i have a matrix that is 2,000,000 x 170,000 the
On Wed, Jul 14, 2010 at 4:23 PM, paul s wrote:
> hi -
> i just started using R as i am trying to figure out how perform a linear
> regression on a huge matrix.
> i am sure this topic has passed through the email list before but could not
> find anything in the archives.
> i have a matrix that i
9 matches
Mail list logo
