With that much RAM, you probably have many cores. Consider splitting
your long array across several R sessions with distributed parallel
processing so that no one segment is over the limit. You will likely
need the parallel processing anyway to make your computation time
tolerable. See the pbdDEMO package and the rest of pbdR packages (see
r-pbd.org).
Cheers,
George
On 1/6/14 6:00 AM, [email protected] wrote:
----------------------------------------------------------------------
Message: 1
Date: Sun, 5 Jan 2014 20:18:06 +0000
From: Boris Aronshtam <[email protected]>
To: "[email protected]" <[email protected]>
Cc: Boris Aronshtam <[email protected]>
Subject: [Rd] Support for long arrays
Message-ID:
<9d80368c6a00834189c1982fb64efa3007ee9...@ord2mbx07c.mex05.mlsrvr.com>
Content-Type: text/plain
My machine has hundreds of GB of RAM. Is there a way to create an array having
more than 2 Billion (2^31) rows?
I am trying to create a large array using:
d = c(1e+10,2)
a=array(0,d)
This results in the error:
Error in array(0, d) : negative length vectors are not allowed
In addition: Warning message:
In array(0, d) : NAs introduced by coercion
Note that I can create a vector of the same large size:
v=c(1:2e+10)
[[alternative HTML version deleted]]
------------------------------
Message: 2
Date: Sun, 05 Jan 2014 15:41:18 -0500
From: Duncan Murdoch <[email protected]>
To: Boris Aronshtam <[email protected]>,
"[email protected]" <[email protected]>
Subject: Re: [Rd] Support for long arrays
Message-ID: <[email protected]>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
On 14-01-05 3:18 PM, Boris Aronshtam wrote:
My machine has hundreds of GB of RAM. Is there a way to create an array having
more than 2 Billion (2^31) rows?
Not currently. Individual dimensions are limited to signed 32 bit
values. The overall count of elements is limited to 2^52 or so.
Duncan Murdoch
I am trying to create a large array using:
d = c(1e+10,2)
a=array(0,d)
This results in the error:
Error in array(0, d) : negative length vectors are not allowed
In addition: Warning message:
In array(0, d) : NAs introduced by coercion
Note that I can create a vector of the same large size:
v=c(1:2e+10)
[[alternative HTML version deleted]]
______________________________________________
[email protected] mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
------------------------------
______________________________________________
[email protected] mailing list
https://stat.ethz.ch/mailman/listinfo/r-devel
