Along the lines of one of Jim's suggestions, if you have some
basic MySQL knowledge check out the RMySQL package. I use it to
convert / partition a matrix similar to yours to R objects and it
works fine.
Hope this helps,
A.
On Fri, 2 Sep 2011 06:33:13 -0400
Jim Holtman wrote:
> i would sugges
On 09/01/2011 10:13 PM, Worik R wrote:
> I am starting on a (section of the) project where I need to build a matrix
> with on the order of 5 million rows and 200 columns
>
> I am wondering if I can stay in R.
>
> I need to do rollapply type operations on the columns, including some that
> will be
i would suggest that if you want to use R that you get a 64-bit version with
24GB of memory to start. if your data is a numeric matrix, you will need 8GB
for a single copy.
Do you really need it all in memory at once, or can you partition the problem?
Can you use a database to access the port
Friends
I am starting on a (section of the) project where I need to build a matrix
with on the order of 5 million rows and 200 columns
I am wondering if I can stay in R.
I need to do rollapply type operations on the columns, including some that
will be functions of (windows of) two columns.
I h
4 matches
Mail list logo
