Re: [R] SVD Memory Issue

2011-09-14 Thread Paul Hiemstra
Hi, An SVD on a 771x5677 matrix should be fine, it took 30 seconds and no memory on my workstation. The problem is most likely when you transform the array tdm2 to a matrix. The array tdm2 has a much greater size than 771x5677, so does tdm_matrix. Without a reproducible example we cannot help you

[R] SVD Memory Issue

2011-09-13 Thread vioravis
I am trying to perform Singular Value Decomposition (SVD) on a Term Document Matrix I created using the 'tm' package. Eventually I want to do a Latent Semantic Analysis (LSA). There are 5677 documents with 771 terms (the DTM is 771 x 5677). When I try to do the SVD, it runs out of memory. I am us