What you need to ensure is that you have sufficient physical memory for the
operations that you want to do.  I would suggest at least 3X the size of
the object you want to create.  If you have RData files that will result
(after the rbind) into a 40GB object, then you will need over 100GB of
physical memory since the rbind operation will be creating a new object of
40GB from the separate files that total 40GB, so that is 80GB right there.
 If you then want to do some operations on an object that large, you might
be making copies, so you need the memory.

Maybe you should consider keeping the data in a relational database and
then use the SELECT operator to get just the data you need.  Also the
aggregation operators might be useful to reduce the size of physical memory
that you need.


On Fri, Jul 26, 2013 at 11:04 AM, David Winsemius <dwinsem...@comcast.net>wrote:

>
> On Jul 25, 2013, at 7:17 AM, Dark wrote:
>
> > Hi,
> >
> > Yes maybe I should have been more clear on my problem.
> > I want to append the different data-frames back into one variable (
> rbind )
> > and save it as one R Data file.
> >
>
> Indeed. That was the operation I had in mind when I made my suggestions.
> Perhaps you need to create a set of toy dataframes with similar structure
> and then the audience can propose solutions. That's the usual process
> around these parts.
>
> --
> David.
>
>
> > Regards Derk
> >
> >
> >
> > --
> > View this message in context:
> http://r.789695.n4.nabble.com/Saving-multiple-rda-files-as-one-rda-file-tp4672041p4672313.html
> > Sent from the R help mailing list archive at Nabble.com.
> >
> > ______________________________________________
> > R-help@r-project.org mailing list
> > https://stat.ethz.ch/mailman/listinfo/r-help
> > PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> > and provide commented, minimal, self-contained, reproducible code.
>
> David Winsemius
> Alameda, CA, USA
>
> ______________________________________________
> R-help@r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide
> http://www.R-project.org/posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>



-- 
Jim Holtman
Data Munger Guru

What is the problem that you are trying to solve?
Tell me what you want to do, not how you want to do it.

        [[alternative HTML version deleted]]

______________________________________________
R-help@r-project.org mailing list
https://stat.ethz.ch/mailman/listinfo/r-help
PLEASE do read the posting guide http://www.R-project.org/posting-guide.html
and provide commented, minimal, self-contained, reproducible code.

Reply via email to