Re: [Rd] likely bug in 'serialize' or please explain the memory usage

2009-11-03 Thread Duncan Murdoch
Sent: 03 November 2009 11:59 To: Sklyar, Oleg (London) Cc: r-devel@r-project.org Subject: Re: [Rd] likely bug in 'serialize' or please explain the memory usage I haven't had a chance to look really closely at this, but I would guess the problem is that in R functions are "clo

Re: [Rd] likely bug in 'serialize' or please explain the memory usage

2009-11-03 Thread Sklyar, Oleg (London)
2009 11:59 > To: Sklyar, Oleg (London) > Cc: r-devel@r-project.org > Subject: Re: [Rd] likely bug in 'serialize' or please explain > the memory usage > > I haven't had a chance to look really closely at this, but I > would guess > the problem is that in

Re: [Rd] likely bug in 'serialize' or please explain the memory usage

2009-11-03 Thread Duncan Murdoch
I haven't had a chance to look really closely at this, but I would guess the problem is that in R functions are "closures". The environment attached to the function will be serialized along with it, so if you have a big dataset in the same environment, you'll get that too. I vaguely recall th

[Rd] likely bug in 'serialize' or please explain the memory usage

2009-11-03 Thread Sklyar, Oleg (London)
Hi all, assume the following problem: a function call takes a function object and a data variable and calls this function with this data on a remote host. It uses serialization to pass both the function and the data via a socket connection to a remote host. The problem is that depending on the way