Re: [R] Median of streaming data

2014-09-30 Thread Mohan Radhakrishnan
Hi, I came across this project(http://jwijffels.github.io/RMOA/) which seems to be directly addressing streaming prediction. >From the manual : A data stream environment has different requirements from the traditional setting. The most significant are the following: Requirement 1 Process a

Re: [R] Median of streaming data

2014-09-26 Thread Rolf Turner
On 26/09/14 21:48, Martin Maechler wrote: Rolf Turner > I have coded up the algorithm from the Cameron and Turner > paper. Dunno if it gives exactly the same results as my > (Splus?) code from lo these many years ago (the code that > is lost in the mists of time), but

Re: [R] Median of streaming data

2014-09-26 Thread Martin Maechler
> Rolf Turner > on Thu, 25 Sep 2014 11:44:38 +1200 writes: > On 24/09/14 20:16, Martin Maechler wrote: >> 1) has your proposal ever been provided in R? I'd be >> happy to add it to the robustX >> (http://cran.ch.r-project.org/web/packages/robustX) or >> even rob

Re: [R] Median of streaming data

2014-09-24 Thread Rolf Turner
On 24/09/14 20:16, Martin Maechler wrote: 1) has your proposal ever been provided in R? I'd be happy to add it to the robustX (http://cran.ch.r-project.org/web/packages/robustX) or even robustbase (http://cran.ch.r-project.org/web/packages/robustbase) package. I have coded up t

Re: [R] Median of streaming data

2014-09-24 Thread Rolf Turner
On 25/09/14 02:55, Mohan Radhakrishnan wrote: I meant the papers. I hit a paywall. Can we reconstruct the code from the papers ? Shouldn't be too tough; the algorithm (in the Cameron and Turner paper) is actually pretty simple. I intend to code it up again; could not find any trace of the o

Re: [R] Median of streaming data

2014-09-24 Thread Mohan Radhakrishnan
Sent: 24 September 2014 09:17 > To: Rolf Turner > Cc: R-help@r-project.org; r-sig-rob...@r-project.org > Subject: Re: [R] Median of streaming data > > >>>>> Rolf Turner > >>>>> on Wed, 24 Sep 2014 18:43:34 +1200 writes: > > > On 24/

Re: [R] Median of streaming data

2014-09-24 Thread Martyn Byng
- From: r-help-boun...@r-project.org [mailto:r-help-boun...@r-project.org] On Behalf Of Martin Maechler Sent: 24 September 2014 09:17 To: Rolf Turner Cc: R-help@r-project.org; r-sig-rob...@r-project.org Subject: Re: [R] Median of streaming data >>>>> Rolf Turner >>>>>

Re: [R] Median of streaming data

2014-09-24 Thread Rolf Turner
On 24/09/14 20:16, Martin Maechler wrote: Rolf Turner on Wed, 24 Sep 2014 18:43:34 +1200 writes: > On 24/09/14 17:31, Mohan Radhakrishnan wrote: >> Hi, >> >> I have streaming data(1 TB) that can't fit in memory. Is >> there a way for me to find the median of these

Re: [R] Median of streaming data

2014-09-24 Thread Mohan Radhakrishnan
Hi, Are these free ? :-) Thanks, Mohan On Wed, Sep 24, 2014 at 1:46 PM, Martin Maechler wrote: > > Rolf Turner > > on Wed, 24 Sep 2014 18:43:34 +1200 writes: > > > On 24/09/14 17:31, Mohan Radhakrishnan wrote: > >> Hi, > >> > >> I have streaming data(1 TB) tha

Re: [R] Median of streaming data

2014-09-24 Thread Martin Maechler
> Rolf Turner > on Wed, 24 Sep 2014 18:43:34 +1200 writes: > On 24/09/14 17:31, Mohan Radhakrishnan wrote: >> Hi, >> >> I have streaming data(1 TB) that can't fit in memory. Is >> there a way for me to find the median of these streaming >> integers assuming I

Re: [R] Median of streaming data

2014-09-23 Thread Rolf Turner
On 24/09/14 17:31, Mohan Radhakrishnan wrote: Hi, I have streaming data(1 TB) that can't fit in memory. Is there a way for me to find the median of these streaming integers assuming I can fit only a small part in memory ? This is about the statistical approach to find the median of a l

[R] Median of streaming data

2014-09-23 Thread Mohan Radhakrishnan
Hi, I have streaming data(1 TB) that can't fit in memory. Is there a way for me to find the median of these streaming integers assuming I can fit only a small part in memory ? This is about the statistical approach to find the median of a large number of values when I can inspect only a p