Map/Reduce directly against solr4 index.

2012-07-26 Thread Trung Pham
Is it possible to run map reduce jobs directly on Solr4? I'm asking this because I want to use Solr4 as the primary storage engine. And I want to be able to run near real time analytics against it as well. Rather than export solr4 data out to a hadoop cluster.

Re: Map/Reduce directly against solr4 index.

2012-07-26 Thread Trung Pham
eously, the question is whether > your Solr is architected to handle that amount of throughput. > > > On Thu, 2012-07-26 at 14:55 -0700, Trung Pham wrote: > > > Is it possible to run map reduce jobs directly on Solr4? > > > > I'm asking this because I want to

Re: Map/Reduce directly against solr4 index.

2012-07-26 Thread Trung Pham
aise an interesting possibility. A map/reduce solr handler over > > solrcloud... > > > > On Thu, 2012-07-26 at 18:52 -0700, Trung Pham wrote: > > > >> I think the performance should be close to Hadoop running on HDFS, if > >> somehow Hadoop job can di

Re: Map/Reduce directly against solr4 index.

2012-07-26 Thread Trung Pham
es available on that server. There might be > something that does this. HDFS works very hard at doing this; are you > sure it is not good enough? I am endlessly amazed at the speed of > these distributed apps. > > Have you done a proof of concept? > > On Thu, Jul 26, 2012 at 7:40 PM