RE: Solr with Hadoop

2013-07-18 Thread Saikat Kanjilal
ine if you have more questions. Regards > From: mlie...@impetus.com > To: solr-user@lucene.apache.org > Subject: Re: Solr with Hadoop > Date: Thu, 18 Jul 2013 15:41:36 + > > Rajesh, > > If you require to have an integration between Solr and Hadoop or NoSQL, I &g

Re: Solr with Hadoop

2013-07-18 Thread Matt Lieber
Rajesh, If you require to have an integration between Solr and Hadoop or NoSQL, I would recommend using a commercial distribution. I think most are free to use as long as you don't require support. I inquired about the Cloudera Search capability, but it seems like that far it is just preliminary:

Re: solr with hadoop

2010-07-06 Thread Jason Rutherglen
> If you do distributed indexing correctly, what about updating the documents > and what about replicating them correctly? Yes, you can do you and it'll work great. On Mon, Jul 5, 2010 at 7:42 AM, MitchK wrote: > > I need to revive this discussion... > > If you do distributed indexing correctly,

Re: solr with hadoop

2010-07-05 Thread MitchK
I need to revive this discussion... If you do distributed indexing correctly, what about updating the documents and what about replicating them correctly? Does this work? Or wasn't this an issue? Kind regards - Mitch -- View this message in context: http://lucene.472066.n3.nabble.com/solr-wit

Re: solr with hadoop

2010-06-23 Thread Otis Gospodnetic
al Message > From: Jon Baer > To: solr-user@lucene.apache.org > Sent: Tue, June 22, 2010 12:47:14 PM > Subject: Re: solr with hadoop > > I was playing around w/ Sqoop the other day, its a simple Cloudera tool for > imports (mysql -> hdfs) @ > href="http://www.clouder

Re: solr with hadoop

2010-06-22 Thread Jon Baer
ematext.com/ -- Lucene - Solr - Nutch >> >> - Original Message >> From: Stu Hood >> To: solr-user@lucene.apache.org >> Sent: Monday, January 7, 2008 7:14:20 PM >> Subject: Re: solr with hadoop >> >> As Mike suggested, we use Hadoop t

Re: solr with hadoop

2010-06-22 Thread MitchK
> Otis > -- > Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch > > - Original Message > From: Stu Hood > To: solr-user@lucene.apache.org > Sent: Monday, January 7, 2008 7:14:20 PM > Subject: Re: solr with hadoop > > As Mike suggested, we use Hadoop

Re: solr with hadoop

2010-06-22 Thread Marc Sturlese
I think a good solution could be to use hadoop with SOLR-1301 to build solr shards and then use solr distributed search against these shards (you will have to copy to local from HDFS to search against them) -- View this message in context: http://lucene.472066.n3.nabble.com/solr-with-hadoop-tp48

Re: solr with hadoop

2010-06-22 Thread Neeb
Hi, We currently have a master-slave setup for solr with two slave servers. We are using Solrj (stream-update-solr-server) to index master slave, which takes 6 hours to index around 15 million documents. I would like to explore hadoop, in particularly for indexing job using mapreduce approach.

Re: solr with hadoop

2008-01-07 Thread Otis Gospodnetic
t;[EMAIL PROTECTED]> To: solr-user@lucene.apache.org Sent: Monday, January 7, 2008 7:14:20 PM Subject: Re: solr with hadoop As Mike suggested, we use Hadoop to organize our data en route to Solr. Hadoop allows us to load balance the indexing stage, and then we use the raw Lucene IndexWrit

Re: solr with hadoop

2008-01-07 Thread Stu Hood
Klaas <[EMAIL PROTECTED]> Sent: Friday, January 4, 2008 3:04pm To: solr-user@lucene.apache.org Subject: Re: solr with hadoop On 4-Jan-08, at 11:37 AM, Evgeniy Strokin wrote: > I have huge index base (about 110 millions documents, 100 fields > each). But size of the index base is reas

Re: solr with hadoop

2008-01-05 Thread Otis Gospodnetic
Evgeniy, Two simple options: 1) take your index, put it on N Solr search servers, and put them behind a load balancer 2) take your index, split it in N (or create N smaller indices from scratch) and put it on N Solr search servers (and see SOLR-303) Each will help in a different way and it soun

Re: solr with hadoop

2008-01-04 Thread Ryan McKinley
Mike Klaas wrote: On 4-Jan-08, at 11:37 AM, Evgeniy Strokin wrote: I have huge index base (about 110 millions documents, 100 fields each). But size of the index base is reasonable, it's about 70 Gb. All I need is increase performance, since some queries, which match big number of documents, a

Re: solr with hadoop

2008-01-04 Thread Mike Klaas
On 4-Jan-08, at 11:37 AM, Evgeniy Strokin wrote: I have huge index base (about 110 millions documents, 100 fields each). But size of the index base is reasonable, it's about 70 Gb. All I need is increase performance, since some queries, which match big number of documents, are running slow.