Re: Federated Search

2008-03-03 Thread Grégoire Neuville
Ok, thanks a lot for your answer. I'm going to investigate that way (Distributed Search) though after reading this (http://www.nabble.com/Multiple-Search-in-Solr-td15268564.html), I'll keep in mind the possibility of 'tweaking' Solr with the LuceneWebService as an inspiration tool ; I've also been

Re: Federated Search

2008-02-29 Thread Otis Gospodnetic
Grégoire, I believe the answers to your first 2 questions are both positive. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message > From: Grégoire Neuville <[EMAIL PROTECTED]> > To: solr-user@lucene.apache.org > Sent: Friday, February 29, 2008 6:38:50 AM >

Re: Federated Search

2008-02-29 Thread Mathieu Lecarme
- browsing through the web came I accross an application called the Lucene Web Service : what do you think of it ? (its goal seems precisely to query multiple indices, it thus would be the thing I'm searching for ; but considering the scale of this project, I think I'd prefer to base my work on

Re: Federated Search

2007-03-14 Thread Venkatesh Seetharam
Hi Jed, Thanks for sharing your thoughts and the link. Venkatesh On 3/11/07, Jed Reynolds <[EMAIL PROTECTED]> wrote: Venkatesh Seetharam wrote: > >> The hash idea sounds really interesting and if I had a fixed number of > indexes it would be perfect. > I'm infact looking around for a reve

Re: SPAM-LOW: Re: Federated Search

2007-03-14 Thread Tim Patton
I have several indexes now (4 at the moment, 20gb each, and I want to be able to drop in a new machine easily). I'm using SQL server as a DB and it scales well. The DB doesn't get hit too hard, mostly doing location lookups, and the app does some checking to make sure a document has really c

Re: Federated Search

2007-03-10 Thread Jed Reynolds
Venkatesh Seetharam wrote: The hash idea sounds really interesting and if I had a fixed number of indexes it would be perfect. I'm infact looking around for a reverse-hash algorithm where in given a docId, I should be able to find which partition contains the document so I can save cycles

Re: Federated Search

2007-03-05 Thread Venkatesh Seetharam
Hi Tim, Thanks for your response. Interesting idea. Does the DB scale? Do you have one single index which you plan to use Solr for or you have multiple indexes? But I don't know how big the index will grow and I wanted to be able to add servers at any point. I'm thinking of having N partition

Re: Federated Search

2007-03-05 Thread Tim Patton
Venkatesh Seetharam wrote: Hi Tim, Howdy. I saw your post on Solr newsgroup and caught my attention. I'm working on a similar problem for searching a vault of over 100 million XML documents. I already have the encoding part done using Hadoop and Lucene. It works like a charm. I create N in

Re: Federated Search

2007-02-27 Thread Mike Klaas
On 2/27/07, Ken Krugler <[EMAIL PROTECTED]> wrote: I'm also interested in this. For me, I don't need sorted output, faceted browsing, or alternative output formats - so something along the lines of the "Merge XML responses w/o Schema" proposal would be just fine. Open issues: 3. Highlighting

Re: Federated Search

2007-02-27 Thread Ken Krugler
I just downloaded Solr to try out, it seems like it will replace a ton of code I've written. I saw a few posts about the FederatedSearch and skimmed the ideas at http://wiki.apache.org/solr/FederatedSearch. The project I am working on has several Lucene indexes 20-40GB in size spread among a