Re: distributed search is significantly slower than direct search

2013-11-25 Thread Manuel Le Normand
https://issues.apache.org/jira/browse/SOLR-5478 There it goes On Mon, Nov 18, 2013 at 5:44 PM, Manuel Le Normand < manuel.lenorm...@gmail.com> wrote: > Sure, I am out of office till end of week. I reply after i upload the patch >

Re: distributed search is significantly slower than direct search

2013-11-18 Thread Manuel Le Normand
Sure, I am out of office till end of week. I reply after i upload the patch

Re: distributed search is significantly slower than direct search

2013-11-18 Thread Yuval Dotan
Hi Thanks very much for your answers :) Manuel, if you have a patch I will be glad to test it's performance Yuval On Mon, Nov 18, 2013 at 10:49 AM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > Manuel, that sounds very interesting. Would you be willing to > contribute this back to th

Re: distributed search is significantly slower than direct search

2013-11-18 Thread Shalin Shekhar Mangar
Manuel, that sounds very interesting. Would you be willing to contribute this back to the community? On Mon, Nov 18, 2013 at 9:53 AM, Manuel Le Normand wrote: > In order to accelerate the BinaryResponseWriter.write we extended this > writer class to implement the docid to id tranformation by docV

Re: distributed search is significantly slower than direct search

2013-11-17 Thread Manuel Le Normand
In order to accelerate the BinaryResponseWriter.write we extended this writer class to implement the docid to id tranformation by docValues (on memory) with no need to access stored field for id reading nor lazy loading of fields that also has a cost. That should improve read rate as docValues are

Re: distributed search is significantly slower than direct search

2013-11-17 Thread Mark Miller
$SegmentTermsEnum$Frame.loadBlock takes most of the time. >>>>> Out of the 7 seconds run these methods take ~5 and >>>>> BinaryResponseWriter.write takes the rest(~ 2 seconds). >>>>> >>>>> We tried increasing cache sizes and got hits, but it o

Re: distributed search is significantly slower than direct search

2013-11-17 Thread Yuval Dotan
seconds). > > >> > > >> We tried increasing cache sizes and got hits, but it only improved the > > >> query time by a second (~6), so no major effect. > > >> We are not indexing during our tests. The performance is similar. > > >> (How do w

Re: distributed search is significantly slower than direct search

2013-11-17 Thread Tomás Fernández Löbbe
or effect. > >> We are not indexing during our tests. The performance is similar. > >> (How do we measure doc size? Is it important due to the fact that the > >> performance is the same when returning only id field?) > >> > >> We still don't complet

Re: distributed search is significantly slower than direct search

2013-11-17 Thread Yuval Dotan
he performance (code, configuration, query)? >> >> -Original Message----- >> From: idokis...@gmail.com [mailto:idokis...@gmail.com] On Behalf Of >> Manuel Le Normand >> Sent: Thursday, November 14, 2013 1:30 AM >> To: solr-user@lucene.apache.org >> Subjec

Re: distributed search is significantly slower than direct search

2013-11-16 Thread Michael Sokolov
-user@lucene.apache.org Subject: Re: distributed search is significantly slower than direct search It's surprising such a query takes a long time, I would assume that after trying consistently q=*:* you should be getting cache hits and times should be faster. Try see in the adminUI how do your

RE: distributed search is significantly slower than direct search

2013-11-14 Thread Elran Dvir
(code, configuration, query)? -Original Message- From: idokis...@gmail.com [mailto:idokis...@gmail.com] On Behalf Of Manuel Le Normand Sent: Thursday, November 14, 2013 1:30 AM To: solr-user@lucene.apache.org Subject: Re: distributed search is significantly slower than direct search It's surpris

Re: distributed search is significantly slower than direct search

2013-11-13 Thread Manuel Le Normand
groups them. > > > > Is there a way to refactor code in order to improve distributed documents > > fetching? > > > > Thanks. > > > > -----Original Message- > > From: Erick Erickson [mailto:erickerick...@gmail.com] > > Sent: Wednesday, October

Re: distributed search is significantly slower than direct search

2013-11-13 Thread Erick Erickson
-- > From: Erick Erickson [mailto:erickerick...@gmail.com] > Sent: Wednesday, October 30, 2013 3:17 AM > To: solr-user@lucene.apache.org > Subject: Re: distributed search is significantly slower than direct search > > You can't. There will inevitably be some overhead in the dist

RE: distributed search is significantly slower than direct search

2013-11-12 Thread Elran Dvir
: Erick Erickson [mailto:erickerick...@gmail.com] Sent: Wednesday, October 30, 2013 3:17 AM To: solr-user@lucene.apache.org Subject: Re: distributed search is significantly slower than direct search You can't. There will inevitably be some overhead in the distributed case. That said, 7 seconds is

Re: distributed search is significantly slower than direct search

2013-10-29 Thread Erick Erickson
You can't. There will inevitably be some overhead in the distributed case. That said, 7 seconds is quite long. 5,000 rows is excessive, and probably where your issue is. You're having to go out and fetch the docs across the wire. Perhaps there is some batching that could be done there, I don't kno

distributed search is significantly slower than direct search

2013-10-28 Thread Elran Dvir
Hi all, I am using Solr 4.4 with multi cores. One core (called template) is my "routing" core. When I run http://127.0.0.1:8983/solr/template/select?rows=5000&q=*:*&shards=127.0.0.1:8983/solr/core1, it consistently takes about 7s. When I run http://127.0.0.1:8983/solr/core1/select?rows=5000&q=