Re: How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-19 Thread Daniel Bruegge
gs. But I haven't found the perfect settings up to now. Thanks. Daniel > > Otis > > Performance Monitoring SaaS for Solr - > http://sematext.com/spm/solr-performance-monitoring/index.html > > > > >On Thu, Jan 19, 2012 at 12:14 AM, Mark Miller > wrote:

Re: How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-18 Thread Daniel Bruegge
totally wrong track? Daniel On Thu, Jan 19, 2012 at 12:14 AM, Mark Miller wrote: > You can raise the limit to a point. > > On Jan 18, 2012, at 5:59 PM, Daniel Bruegge wrote: > > > Hi, > > > > I am just wondering how I can 'grow' a distributed Solr setup to an

How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-18 Thread Daniel Bruegge
Hi, I am just wondering how I can 'grow' a distributed Solr setup to an index size of a couple of terabytes, when one of the distributed Solr limitations is max. 4000 characters in URI limitation. See: *The number of shards is limited by number of characters allowed for GET > method's URI; most W

Re: Solr hides some facet.fields when doing a distributed search over multiple shards

2012-01-18 Thread Daniel Bruegge
Thanks a lot. That worked like a charm. On Wed, Jan 18, 2012 at 9:50 PM, Yonik Seeley wrote: > On Wed, Jan 18, 2012 at 3:36 PM, Daniel Bruegge > wrote: > > > > Hi, > > > > I have asked the question already over Stackoverflow ( > > > http://stackoverflo

Solr hides some facet.fields when doing a distributed search over multiple shards

2012-01-18 Thread Daniel Bruegge
Hi, I have asked the question already over Stackoverflow ( http://stackoverflow.com/questions/8913654/solr-hides-some-facet-fields-when-doing-a-distributed-search), but maybe someone here can give me a hint how to solve this issue: I am searching over 6 Solr shards (Solr version 3.5). What I reco

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
n 17, 2012 at 2:36 PM, Daniel Bruegge < daniel.brue...@googlemail.com> wrote: > Evictions are 0 for all cache types. > > Your server max heap space with 12G is pretty huge. Which is good I think. > The CPU on my server is a 8-Core Intel i7 965. > > Commit frequency is low

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
What kind of server is it, in > terms of CPU and OS? How often do you commit to the index? > > Dmitry > > On Tue, Jan 17, 2012 at 3:01 PM, Daniel Bruegge < > daniel.brue...@googlemail.com> wrote: > > > Hi Dmitry, > > > > I had everything on one Solr Inst

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
What kind of server is it, in > terms of CPU and OS? How often do you commit to the index? > > Dmitry > > On Tue, Jan 17, 2012 at 3:01 PM, Daniel Bruegge < > daniel.brue...@googlemail.com> wrote: > > > Hi Dmitry, > > > > I had everything on one Solr Inst

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
faceting should become faster. Size > wise it should not be a problem for SOLR. > > Also, you didn't say anything about the facet.limit value, cache > parameters, usage of filter queries. Some of these can be interconnected. > > Dmitry > > On Tue, Jan 17, 2012 at 2

really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
Hi, I have 2 Solr-shards. One is filled with approx. 25mio documents (local index 6GB), the other with 10mio documents (2.7GB size). I am trying to create some kind of 'word cloud' to see the frequency of words for a *text_general *field. For this I am currently using a facet over this field and I