Have you tried watching the threads in a monitoring program like VisualVM?
We have found that at a certain point the solr software starts locking in
the synchronous calls including logging.
--
Jeff Newburn
Software Engineer, Zappos.com
jnewb...@zappos.com - 702-943-7562
> From: Raf Gemmail <raf.gemm...@tmdr.com>
> Reply-To: <solr-user@lucene.apache.org>
> Date: Tue, 26 Jan 2010 15:25:51 +0000
> To: <solr-user@lucene.apache.org>
> Subject: Behaviour Indicitive of Throttling
>
> I've been working on benchmarking our solr response times in relation to
> the a variable number of concurrent queries. With maxThreads=150 - I've
> tried running between 20-100 queries concurrently against our solr
> instance and have noted that for all n-way (>20) queries I'm finding
> that performance flatlines at 20-30 requests/second.
>
> We've tried tuning caches and while part of the poor performance is
> down to poor query formulation - I find the lack of seeing either
> performance improvement or degradation as being indicative of some kind
> of throttling.
>
> Not sure if this is the case or not however as a novice in these realms
> I would appreciate some guidance as to what I should be looking at and
> where we might be able to tune/investigate?
>
> We've ruled out disk contention and network latency.
>
> Useful metrics:
> maxThreads:150
> filterCache Size; 16384
> queryResultCache size: 16384
> documentCache size: 10502
>
> I'm running Solr/Lucene version:
> Solr Specification Version: 1.3.0.2009.08.19.15.54.27Solr Implementation
> Version: 1.4-dev ${svnversion} - rafiq - 2009-08-19 15:54:27Lucene
> Specification Version: 2.9-dev
>
> Would be grateful for any pointers and can furnish more details.
>
> --
> Raf Gemmail
>
> Software Engineer
> www.tmdr.com
> 0207 3489 912
> Extension: 5112
> Raf Gemmail
> Senior Developer
> www.tmdr.com
> d: 0207 3489 912
> t: 0845 468 0568
> f: 0845 468 0868
> m:
> Beaumont House, Kensington Village, Avonmore Road, London, W14 8TS
>
> - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
> - - - - - - - - - - - - - - - -
> This message is sent in confidence for the addressee only. It may contain
> privileged
> information. The contents are not to be disclosed to anyone other than the
> addressee.
> Unauthorised recipients are requested to preserve this confidentiality and to
> advise
> us of any errors in transmission. Thank you.
> Trinity Mirror Digital Recruitment ltd is registered in England & Wales.
> Registered office: One Canada Square, Canary Wharf, London E14 5AP.
> Registered No: 01904765.
