Re: Lucene/Solr Filesystem tunings

2013-06-10 Thread Ryan Zezeski
Just to add to the pile...use the Deadline or NOOP I/O scheduler. -Z On Sat, Jun 8, 2013 at 4:40 PM, Mark Miller wrote: > Turning swappiness down to 0 can have some decent performance impact. > > - http://en.wikipedia.org/wiki/Swappiness > > In the past, I've seen better performance with ext3

Re: Distributed Search and the Stale Check

2013-02-27 Thread Ryan Zezeski
On Mon, Feb 25, 2013 at 8:26 PM, Mark Miller wrote: > Please file a JIRA issue and attach your patch. Great write up! (Saw it > pop up on twitter, so I read it a little earlier). > > Done. https://issues.apache.org/jira/browse/SOLR-4509

Re: Distributed Search and the Stale Check

2013-02-25 Thread Ryan Zezeski
On Mon, Feb 25, 2013 at 8:42 PM, Yonik Seeley wrote: > > > That's insane! > It is insane. Keep in mind this was a 5-node cluster on the same physical machine sharing the same resources. It consist of 5 smartos zones on the same global zone. On my MacBook Pro I saw ~1.5ms per stale check bu

Distributed Search and the Stale Check

2013-02-25 Thread Ryan Zezeski
Hello Solr Users, I just wrote up a piece about some work I did recently to improve the throughput of distributed search. http://www.zinascii.com/2013/solr-distributed-search-and-the-stale-check.html The short of it is that the stale check in Apache's HTTP Client used by SolrJ can add a lot of l

Re: SolrCloud - Query performance degrades with multiple servers

2012-12-06 Thread Ryan Zezeski
There are some gains to be made in Solr's distributed search code. A few weeks about I spent time profiling dist search using dtrace/btrace and found some areas for improvement. I planned on writing up some blog posts and providing patches but I'll list them off now in case others have input. 1)