Re: Throughput Optimization

2008-12-04 Thread Yonik Seeley
because you didn't want to change that variable just now? >> >> -Yonik >> > > -- > View this message in context: > http://www.nabble.com/Throughput-Optimization-tp20335132p20840668.html > Sent from the Solr - User mailing list archive at Nabble.com. > >

Re: Throughput Optimization

2008-12-04 Thread wojtekpia
t; > new faceting stuff off because it didn't improve things in your case, > or because you didn't want to change that variable just now? > > -Yonik > -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20840668.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Throughput Optimization

2008-12-04 Thread Yonik Seeley
know if it improves your >> scenario. >> >> -Yonik >> > > -- > View this message in context: > http://www.nabble.com/Throughput-Optimization-tp20335132p20840017.html > Sent from the Solr - User mailing list archive at Nabble.com. > >

Re: Throughput Optimization

2008-12-04 Thread wojtekpia
Let us know if it improves your > scenario. > > -Yonik > -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20840017.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Throughput Optimization

2008-11-07 Thread Yonik Seeley
FYI, SOLR-465 has been committed. Let us know if it improves your scenario. -Yonik On Wed, Nov 5, 2008 at 5:39 PM, Yonik Seeley <[EMAIL PROTECTED]> wrote: > On Wed, Nov 5, 2008 at 5:18 PM, wojtekpia <[EMAIL PROTECTED]> wrote: >> I'd like to integrate this improvement into my deployment. Is it ju

Re: Throughput Optimization

2008-11-05 Thread Yonik Seeley
On Wed, Nov 5, 2008 at 5:18 PM, wojtekpia <[EMAIL PROTECTED]> wrote: > I'd like to integrate this improvement into my deployment. Is it just a > matter of getting the latest Lucene jars (Lucene nightly build)? You need to apply this source code patch to Solr: https://issues.apache.org/jira/browse/

Re: Throughput Optimization

2008-11-05 Thread wojtekpia
ecently improved in Lucene > for non-Windows boxes, and we're integrating that into Solr (should > def be in the next release). > > -Yonik > > -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20349247.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Throughput Optimization

2008-11-05 Thread Yonik Seeley
On Wed, Nov 5, 2008 at 2:44 PM, wojtekpia <[EMAIL PROTECTED]> wrote: > I'll try changing my other caches to LRUCache and observe performance. > Interestingly, the FastLRUCache has given me a ~10% increase in performance, > much lower than I've read on the SOLR-667 thread. That's better than I woul

Re: Throughput Optimization

2008-11-05 Thread Yonik Seeley
On Wed, Nov 5, 2008 at 2:29 PM, Feak, Todd <[EMAIL PROTECTED]> wrote: > Yonik said something about the FastLRUCache giving the most gain for > high hit-rates and the LRUCache being faster for low hit-rates. Right, for single-threaded requests. FastLRUCache has faster gets and slower puts (on aver

RE: Throughput Optimization

2008-11-05 Thread wojtekpia
your user base? I realize this probably > isn't part of your bottleneck, just curious. > -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20348749.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Throughput Optimization

2008-11-05 Thread Feak, Todd
curious. -Todd Feak -Original Message- From: wojtekpia [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 05, 2008 11:08 AM To: solr-user@lucene.apache.org Subject: RE: Throughput Optimization My documentCache hit rate is ~.7, and my queryCache is ~.03. I'm using FastLRUCache on al

RE: Throughput Optimization

2008-11-05 Thread wojtekpia
iginal Message- > From: wojtekpia [mailto:[EMAIL PROTECTED] > Sent: Wednesday, November 05, 2008 8:15 AM > To: solr-user@lucene.apache.org > Subject: Re: Throughput Optimization > > > Yes, I am seeing evictions. I've tried setting my filterCache higher, > but > then I

Re: Throughput Optimization

2008-11-05 Thread wojtekpia
ctory patch uses It. > > - Mark > > -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20345965.html Sent from the Solr - User mailing list archive at Nabble.com.

RE: Throughput Optimization

2008-11-05 Thread Feak, Todd
What are your other cache hit rates looking like? Which caches are you using the FastLRUCache on? -Todd Feak -Original Message- From: wojtekpia [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 05, 2008 8:15 AM To: solr-user@lucene.apache.org Subject: Re: Throughput Optimization Yes

Re: Throughput Optimization

2008-11-05 Thread Yonik Seeley
On Wed, Nov 5, 2008 at 11:14 AM, wojtekpia <[EMAIL PROTECTED]> wrote: > Yes, I am seeing evictions. I've tried setting my filterCache higher, but > then I start getting Out Of Memory exceptions. My filterCache hit ratio is > > .99. It looks like I've hit a RAM bound here. Evictions on the filterCa

RE: Throughput Optimization

2008-11-05 Thread Feak, Todd
o:[EMAIL PROTECTED] Sent: Wednesday, November 05, 2008 8:15 AM To: solr-user@lucene.apache.org Subject: Re: Throughput Optimization Yes, I am seeing evictions. I've tried setting my filterCache higher, but then I start getting Out Of Memory exceptions. My filterCache hit ratio is > .99. It

Re: Throughput Optimization

2008-11-05 Thread christophe
? 2. Why does CPU utilization fall when I make more than 8 concurrent requests? 3. Is there an obvious bottleneck that I'm missing? 4. Does Tomcat have any settings that affect Solr performance? Any input is greatly appreciated. -- View this message in context: http://www.nabble.com/Th

Re: Throughput Optimization

2008-11-05 Thread wojtekpia
f requests I could make per >> second >> didn't increase). This makes no sense to me, unless there is another >> bottle >> neck somewhere. >> 3. Reduced the number of records in my index. The throughput >> increased, but >> the shape of all my graphs

Re: Throughput Optimization

2008-11-05 Thread Mark Miller
The latest alt directory patch uses It. - Mark On Nov 5, 2008, at 9:25 AM, "Yonik Seeley" <[EMAIL PROTECTED]> wrote: You're probably hitting some contention with the locking around the reading of index files... this has been recently improved in Lucene for non-Windows boxes, and we're integra

Re: Throughput Optimization

2008-11-05 Thread Yonik Seeley
You're probably hitting some contention with the locking around the reading of index files... this has been recently improved in Lucene for non-Windows boxes, and we're integrating that into Solr (should def be in the next release). -Yonik On Tue, Nov 4, 2008 at 9:01 PM, wojtekpia <[EMAIL PROTECT

Re: Throughput Optimization

2008-11-05 Thread Erik Hatcher
e an obvious bottleneck that I'm missing? 4. Does Tomcat have any settings that affect Solr performance? Any input is greatly appreciated. -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20335132.html Sent from the Solr - User mailing list archive at Nabble.com.

Throughput Optimization

2008-11-04 Thread wojtekpia
? 3. Is there an obvious bottleneck that I'm missing? 4. Does Tomcat have any settings that affect Solr performance? Any input is greatly appreciated. -- View this message in context: http://www.nabble.com/Throughput-Optimization-tp20335132p20335132.html Sent from the Solr - User mailing list archive at Nabble.com.