Re: Solr and jvm Garbage Collection tuning

2010-09-10 Thread Kent Fitch
rent query volumes on rotating disk without spending a great deal of money. The old newspaper index is running on a SAN with 24 fast disks backing it, and we can't support the same query rate on it as we can with the other newspaper index on SSDs (even before the shingling change). Kent Fitch Trove development team National Library of Australia

Re: Need help with graphing function (MATH)

2012-02-13 Thread Kent Fitch
n((x+5)/38)*42+105 http://www.wolframalpha.com/input/?i=plot++sin%28%28x%2B5%29%2F38%29*42%2B105%2C+x%3D50..175 Regards, Kent Fitch On Tue, Feb 14, 2012 at 12:29 PM, Mark wrote: > I need some help with one of my boost functions. I would like the > function to look something like the foll

Re: Need help with graphing function (MATH)

2012-02-14 Thread Kent Fitch
trick, such as 110 - 50((x-100)/20)/(sqrt(1+((x-100)/20)^2)) http://www.wolframalpha.com/input/?i=plot+110+-+50%28%28x-100%29%2F20%29%2F%28sqrt%281%2B%28%28x-100%29%2F20%29 ^2%29%29%2C+x%3D0..200 Regards Kent Fitch On Wed, Feb 15, 2012 at 6:17 AM, Walter Underwood wrote: > In practice, I expect

Re: high CPU usage and SelectCannelConnector threads used a lot

2010-12-06 Thread Kent Fitch
Hi John, sounds like this bug in NIO: http://jira.codehaus.org/browse/JETTY-937 http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6403933 I think recent versions of jetty work around this bug, or maybe try the non-NIO socket connector Kent On Tue, Dec 7, 2010 at 9:10 AM, John Russell wrote:

best way to cache "base" queries (before application of filters)

2009-05-20 Thread Kent Fitch
SolrIndexSearcher (and organise somehow for SolrIndexSearcher to use that sublass) Or perhaps Im taking the wrong approach to this problem entirely! Any advice is greatly appreciated. Kent Fitch

Re: best way to cache "base" queries (before application of filters)

2009-05-21 Thread Kent Fitch
ilters one by one in our own query component on a scored document list retrieved by SolrIndexSearcher - Im not sure - maybe I havent understood SOLR-1165? Thanks also Walter for your suggestions. Our users have a requirement for the index to be continuously updated (well, every 10 minutes or so), and our queries are extremely diverse/"long tail"ish, so an HTTP cache will probably not help us. Kent Fitch

UnInvertedField performance on faceted fields containing many unique terms

2009-06-15 Thread Kent Fitch
to 134 seconds on reloads after index updates. About 60-70 secs is still spend in GC, but it is a significant improvement. Unless you have very large numbers of facet values, this change won't have any positive benefit. Regards, Kent Fitch

Re: UnInvertedField performance on faceted fields containing many unique terms

2009-06-15 Thread Kent Fitch
t version of 1.4 very soon. > And don't forget to update http://wiki.apache.org/solr/PublicServers > when you go live! We will - thanks for your great work in improving SOLR performance with 1.4 which makes such outrageous uses of facets even thinkable. Regards, Kent Fitch

Re: Facets with an IDF concept

2009-06-23 Thread Kent Fitch
they can "mask" facets from the most relevant results - the authors, years and subjects we have full text for are not representative of the whole corpus) - if a searcher pages through to the 1000th result page, down to these less relevant results, should we somehow include these resul