Re: documentCache clarification

2010-10-29 Thread Yonik Seeley
On Fri, Oct 29, 2010 at 4:21 PM, Chris Hostetter wrote: > > : > Why don't we just include the start & rows (modulo the window size) in > : > the cache key? > : > : The implementation of equals() would be rather difficult... actually > : impossible w/o abusing the semantics. > : It would also be im

Re: documentCache clarification

2010-10-29 Thread Chris Hostetter
: > Why don't we just include the start & rows (modulo the window size) in : > the cache key? : : The implementation of equals() would be rather difficult... actually : impossible w/o abusing the semantics. : It would also be impossible w/o the Map implementation guaranteeing : what object was on

Re: documentCache clarification

2010-10-29 Thread Yonik Seeley
On Fri, Oct 29, 2010 at 3:49 PM, Chris Hostetter wrote: > > : This is a limitation in the SolrCache API. > : The key into the cache does not contain rows, so the cache returns the > : first 10 docs and increments it's hit count.  Then the cache user > : (SolrIndexSearcher) looks at the entry and d

Re: documentCache clarification

2010-10-29 Thread Chris Hostetter
: This is a limitation in the SolrCache API. : The key into the cache does not contain rows, so the cache returns the : first 10 docs and increments it's hit count. Then the cache user : (SolrIndexSearcher) looks at the entry and determines it can't use it. Wow, I never realized that. Why don't

Re: documentCache clarification

2010-10-29 Thread Yonik Seeley
On Fri, Oct 29, 2010 at 2:31 PM, Jay Luker wrote: > This makes sense but still doesn't explain what I'm seeing in my cache > stats. When I issue a request with rows=10 the stats show an insert > into the queryResultCache. If I send the same query, this time with > rows=1000, I would not expect to

Re: documentCache clarification

2010-10-29 Thread Jay Luker
On Thu, Oct 28, 2010 at 7:27 PM, Chris Hostetter wrote: > The queryResultCache is keyed on and the > value is a "DocList" object ... > > http://lucene.apache.org/solr/api/org/apache/solr/search/DocList.html > > Unlike the Document objects in the documentCache, the DocLists in the > queryResultCa

RE: documentCache clarification

2010-10-28 Thread Jonathan Rochkind
-user@lucene.apache.org Subject: Re: documentCache clarification : the documentCache: "(Note: This cache cannot be used as a source for : autowarming because document IDs will change when anything in the : index changes so they can't be used by a new searcher.)" : : Can anyone elaborate a bit o

Re: documentCache clarification

2010-10-28 Thread Chris Hostetter
: the documentCache: "(Note: This cache cannot be used as a source for : autowarming because document IDs will change when anything in the : index changes so they can't be used by a new searcher.)" : : Can anyone elaborate a bit on that. I think I've read it at least 10 : times and I'm still unab

Re: documentCache clarification

2010-10-28 Thread Jay Luker
On Wed, Oct 27, 2010 at 9:13 PM, Chris Hostetter wrote: > > : schema.) My evidence for this is the documentCache stats reported by > : solr/admin. If I request "rows=10&fl=id" followed by > : "rows=10&fl=id,title" I would expect to see the 2nd request result in > : a 2nd insert to the cache, but i

Re: documentCache clarification

2010-10-27 Thread Chris Hostetter
: schema.) My evidence for this is the documentCache stats reported by : solr/admin. If I request "rows=10&fl=id" followed by : "rows=10&fl=id,title" I would expect to see the 2nd request result in : a 2nd insert to the cache, but instead I see that the 2nd request hits : the cache from the 1st re

Re: documentCache clarification

2010-10-27 Thread Koji Sekiguchi
(10/10/28 6:32), Jonathan Rochkind wrote: Woah, I hadn't known about that. queryResultMaxDocsCached is actually a part of Solr 1.4? Is it documented anywhere at all? I guess it is included in the example solrconfig.xml, but is not in my own personal solrconfig.xml. The feature was added since

Re: documentCache clarification

2010-10-27 Thread Jonathan Rochkind
Woah, I hadn't known about that. queryResultMaxDocsCached is actually a part of Solr 1.4? Is it documented anywhere at all? I guess it is included in the example solrconfig.xml, but is not in my own personal solrconfig.xml. Anyone know if it has a default size if left unspecified? Shawn He

Re: documentCache clarification

2010-10-27 Thread Shawn Heisey
On 10/27/2010 12:17 PM, Jay Luker wrote: A 2nd question: while watching these stats I noticed something else weird with the queryResultCache. It seems that inserts to the queryResultCache depend on the number of rows requested. For example, an initial request (solr restarted, clean cache, etc) wi

Re: documentCache clarification

2010-10-27 Thread Jay Luker
(btw, I'm running 1.4.1) It looks like my assumption was wrong. Regardless of the fields selected using the "fl" parameter and the enableLazyFieldLoading setting, solr apparently fetches from disk and caches all the fields in the document (or maybe just those that are stored="true" in my schema.)

Re: documentCache clarification

2010-10-27 Thread Markus Jelsma
I've been wondering about this too some time ago. I've found more information in SOLR-52 and some correspondence on this one but it didn't give me a definitive answer.. [1]: https://issues.apache.org/jira/browse/SOLR-52 [2]: http://www.mail-archive.com/solr-...@lucene.apache.org/msg01185.html O