Re: More Like This and Caching

2013-05-10 Thread Giammarco Schisani
Hi David, Jason and Otis, Thank you for the feedback on the question. It is very much appreciated. To confirm what caches are being used, I will remove on of the Solr servers from the cluster, restart it, note the status of the various Solr caches, issue some MLT queries to it, and compare the st

Re: More Like This and Caching

2013-05-09 Thread Otis Gospodnetic
This is correct, doc cache for previously read docs regardless of which query read them and query cache for repeat query. Plus OS cache for actual index files. Otis Solr & ElasticSearch Support http://sematext.com/ On May 9, 2013 2:32 PM, "Jason Hellman" wrote: > Purely from empirical observati

Re: More Like This and Caching

2013-05-09 Thread Jason Hellman
Purely from empirical observation, both the DocumentCache and QueryResultCache are being populated and reused in reloads of a simple MLT search. You can see in the cache inserts how much extra-curricular activity is happening to populate the MLT data by how many inserts and lookups occur on the

RE: More Like This and Caching

2013-05-09 Thread David Parks
I'm not the expert here, but perhaps what you're noticing is actually the OS's disk cache. The actual solr index isn't cached by solr, but as you read the blocks off disk the OS disk cache probably did cache those blocks for you. On the 2nd run the index blocks were read out of memory. There was a