Re: A question about solr filter cache

2020-02-18 Thread Erick Erickson
uary 18, 2020 15:27 > To: solr-user@lucene.apache.org > Subject: RE: A question about solr filter cache > > Hi! > Yes, it may depends on Solr version > Solr 8.3 Admin filterCache page stats looks like: > > stats: > CACHE.searcher.filterCache.cleanupThread:

Re: A question about solr filter cache

2020-02-17 Thread Hongxu Ma
@Vadim Ivanov<mailto:vadim.iva...@spb.ntk-intourist.ru> Thank you! From: Vadim Ivanov Sent: Tuesday, February 18, 2020 15:27 To: solr-user@lucene.apache.org Subject: RE: A question about solr filter cache Hi! Yes, it may depends on Solr version Solr 8.3

RE: A question about solr filter cache

2020-02-17 Thread Vadim Ivanov
o:inte...@outlook.com] > Sent: Tuesday, February 18, 2020 5:32 AM > To: solr-user@lucene.apache.org > Subject: Re: A question about solr filter cache > > @Erick Erickson<mailto:erickerick...@gmail.com> and @Mikhail Khludnev > > got it, the explanation is very cl

Re: A question about solr filter cache

2020-02-17 Thread Hongxu Ma
Sent: Monday, February 17, 2020 17:51 To: solr-user@lucene.apache.org Subject: RE: A question about solr filter cache You can easily check amount of RAM used by core filterCache in Admin UI: Choose core - Plugins/Stats - Cache - filterCache It shows useful information on configuration, statisti

Re: A question about solr filter cache

2020-02-17 Thread Hongxu Ma
0 17:51 To: solr-user@lucene.apache.org Subject: RE: A question about solr filter cache You can easily check amount of RAM used by core filterCache in Admin UI: Choose core - Plugins/Stats - Cache - filterCache It shows useful information on configuration, statistics and current RAM usage by fil

Re: A question about solr filter cache

2020-02-17 Thread Erick Erickson
That’s the upper limit of a filter cache entry (maxDoc/8). For low numbers of hits, more space-efficient structures are used. Specifically a list of doc IDs is kept. So say you have an fq clause that marks 10 doc. The filterCache entry is closer to 40 bytes + sizeof(query object) etc. Still, it

RE: A question about solr filter cache

2020-02-17 Thread Vadim Ivanov
You can easily check amount of RAM used by core filterCache in Admin UI: Choose core - Plugins/Stats - Cache - filterCache It shows useful information on configuration, statistics and current RAM usage by filter cache, as well as some examples of current filtercaches in RAM Core, for ex, with 10 ml

Re: A question about solr filter cache

2020-02-17 Thread Mikhail Khludnev
Hello, The former https://github.com/apache/lucene-solr/blob/188f620208012ba1d726b743c5934abf01988d57/solr/core/src/java/org/apache/solr/search/DocSetCollector.java#L84 More efficient sets (roaring and/or elias-fano, iirc) present in Lucene, but not yet being used in Solr. On Mon, Feb 17, 2020 at

Re: A question about solr filter cache

2020-02-17 Thread Nicolas Franck
If 1GB would make solr go out of memory by using a filter query cache, then it would have already happened during the initial upload of the solr documents. Imagine the amount of memory you need for one billion documents.. A filter cache would be the least of your problems. 1GB is small in comparis