Again depending on the version of Solr, but the metrics end point (added in 6.4) has a TON of information. Be prepared to wade through it for half a day to find out the things you need ;). There are something like 150 different metrics returned…
Frankly I don’t remember if cache RAM usage is one of them, but that’s what grep was made for ;) Best, Erick > On Feb 18, 2020, at 2:53 AM, Hongxu Ma <inte...@outlook.com> wrote: > > @Vadim Ivanov<mailto:vadim.iva...@spb.ntk-intourist.ru> > > Thank you! > ________________________________ > From: Vadim Ivanov <vadim.iva...@spb.ntk-intourist.ru> > Sent: Tuesday, February 18, 2020 15:27 > To: solr-user@lucene.apache.org <solr-user@lucene.apache.org> > Subject: RE: A question about solr filter cache > > Hi! > Yes, it may depends on Solr version > Solr 8.3 Admin filterCache page stats looks like: > > stats: > CACHE.searcher.filterCache.cleanupThread:false > CACHE.searcher.filterCache.cumulative_evictions:0 > CACHE.searcher.filterCache.cumulative_hitratio:0.94 > CACHE.searcher.filterCache.cumulative_hits:198 > CACHE.searcher.filterCache.cumulative_idleEvictions:0 > CACHE.searcher.filterCache.cumulative_inserts:12 > CACHE.searcher.filterCache.cumulative_lookups:210 > CACHE.searcher.filterCache.evictions:0 > CACHE.searcher.filterCache.hitratio:1 > CACHE.searcher.filterCache.hits:84 > CACHE.searcher.filterCache.idleEvictions:0 > CACHE.searcher.filterCache.inserts:0 > CACHE.searcher.filterCache.lookups:84 > CACHE.searcher.filterCache.maxRamMB:-1 > CACHE.searcher.filterCache.ramBytesUsed:70768 > CACHE.searcher.filterCache.size:12 > CACHE.searcher.filterCache.warmupTime:1 > >> -----Original Message----- >> From: Hongxu Ma [mailto:inte...@outlook.com] >> Sent: Tuesday, February 18, 2020 5:32 AM >> To: solr-user@lucene.apache.org >> Subject: Re: A question about solr filter cache >> >> @Erick Erickson<mailto:erickerick...@gmail.com> and @Mikhail Khludnev >> >> got it, the explanation is very clear. >> >> Thank you for your help. >> ________________________________ >> From: Hongxu Ma <inte...@outlook.com> >> Sent: Tuesday, February 18, 2020 10:22 >> To: Vadim Ivanov <vadim.iva...@spb.ntk-intourist.ru>; solr- >> u...@lucene.apache.org <solr-user@lucene.apache.org> >> Subject: Re: A question about solr filter cache >> >> Thank you @Vadim Ivanov<mailto:vadim.iva...@spb.ntk-intourist.ru> >> I know that admin page, but I cannot find the memory usage of filter cache >> (only has "CACHE.searcher.filterCache.size", I think it's the used slot > number >> of filtercache) >> >> There is my output (solr version 7.3.1): >> >> filterCache >> >> * >> >> class: >> org.apache.solr.search.FastLRUCache >> * >> >> description: >> Concurrent LRU Cache(maxSize=512, initialSize=512, minSize=460, >> acceptableSize=486, cleanupThread=false) >> * stats: >> * >> >> CACHE.searcher.filterCache.cumulative_evictions: >> 0 >> * >> >> CACHE.searcher.filterCache.cumulative_hitratio: >> 0.5 >> * >> >> CACHE.searcher.filterCache.cumulative_hits: >> 1 >> * >> >> CACHE.searcher.filterCache.cumulative_inserts: >> 1 >> * >> >> CACHE.searcher.filterCache.cumulative_lookups: >> 2 >> * >> >> CACHE.searcher.filterCache.evictions: >> 0 >> * >> >> CACHE.searcher.filterCache.hitratio: >> 0.5 >> * >> >> CACHE.searcher.filterCache.hits: >> 1 >> * >> >> CACHE.searcher.filterCache.inserts: >> 1 >> * >> >> CACHE.searcher.filterCache.lookups: >> 2 >> * >> >> CACHE.searcher.filterCache.size: >> 1 >> * >> >> CACHE.searcher.filterCache.warmupTime: >> 0 >> >> >> >> ________________________________ >> From: Vadim Ivanov <vadim.iva...@spb.ntk-intourist.ru> >> Sent: Monday, February 17, 2020 17:51 >> To: solr-user@lucene.apache.org <solr-user@lucene.apache.org> >> Subject: RE: A question about solr filter cache >> >> You can easily check amount of RAM used by core filterCache in Admin UI: >> Choose core - Plugins/Stats - Cache - filterCache It shows useful > information >> on configuration, statistics and current RAM usage by filter cache, as > well as >> some examples of current filtercaches in RAM Core, for ex, with 10 mln > docs >> uses 1.3 MB of Ram for every filterCache >> >> >>> -----Original Message----- >>> From: Hongxu Ma [mailto:inte...@outlook.com] >>> Sent: Monday, February 17, 2020 12:13 PM >>> To: solr-user@lucene.apache.org >>> Subject: A question about solr filter cache >>> >>> Hi >>> I want to know the internal of solr filter cache, especially its >>> memory >> usage. >>> >>> I googled some pages: >>> https://teaspoon-consulting.com/articles/solr-cache-tuning.html >>> https://lucene.472066.n3.nabble.com/Solr-Filter-Cache-Size-td4120912.h >>> tml >>> (Erick Erickson's answer) >>> >>> All of them said its structure is: fq => a bitmap (total doc number >>> bits), >> but I >>> think it's not so simple, reason: >>> Given total doc number is 1 billion, each filter cache entry will use >> nearly >>> 1GB(1000000000/8 bit), it's too big and very easy to make solr OOM (I >>> have >> a >>> 1 billion doc cluster, looks it works well) >>> >>> And I also checked solr node, but cannot find the details (only saw >>> using DocSets structure) >>> >>> So far, I guess: >>> >>> * degenerate into an doc id array/list when the bitmap is sparse >>> * using some compressed bitmap, e.g. roaring bitmaps >>> >>> which one is correct? or another answer, thanks you very much! >> > >
