Should say -- Can anyone confirm if it's right *still*, since the article
is 10 years old :)
On Fri, Mar 5, 2021 at 10:36 AM Stephen Lewis Bianamara <
stephen.bianam...@gmail.com> wrote:
> Hi SOLR Community,
>
> Just following up here with an update. I found this article which goes
> into depth o
Hi SOLR Community,
Just following up here with an update. I found this article which goes into
depth on the field cache though stops short of discussing how it handles
eviction. Can anyone confirm if this info is right?
https://lucidworks.com/post/scaling-lucene-and-solr/
Also, can anyone speak
Hi SOLR Community,
I've been trying to understand how the field cache in SOLR manages
its evictions, and it is not easily readable from the code or documentation
the simple question of when and how something gets evicted from the field
cache. This cache also doesn't show hit ratio, total hits, evi
On Fri, Oct 3, 2014 at 6:38 PM, Peter Keegan wrote:
>> it will be cached as hidden:true and then inverted
> Inverted at query time, so for best query performance use fq=hidden:false,
> right?
Yep.
-Yonik
http://heliosearch.org - native code faceting, facet functions,
sub-facets, off-heap data
d 'hidden', and less than 1% of the
> > documents in the index have hidden=true.
> > Do both these filter queries use the same docset cache size? :
> > fq=hidden:false
> > fq=!hidden:true
>
> Nope... !hidden:true will be smaller in the cache (it will be cache
hidden=true.
>>> Do both these filter queries use the same docset cache size? :
>>> fq=hidden:false
>>> fq=!hidden:true
>>
>> Nope... !hidden:true will be smaller in the cache (it will be cached
>> as hidden:true and then inverted)
>> The downside
On 10/3/2014 1:57 PM, Yonik Seeley wrote:
> On Fri, Oct 3, 2014 at 3:42 PM, Peter Keegan wrote:
>> Say I have a boolean field named 'hidden', and less than 1% of the
>> documents in the index have hidden=true.
>> Do both these filter queries use the same docset c
On Fri, Oct 3, 2014 at 3:42 PM, Peter Keegan wrote:
> Say I have a boolean field named 'hidden', and less than 1% of the
> documents in the index have hidden=true.
> Do both these filter queries use the same docset cache size? :
> fq=hidden:false
> fq=!hidden:true
Nop
Say I have a boolean field named 'hidden', and less than 1% of the
documents in the index have hidden=true.
Do both these filter queries use the same docset cache size? :
fq=hidden:false
fq=!hidden:true
Peter
What Erick said. That's a giant Filter Cache. Have a look at these Solr
metrics and note the Filter Cache in the middle:
http://www.flickr.com/photos/otis/8409088080/
Note how small the cache is and how high the hit rate is. Those are stats
for http://search-lucene.com/ and http://search-hadoop
This, BTW, is an ENORMOUS number cached queries.
Here's a rough guide:
Each entry will be (length of query) + maxDoc/8 bytes long.
Think of the filterCache as a map where the key is the query
and the value is a bitmap large enough to hold maxDoc bits.
BTW, I'd kick this back to the default (512?
How can we calculate how much heap memory the filter cache will consume? We
understand that in order to determine a good size we also need to evaluate
how many filterqueries would be used over a certain time period.
Here's our setting:
According to the post below, 53 GB of RAM would b
s for http://search-lucene.com/ for
example:
https://apps.sematext.com/spm-reports/s.do?k=eDcirzHG7i
Otis
Solr & ElasticSearch Support
http://sematext.com/
On May 2, 2013 5:14 PM, "Furkan KAMACI" wrote:
> I read that at wiki:
>
> Sometimes a smaller cache size
I read that at wiki:
Sometimes a smaller cache size will help avoid full garbage collections at
the cost of more evictions. Load testing should be used to help determine
proper cache sizes throughout the searching/indexing lifecycle.
Could anybody give me an example scenario of how can I make a
guration.
> >
> > If I want to calculate cache size in memory relativly to cache size in
> > solrconfig.xml
> >
> > For Document cache
> >
> > size in memory = size in solrconfig.xml * average size of all fields
> > defined in fl parameter ???
>
See below:
On Thu, Dec 1, 2011 at 10:57 AM, elisabeth benoit
wrote:
> Hello,
>
> If anybody can help, I'd like to confirm a few things about Solr's caches
> configuration.
>
> If I want to calculate cache size in memory relativly to cache size in
> solrconfig.xml
> For Filter cache
>
> size in memory = size in solrconfig.xml * WHAT (the size of an id) ???
> (I
> don't use facet.enum method)
>
As I understand it, size is the number queries that will be cached. My short
experience means that the memory consumed will be data dep
Hello,
If anybody can help, I'd like to confirm a few things about Solr's caches
configuration.
If I want to calculate cache size in memory relativly to cache size in
solrconfig.xml
For Document cache
size in memory = size in solrconfig.xml * average size of all fields
defined in fl
You can dump the heap and analyze it with a tool like jhat. IBM's heap
analyzer is also a very good tool and if i'm not mistaken people also use one
that comes with Eclipse.
On Tuesday 08 February 2011 16:35:35 Mehdi Ben Haj Abbes wrote:
> Hi folks,
>
> Is there any way to know the size *in byt
Hi folks,
Is there any way to know the size *in bytes* occupied by a cache (filter
cache, doc cache ...)? I don't find such information within the stats page.
Regards
--
Mehdi BEN HAJ ABBES
: please help - how can I calculate queryresultcache size (how much RAM should
: be dedicated for that). I have 1,5 index size, 4 mio docs.
: QueryResultWindowSize is 20.
: Could I use "expire" property on the documents in this cache?
There is no "expire" property, items are automaticly removed f
Hi all!
please help - how can I calculate queryresultcache size (how much RAM should
be dedicated for that). I have 1,5 index size, 4 mio docs.
QueryResultWindowSize is 20.
Could I use "expire" property on the documents in this cache?
regards,
Stanislaw
quite small, usually under 10k. I
> currently have a document cache size of about 15,000, and am warming up 5,000
> with a query after each indexing. Autocommit is set at 30 seconds, and my
> caches are warming up easily in just a couple of seconds. I've read of
> concerns regarding
I am trying to tune my Solr setup so that the caches are well warmed after the
index is updated. My documents are quite small, usually under 10k. I currently
have a document cache size of about 15,000, and am warming up 5,000 with a
query after each indexing. Autocommit is set at 30 seconds
On Mon, Dec 14, 2009 at 7:17 PM, kalidoss <
kalidoss.muthuramalin...@sifycorp.com> wrote:
> Hi,
>
> We have enabled the query result cache, its 512 entries,
>
> we have calculated the size used for cache :
> page size about 1000bytes, (1000*512)/1024/1024 = .48MB
>
>
The query result ca
Hi,
We have enabled the query result cache, its 512 entries,
we have calculated the size used for cache :
page size about 1000bytes, (1000*512)/1024/1024 = .48MB
If we increase the cache count to 10 then the memory used for
cache about. (1000*10)/1024/1024 = 96MB
On Jan 28, 2008, at 6:05 PM, Alex Benjamen wrote:
I need some clarification on the cache size parameters in the
solrconfig. Suppose I'm using these values:
A lot of this is here: http://wiki.apache.org/solr/SolrCaching
I need some clarification on the cache size parameters in the solrconfig.
Suppose I'm using these values:
What does size="5" mean... Is this 5 bytes, kilobytes, megabytes... or
is it the number of documents
that can be cached?
In other words, how do I calculate t
: > I know this is a lot and I'm going to decrease it, I was just experimenting,
: > but I need some guidelines of how to calculate the right size of the cache.
:
: Each filter that matches more than ~3000 documents will occupy maxDocs/8 bytes
: of memory. Certain kinds of faceting require one en
On 16-Jan-08, at 11:15 AM, [EMAIL PROTECTED] wrote:
I'm using Tomcat. I set Max Size = 5Gb and I checked in profiler
that it's actually uses whole memory. There is no significant
memory use by other applications.
Whole change was I increased the size of cache to:
LRU Cache(maxSize=1048576, i
e.org
Sent: Wednesday, January 16, 2008 10:48:50 AM
Subject: Re: Cache size and Heap size
Hi Gene.
Have you set your app server / servlet container to use allocate some of
this memory to be used?
You can define the maximum and minimum heap size adding/replacing some
parameters on the app
Hi Gene.
Have you set your app server / servlet container to use allocate some of
this memory to be used?
You can define the maximum and minimum heap size adding/replacing some
parameters on the app server initialization:
-Xmx1536m -Xms1536m
Which app server / servlet container are you using?
Hello,..
I have relatively large RAM (10Gb) on my server which is running Solr. I
increased Cache settings and start to see OutOfMemory exceptions, specially on
facet search.
Is anybody has some suggestions how Cache settings related to Memory
consumptions? What are optimal settings? How they c
33 matches
Mail list logo
