ch goes
> into depth on the field cache though stops short of discussing how it
> handles eviction. Can anyone confirm if this info is right?
>
> https://lucidworks.com/post/scaling-lucene-and-solr/
>
>
> Also, can anyone speak to how the field cache handles evictions?
>
>
Hi SOLR Community,
Just following up here with an update. I found this article which goes into
depth on the field cache though stops short of discussing how it handles
eviction. Can anyone confirm if this info is right?
https://lucidworks.com/post/scaling-lucene-and-solr/
Also, can anyone
Hi SOLR Community,
I've been trying to understand how the field cache in SOLR manages
its evictions, and it is not easily readable from the code or documentation
the simple question of when and how something gets evicted from the field
cache. This cache also doesn't show hit ratio,
Which are you using? schema.xml of managed-schema? You must be using
one or the other, but not both.
It's likely you're using managed-schema, that's where changes need to be made.
Best,
Erick
On Sun, Sep 2, 2018 at 11:55 AM Bineesh wrote:
>
> Hi Govind,
>
> Thanks for the reply. Pleasee below th
Hi Govind,
Thanks for the reply. Pleasee below the chema.xml and managed.schema
1: schema.xml
int, float, long, date, double, including the "Trie" variants.
2 : managed.schema
- For maximum indexing performance, use the ConcurrentUpdateSolrServer
Please metion the schema definition of date.
If you edit solr schema manually, you need to reload the solr core.
On Sat, Sep 1, 2018 at 3:38 AM kunhu0...@gmail.com
wrote:
> Hello Team,
>
> Need suggestions on Solr Indexing. We are using Solr-6.6.3 and Nutch 1.14.
>
> I se
Hello Team,
Need suggestions on Solr Indexing. We are using Solr-6.6.3 and Nutch 1.14.
I see unknown field 'cache' error while indexing the data to Solr so i added
below entry in field section of schema.xml forsolr
Tried indexing the data again and this time error is unknown f
Yes. Thanks.
On 9/1/16 4:53 AM, Alessandro Benedetti wrote:
Are you looking for this ?
org/apache/solr/core/SolrConfig.java:243
CacheConfig conf = CacheConfig.getConfig(this, "query/fieldValueCache");
if (conf == null) {
Map args = new HashMap<>();
args.put(NAME, "fieldValueCache");
args
Are you looking for this ?
org/apache/solr/core/SolrConfig.java:243
CacheConfig conf = CacheConfig.getConfig(this, "query/fieldValueCache");
if (conf == null) {
Map args = new HashMap<>();
args.put(NAME, "fieldValueCache");
args.put("size", "1");
args.put("initialSize", "10");
args.
But, the configuration is commented out (disabled). As comments section
mentioned
"The fieldValueCache is created by default even if not configured here"
I would like to know what would be the configuration of default
fieldValueCache created.
On 8/31/16 6:37 PM, Zheng Lin Edwin Yeo wrote:
I
If I didn't get your question wrong, what you have listed is already the
default configuration that comes with your version of Solr.
Regards,
Edwin
On 30 August 2016 at 07:49, Rallavagu wrote:
> Solr 5.4.1
>
>
>
>
> Wondering what is the default configuration for "fieldValueCache".
>
Solr 5.4.1
Wondering what is the default configuration for "fieldValueCache".
out with Jetty.
so thinking if I could use docValues with solr/lucene 4.8.x
--
View this message in context:
http://lucene.472066.n3.nabble.com/Disable-or-limit-the-size-of-Lucene-field-cache-tp4198798p4209873.html
Sent from the Solr - User mailing list archive at Nabble.com.
Thank you.. This really helps.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Disable-or-limit-the-size-of-Lucene-field-cache-tp4198798p4199646.html
Sent from the Solr - User mailing list archive at Nabble.com.
D+text:KEYWORD) The problem is that sorting in Lucene
> requires lots of Field Cache and Solr can't handle Field Cache well. The
> Field Cache is getting larger as more queries are executed and is not
> evicted. When the whole memory is filled with Field Cache, Solr server
> stops or ge
ng in Lucene
requires lots of Field Cache and Solr can't handle Field Cache well. The
Field Cache is getting larger as more queries are executed and is not
evicted. When the whole memory is filled with Field Cache, Solr server
stops or generates Out of Memory exception.
Solr cannot control Lu
A new Heliosearch pre-release has been cut for people to try out:
https://github.com/Heliosearch/heliosearch/releases
Release Notes:
-
This is Heliosearch v0.03
Heliosearch is forked from Apache Solr and includ
uses faceting. I might try reducing
> the JVM
> >>>> memory some and amount of perm generation as suggested earlier.
> It feels
> >>>> like a GC issue and loading the cache just happens to be the
> victim of a
> >
ly sort. We provide classified ad
> >>>> searches and that heavily uses faceting. I might try reducing the JVM
> >>>> memory some and amount of perm generation as suggested earlier. It
> feels
> >>>> like a GC issue and loading the cache just happens to be th
y gut instinct is that your heap size is way too high. Try
>>>>> decreasing it to like 5-10G. I know you say it uses more than that,
>>>>> but that just seems bizarre unless you're doing something like
>>>>> faceting and/or sorting on ever
o perform a lot of sorting - on multiple fields in fact. We have
>>>>>> different kinds of Solr configurations - our news searches do little
>>>>>> with regards to faceting, but heavily sort. We provide classified ad
>>>>>> searches and that heavily uses faceti
From: Patrick O'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 11:59 AM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
I've been tracking a problem in our Solr environment for awhile with
periodic stalls of S
ow you say it uses more than that,
> >>> but that just seems bizarre unless you're doing something like
> >>> faceting and/or sorting on every field.
> >>>
> >>> -Michael
> >>>
> >>> -Original Message-
> >>
er. It
>>>> feels
>>>> like a GC issue and loading the cache just happens to be the victim
>>>> of a
>>>> stop-the-world event at the worse possible time.
>>>>
>>>>> My gut instinct is that your heap size is way too high. Try
>&
r sorting on every field.
-Michael
-Original Message-
From: Patrick O'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 11:59 AM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
I've been tracking a problem in
hael
>>>
>>> -Original Message-
>>> From: Patrick O'Lone [mailto:pol...@townnews.com]
>>> Sent: Tuesday, November 26, 2013 11:59 AM
>>> To: solr-user@lucene.apache.org
>>> Subject: Solr 3.6.1 stalling with high CPU and blocking on fie
seems bizarre
unless you're doing something like faceting and/or sorting on every field.
-Michael
-Original Message-
From: Patrick O'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 11:59 AM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU an
:59 AM
> To: solr-user@lucene.apache.org
> Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
>
> I've been tracking a problem in our Solr environment for awhile with periodic
> stalls of Solr 3.6.1. I'm running up to a wall on ideas to try and thought I
>
'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 11:59 AM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
I've been tracking a problem in our Solr environment for awhile with periodic
stalls of Solr 3.6.1. I'm run
snode Slovenia d.o.o.
-Original Message-
From: Patrick O'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 5:59 PM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
I've been tracking a problem in our Solr environment fo
e-
From: Patrick O'Lone [mailto:pol...@townnews.com]
Sent: Tuesday, November 26, 2013 5:59 PM
To: solr-user@lucene.apache.org
Subject: Solr 3.6.1 stalling with high CPU and blocking on field cache
I've been tracking a problem in our Solr environment for awhile with periodic
stalls of S
s way too large (30GB from 40GB) and may
not leave enough memory for mmap operations (MMap appears to be used in
the field cache). Based on active memory utilization in Java, seems like
I might be able to reduce down to 22GB safely - but I'm not sure if that
will help with the CPU issues.
Not a solution for the short term but sounds like a good use case to migrate
to Solr 4.X and use DocValues instead of FieldCache for faceting.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Solr-3-6-optimize-and-field-cache-question-tp4076398p4076822.html
Sent from the
lion and
> bounce both slaves. We have facets on 14 fields. We usually don't run
> optimize after the purge. Will the deleted documents be part of field cache
> if we don't run optimize after purge? Will I see difference in java heap
> memory utilization before and after
I'm 99% sure that the deleted docs will indeed use up space in the field cache,
at least until the segments that those documents are in are merged - that is
what an optimize will do. Of course, these segments will automatically be
merged eventually, but it might take days for this to h
don't run optimize after
the purge. Will the deleted documents be part of field cache if we don't run
optimize after purge? Will I see difference in java heap memory utilization
before and after running optimize? I thought optimize only affects the disk
space.
Thanks!
I am using Solr 4.2.1
./zahoor
On 20-May-2013, at 11:48 AM, J Mohamed Zahoor wrote:
> Hi
>
> I am trying to avoid loading some fields in Lucene's FieldCache.
>
> Is there a way to avoid loading certain failed in Lucene's FieldCache.
> One way is to declare them multivalued..
>
> Is there an
Hi
I am trying to avoid loading some fields in Lucene's FieldCache.
Is there a way to avoid loading certain failed in Lucene's FieldCache.
One way is to declare them multivalued..
Is there any other way?
./zahoor
ge if necessary.
Is there a better way?
2. We need a fast way to fetch x for a large (100s) number of docs.
It'd be great if the doc()/document() methods could automatically use the field
cache - perhaps with something like
https://issues.apache.org/jira/browse/SOLR-1961 . That hasn'
Hi,
I have read lucene field cache is used in faceting and sorting. Is it also
populated/used when only selected fields are retrieved using the 'fl' OR
'included fields in collapse' parameters? Is it also used for collapsing?
--
Regards,
Samarth
eeley > wrote:
>
>> On Sat, Dec 19, 2009 at 2:25 PM, Jay Hill wrote:
>> > One thing that struck me as odd in the output of the stats.jsp page is
>> that
>> > the field cache always shows a String type for a field, even if it is
>> not a
>> > String
n Sat, Dec 19, 2009 at 11:37 AM, Yonik Seeley
wrote:
> On Sat, Dec 19, 2009 at 2:25 PM, Jay Hill wrote:
> > One thing that struck me as odd in the output of the stats.jsp page is
> that
> > the field cache always shows a String type for a field, even if it is not
> a
> >
On Sat, Dec 19, 2009 at 2:25 PM, Jay Hill wrote:
> One thing that struck me as odd in the output of the stats.jsp page is that
> the field cache always shows a String type for a field, even if it is not a
> String. For example, the output below is for a field "cscore" that is
I'm on a project where I'm trying to determine the size of the field cache.
We're seeing lots of memory problems, and I suspect that the field cache is
extremely large, but I'm trying to get exact counts on what's in the field
cache.
One thing that struck me as odd in th
I want to build a FunctionQuery that scores documents based on a multi-valued
field. My intention was to use the field cache, but that doesn't get me
multiple values per document. I saw other posts suggesting UnInvertedField
as the solution. I don't see a method in the UnInvertedField
Have a look at UninvertedField.java. I think that might help.
On Sep 23, 2009, at 2:35 PM, Amit Nithian wrote:
Are there any good implementations of a field cache that will return
all
values of a multivalued field? I am in the process of writing one
for my
immediate needs but I was
Are there any good implementations of a field cache that will return all
values of a multivalued field? I am in the process of writing one for my
immediate needs but I was wondering if if there is a complete implementation
of one that handles the different field types. If not, then I can continue
nfig option is set to true.
>>
>> the easiest way to know whether your faceting is using the FieldCache is
>> to start your server cold (no newSearcher warming) and then send it a
>> simple query with a single facet.field. depending on the query, you
>> might
>&
start your server cold (no newSearcher warming) and then send it a
> simple query with a single facet.field. depending on the query, you might
> get 0 or 1 entries in the filterCache if SimpleFacets is using the
> FieldCache -- but if it's using the TermEnums, and generating a DocSet p
: ..fq=country:france
:
: do these queries share cached items in the fieldcache? (in this example:
: country:france) or do they somehow live as seperate entities in the cache?
: The latter would explain my fieldcache having evictions at the moment.
FieldCache can't have evicitions. it's a reall
say I have the following (partial)
querystring:...&facet=true&facet.field=country
field 'country' is not tokenized, not multi-valued, and not boolean, so the
field-cache approach is used.
Morover, the following (partial) querystring is used as well:
..fq=country:france
do t
51 matches
Mail list logo
