solr suggester.rebuild takes forever and eventually runs out of memory on production

Dear mailing list community, we have troubles when starting the Suggester-Build on one of our production servers. 1. We execute the required query with the suggest.build parameter 2. It seems solr is taking up the task to recreate the suggester index (we see that the CPU rises sig

AW: solr suggester.rebuild takes forever and eventually runs out of memory on production

Oh, I am sorry, I totally forgot to mention our solr version, it's 7.7.3. -Ursprüngliche Nachricht- Von: Sebastian Riemer [mailto:s.rie...@littera.eu] Gesendet: Freitag, 24. Juli 2020 09:53 An: solr-user@lucene.apache.org Betreff: solr suggester.rebuild takes forever and eventually runs o

RE: tlog keeps growing

I think I've come down to the root cause of this mess in our case. Everything is confirming that the TLOG state is "BUFFERING" rather than "ACTIVE". 1/ This can be seen with the metrics API as well where we observe: "TLOG.replay.remaining.bytes":48997506, "TLOG.replay.remaining.logs":1, "TLOG.sta

Re: JsonLayout breaks logging?

You should explicitly provide the jackson dependencies: jackson-core, jackson-databind and/or jackson-annotations. On Fri, Jul 24, 2020 at 8:24 AM t spam wrote: > Hi, > > I'm having difficulty configuring JsonLayout for appenders. I have the > following in my log4j2.xml: > > > > > > >

Re: JsonLayout breaks logging?

Hi Naz, Could you give me some directions in where or how I should provide these dependencies? I can see these dependencies are already in various places by default: [tijmen@solr-1 solr-7.7.3]$ find . -name jackson* ./contrib/clustering/lib/jackson-annotations-2.9.8.jar ./contrib/clustering/lib/j

Re: tlog keeps growing

Gaël: Many thanks for your writeup. I preserved your and Carlos’ comments in a JIRA: https://issues.apache.org/jira/browse/SOLR-14679. How fast you bring the nodes up and down shouldn’t really matter, but if pausing between bouncing nodes when doing a rolling upgrade keeps you from having oper

Re: How to measure search performance

Oh, call it a brain fart on my part. docValues have nothing to with pseudo-fields, sorry for the confusion. If function queries are used for _scoring_, then they must be docValues but that’s not the case here since you’re just dealing with pseudo fields. As far as whether edismax adds work, not

Re: Replication of Solr Model and feature store

Hi Krishan, Could you share what version of Solr you are using? And I wonder if the observed behaviour could be reproduced e.g. with the techproducts example, changes not applying after reload [1] sounds like a bug if so. Hope that helps. Regards, Christine [1] https://lucene.apache.org/so

Re: Cybersecurity Incident Report

docker pull solr:8.4.1-slim docker run -it --rm solr:8.4.1-slim /bin/bash solr@223042112be5:/opt/solr-8.4.1$ find ./ -name "*jackson*" ./server/solr-webapp/webapp/WEB-INF/lib/jackson-core-2.10.0.jar ./server/solr-webapp/webapp/WEB-INF/lib/jackson-annotations-2.10.0.jar ./server/solr-webapp/webapp

Re: solr suggester.rebuild takes forever and eventually runs out of memory on production

Hi Sebastian, I saw similar undesirable results with the standard SuggestComponent when we upgraded multiple Solr versions. For our index of 2.8M docs, it takes 6-7 minutes to build a suggestion index using SuggestComponent out of the box, so I wouldn't be surprised if your 7.2M doc index takes a g

Loading JSON docs into Solr with Streaming Expressions?

Hey all, I wanted to load some JSON docs into Solr and as I load them, do some manipulations to the documents as they go in. I looked at https://lucene.apache.org/solr/guide/8_6/transforming-and-indexing-custom-json.html

Re: Loading JSON docs into Solr with Streaming Expressions?

It's probably time to add JSON loading support to streaming expressions, but nothing yet. This ticket is almost done and paves the way for a suite of parseXYZ functions: https://issues.apache.org/jira/browse/SOLR-14673 Joel Bernstein http://joelsolr.blogspot.com/ On Fri, Jul 24, 2020 at 1:00

Re: Cybersecurity Incident Report

On 7/24/2020 2:35 PM, Man with No Name wrote: This version of jackson is pulled in as a shadow jar. Also solr is using io.netty version 4.1.29.Final which has critical vulnerabilities which are fixed in 4.1.44. It looks like that shaded jackson library is included in the jar for htrace. I lo

bin/solr auth enable

When I issue “bin/solr auth enable -prompt true -blockUnknown true”, I get a Null Pointer Exception. I’m using the 8.5.1 release. Am I doing something wrong? Thanks. Sent from my iPhone