Re: Highlighting large text fields

2021-01-12 Thread Shaun Campbell
Hi David Just reindexed everything and it appears to be performing well and giving me highlights for the matched text. Thanks for your help. Shaun On Tue, 12 Jan 2021, 21:00 David Smiley, wrote: > The last update to highlighting that I think is pertinent to > whether highlights match or not is

Re: Highlighting large text fields

2021-01-12 Thread David Smiley
The last update to highlighting that I think is pertinent to whether highlights match or not is v7.6 which added that hl.weightMatches option. So I recommend upgrading to at least that if you want to experiment further. But... uh.weightMatches highlights more accurately and as such is more likely

Re: Highlighting large text fields

2021-01-12 Thread Shaun Campbell
That's great David. So hl.maxAnalyzedChars isn't that critical. I'll whack it right up and see what happens. I'm running 7.4 from a few years ago. Should I upgrade? For your info this is what I'm doing with Solr https://dev.fundingawards.nihr.ac.uk/search. Thanks Shaun On Tue, 12 Jan 2021 at 1

Re: Highlighting large text fields

2021-01-12 Thread David Smiley
On Tue, Jan 12, 2021 at 1:08 PM Shaun Campbell wrote: > Hi David > > Getting closer now. > > First of all, a bit of a mistake on my part. I have two cores set up and I > was changing the solrconfig.xml on the wrong core doh!! That's why > highlighting wasn't being turned off. > > I think I've go

RE: disallowing delete through security.json

2021-01-12 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
Does anyone yet have any examples or suggestion for using the "method" section in lucene.apache.org/solr/guide/8_4/rule-based-authorization-plugin.html ? Also, if anyone has any other suggestions of how to provide high availability while completely dropping and recreating and reloading a large c

Re: Highlighting large text fields

2021-01-12 Thread Shaun Campbell
Hi David Getting closer now. First of all, a bit of a mistake on my part. I have two cores set up and I was changing the solrconfig.xml on the wrong core doh!! That's why highlighting wasn't being turned off. I think I've got the unified highlighter working. storeOffsetsWithPositions was alread

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Charlie Hull
Hi Jeremy, You might find our recent blog on Debugging Solr Performance Issues useful https://opensourceconnections.com/blog/2021/01/05/a-solr-performance-debugging-toolkit/ - also check out Savan Das' blog which is linked within. Best Charlie On 12/01/2021 14:53, Michael Gibney wrote: Ah

Re: Highlighting large text fields

2021-01-12 Thread David Smiley
On Tue, Jan 12, 2021 at 9:39 AM Shaun Campbell wrote: > Hi David > > First of all I wanted to say I'm working off your book!! Third edition, > and I think it's a bit out of date now. I was just going to try following > the section on the Postings highlighter, but I see that's been absorbed > int

Re: leader election stuck after hosts restarts

2021-01-12 Thread Pierre Salagnac
Sorry I missed this detail. We are running Solr 8.2. Thanks Le mar. 12 janv. 2021 à 16:46, Phill Campbell a écrit : > Which version of Apache Solr? > > > On Jan 12, 2021, at 8:36 AM, Pierre Salagnac > wrote: > > > > Hello, > > We had a stuck leader election for a shard. > > > > We have collecti

Re: leader election stuck after hosts restarts

2021-01-12 Thread Phill Campbell
Which version of Apache Solr? > On Jan 12, 2021, at 8:36 AM, Pierre Salagnac > wrote: > > Hello, > We had a stuck leader election for a shard. > > We have collections with 2 shards, each shard has 5 replicas. We have many > collections but the issue happened for a single shard. Once all host >

Re: leader election stuck after hosts restarts

2021-01-12 Thread matthew sporleder
When this has happened to me before I have had pretty good luck by restarting the overseer leader, which can be found in zookeeper under /overseer_elect/leader If that doesn't work I've had to do more intrusive and manual recovery methods, which suck. On Tue, Jan 12, 2021 at 10:36 AM Pierre Salag

leader election stuck after hosts restarts

2021-01-12 Thread Pierre Salagnac
Hello, We had a stuck leader election for a shard. We have collections with 2 shards, each shard has 5 replicas. We have many collections but the issue happened for a single shard. Once all host restarts completed, this shard was stuck with one replica is "recovery" state and all other is "down" s

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Michael Gibney
Ahh ok. If those are your only fieldType definitions, and most of your config is copied from the default, then SOLR-13336 is unlikely to be the culprit. Looking at more general options, off the top of my head: 1. make sure you haven't allocated all physical memory to heap (leave a decent amount for

Re: Highlighting large text fields

2021-01-12 Thread Shaun Campbell
Hi David First of all I wanted to say I'm working off your book!! Third edition, and I think it's a bit out of date now. I was just going to try following the section on the Postings highlighter, but I see that's been absorbed into the Unified highlighter. I find your book easier to follow than t

Re: Solr using all available CPU and becoming unresponsive

2021-01-12 Thread Jeremy Smith
Thanks Michael, SOLR-13336 seems intriguing. I'm not a solr expert, but I believe these are the relevant sections from our schema definition:

Solr 8.7.0 in Cloud mode with Zookeeper 3.4.5 cdh 5.16

2021-01-12 Thread Subhajit Das
Hi, We are planning to implement Solr Cloud 8.7.0, running in Kubernetes cluster, with external Zookeeper 3.4.5 cdh 5.16. Solr 8.7.0 seems to be matched with Zookeeper 3.6.2. Is there any issue using Zookeeper 3.4.5 cdh 5.16? Thanks in advance. Regards, Subhajit

SOLR 7.5 : java.io.IOException

2021-01-12 Thread Akreeti Agarwal
Classification: Internal Hi, I am using SOLR 7.5 master slave architecture. I am having two slaves connected to master, when load is getting increased then one my slave server CPU spikes 100% and gets terminated. In logs and monitoring I could find "java.io.IOException" coming. Please help me

Question: JavaBinCodec cannot handle BytesRef object

2021-01-12 Thread Boqi Gao
Dear all: We are facing a problem recently when we are utilizing BinaryDocValueField of solr 7.3.1. We have created a binary docValue field. The constructor of BinaryDocValuesField(String name, BytesRef value) needs a BytesRef object to be set as its fieldData. However, the JavaBinCodec cannot

RE: Query over migrating a solr database from 7.7.1 to 8.7.0

2021-01-12 Thread Flowerday, Matthew J
Hi Jim Thanks for getting back to me. I checked the schema.xml that we are using and it has the line you mentioned: And this is the only reference (apart from within a comment) for _root_ In the schema.xml. Does your schema.xml have further references to _root_ that I could nee