RE: CloudSolrClient (any version). Find the node your query has connected to.

2019-05-30 Thread Russell Taylor
Hi Erick/Shawn, I went for the deleteById option but still under heavy load on my test machine I still see issues with the nodes going into recovery. I've also noticed in my testing that the leader changed and one node was down for a period before going into recovery. The two errors I see in th

Field ByteArrayUtf8CharSequence instead of String

2019-05-30 Thread Markus Jelsma
Hello, When upgrading to 7.7 i got SOLR-13249, when a SolrInputField's value suddenly became ByteArrayUtf8CharSequence instead of a String. That has been addressed. I am now upgrading to 8.1.1 and have a SearchComponent that operates on uses SolrClient to fetch documents from elsewhere on-the-f

Solr 7.6.0 - won't elect leader

2019-05-30 Thread Joe Obernberger
Hi All - I have a 40 node cluster that has been running great for a long while, but it all came down due to OOM.  I adjusted the parameters and restarted, but one shard with 3 replicas (all NRT) will not elect a leader.  I see messages like: 2019-05-30 12:35:30.597 INFO  (zkCallback-7-thread-3

Solr 8.1.1, JMX and VisualVM

2019-05-30 Thread Markus Jelsma
Hello, While upgrading from 7.7 to 8.1.1, i noticed start.jar and SolrCLI no longer pop up in the local applications view of VisualVM! I CTRL-F'ed my way through the changelog for Solr 8.0.0 to 8.1.1 but could not find anything related. I am clueless! Using OpenJDK 11.0.3 2019-04-16 and Solr 8

Re: Solr 7.6.0 - won't elect leader

2019-05-30 Thread Joe Obernberger
More info - looks like a zookeeper node got deleted somehow. NoNode for /collections/UNCLASS_30DAYS/leaders/shard31/leader I then made that node using solr zk mkroot, and now I get the error: :org.apache.solr.common.SolrException: Error getting leader from zk for shard shard31     at org.apach

RE: Solr 8.1.1, JMX and VisualVM

2019-05-30 Thread Markus Jelsma
Hello, Slight correction, SolrCLI does become visible in the local applications view. I just missed it before. Thanks, Markus -Original message- > From:Markus Jelsma > Sent: Thursday 30th May 2019 14:47 > To: solr-user > Subject: Solr 8.1.1, JMX and VisualVM > > Hello, > > While up

Re: Solr 7.6.0 - won't elect leader

2019-05-30 Thread Walter Underwood
We had a 6.6.2 prod cluster get into a state like this. It did not have an overseer, so any command just sat in the overseer queue. After I figured that out, I could see a bunch of queued stuff in the tree view under /overseer. That included an ADDROLE command to set an overseer. Sigh. Fixed it

Re: Solr 7.6.0 - won't elect leader

2019-05-30 Thread Joe Obernberger
Thank you Walter.  I ended up dropping the collection.  We have two primary collections - one is all the data (100 shards, no replicas), and one is 30 days of data (40 shards, 3 replicas each).  We hardly ever have any issues with the collection with no replicas.  I tried bringing down the node

Edit rights to apache solr wiki

2019-05-30 Thread Тони Петров
Hello, Could you please add me to the ContributorsGroup list as per https://wiki.apache.org/solr/FrontPage I'd like to contribute to the apache solr wiki. My wiki login name is ToniPetrovpetr Thank you Toni

Re: Solr 8.1.1, JMX and VisualVM

2019-05-30 Thread Andrzej Białecki
Hi, This has to do with the new JVM flags that optimise performance, they were added roughly at the same time when Solr switched to G1GC. In ‘bin/solr’ please comment out this flag: '-XX:+PerfDisableSharedMem'. > On 30 May 2019, at 14:59, Markus Jelsma wrote: > > Hello, > > Slight correction

RE: Query of Death Lucene/Solr 7.6

2019-05-30 Thread Markus Jelsma
Hello, When upgrading to 8.1.1 i took some time to quickly test this problem. Good news, is has disappeared, for me at least. I immediately reproduce it on a local 7.7 node, it died immediately. But it runs smoothly on the production 7.5, and local 8.1.1 node! The problem still exists in 8.0.0.

RE: Solr 8.1.1, JMX and VisualVM

2019-05-30 Thread Markus Jelsma
Hello, It solves the problem! So, with this flag disabled, would that mean our Solr would have lower performance than with it? Thanks Andrzej! Markus -Original message- > From:Andrzej Białecki > Sent: Thursday 30th May 2019 17:35 > To: solr-user@lucene.apache.org > Subject: Re: Solr 8

Re: Query of Death Lucene/Solr 7.6

2019-05-30 Thread Michael Gibney
Very likely: https://issues.apache.org/jira/browse/SOLR-13336 Individual queries should still fail, but should fail fast, without the broader impact seen prior to 8.1. Does that describe the behavior you're seeing now with 8.1.1? Michael On Thu, May 30, 2019 at 11:55 AM Markus Jelsma wrote: > > H

Re: Solr 8.1.1, JMX and VisualVM

2019-05-30 Thread Shawn Heisey
On 5/30/2019 9:58 AM, Markus Jelsma wrote: Hello, It solves the problem! So, with this flag disabled, would that mean our Solr would have lower performance than with it? That flag ended up in the config because I was using it in my GC experiments, and my wiki page appears to have been used a

CDCR Monitoring

2019-05-30 Thread Natarajan, Rajeswari
Hi, Is there a way to monitor the replication delay between Primary/Secondary Cluster for CDCR and raise alerts ,if it exceeds above some threshold. I see below API’s for monitoring. · core/cdcr?action=QUEUES: Fetches statistics about the queue

Boosting using Range

2019-05-30 Thread sachin gk
Hi All, I am trying to boost solr documents using the range attribute as mentioned below. price_range: 10 25 is it possible, if so how to form a query. -- Regards, Sachin

Re: alias read access impossible for anyone other than admin?

2019-05-30 Thread Aroop Ganguly
Thanks Jason. We are awaiting the 7.7.2 release. I will send out a note describing how the documentation is easy to mess-up. Maybe this is worth writing a blog for folks like yourselves who are experts in this :) > On May 28, 2019, at 4:31 AM, Jason Gerlowski wrote: > > Hey Aroop, > > The

Re: Boosting using Range

2019-05-30 Thread Erik Hatcher
The simplest given your example, with edismax add &boost=price:[10 TO 25] Or you literally have a price_range field?&boost=price_range:10_25 (assuming that's how you indexed it). What type of field is price_range? What did you index into it? Erik > On May 30, 2019, at 1:24 PM,

Newbie permissions problem running solr

2019-05-30 Thread Bernard T. Higonnet
Hello, I have installed solr from ports under FreeBSD 12.0 and I am trying to run solr as described in the Solr Quick Start tutorial. I keep getting permission errors: /usr/local/solr/example/cloud/node2/solr/../logs could not be created. Exiting Apart from the fact that I find it bizarre

Re: Newbie permissions problem running solr

2019-05-30 Thread Joe Doupnik
On 30/05/2019 20:04, Bernard T. Higonnet wrote: Hello, I have installed solr from ports under FreeBSD 12.0 and I am trying to run solr as described in the Solr Quick Start tutorial. I keep getting permission errors: /usr/local/solr/example/cloud/node2/solr/../logs  could not be created. Exi

Re: Newbie permissions problem running solr

2019-05-30 Thread Alexandre Rafalovitch
It is a Unix ".." - as in parent directory. So the path would be: /usr/local/solr/example/cloud/node2/logs And I am guessing you have installed Solr with one user and are trying to use it with another. So, maybe a sudo is required. Or maybe you could just download a fresh Solr install, unzip it a

Re: Newbie permissions problem running solr

2019-05-30 Thread Shawn Heisey
On 5/30/2019 1:04 PM, Bernard T. Higonnet wrote: I have installed solr from ports under FreeBSD 12.0 and I am trying to run solr as described in the Solr Quick Start tutorial. I keep getting permission errors: /usr/local/solr/example/cloud/node2/solr/../logs  could not be created. Exiting T

Re: Newbie permissions problem running solr

2019-05-30 Thread Joe Doupnik
    One day I will learn to type. In the meanwhile the command, as root, is  chown -R solr:users solr. That means creating that username if it is not present.     Thanks,     Joe D. On 30/05/2019 20:12, Joe Doupnik wrote: On 30/05/2019 20:04, Bernard T. Higonnet wrote: Hello, I have installe

Re: Newbie permissions problem running solr

2019-05-30 Thread Terry Steichen
For what it's worth - after not using it for some time, I just started up my solr system (6.6.0) and made a mistake in the command line.  I mistakenly used 'bin/solr start -c -m 1gb' and got precisely the same error message as Bernard did (other than the '.." part).  When I changed it to the corre

Solr query with long query

2019-05-30 Thread Venkateswarlu Bommineni
Hello Team, I have got a requirement to send many strings (~1500) in the filter query param to the solr. Can you please provide any suggestions/precautions we need to take care in this particular scenario. Thanks, Venkat.

Re: Solr query with long query

2019-05-30 Thread Alexandre Rafalovitch
You can use POST instead of GET. But you may also want to see if you can refactor those 1500 strings somehow. If you don't use it already, maybe Terms query parser could be useful: https://lucene.apache.org/solr/guide/7_7/other-parsers.html#terms-query-parser Also, if at least some of those numb

Re: Solr query with long query

2019-05-30 Thread Shawn Heisey
On 5/30/2019 2:20 PM, Venkateswarlu Bommineni wrote: I have got a requirement to send many strings (~1500) in the filter query param to the solr. Can you please provide any suggestions/precautions we need to take care in this particular scenario. You'll probably want to send that as a POST, wh

Re: Solr query with long query

2019-05-30 Thread Venkateswarlu Bommineni
Thank you guys for quick response. I was able to query solr by sending 1500 products using solrJ with http post method. But I had to change maxBooleanClauses to 4096 from default 1024. But I wanted to check with you guys that, will there be any performance issues by changing maxBooleanClauses to

Re: Solr query with long query

2019-05-30 Thread Shawn Heisey
On 5/30/2019 4:13 PM, Venkateswarlu Bommineni wrote: Thank you guys for quick response. I was able to query solr by sending 1500 products using solrJ with http post method. But I had to change maxBooleanClauses to 4096 from default 1024. But I wanted to check with you guys that, will there be

Empty rows from /export?

2019-05-30 Thread Walter Underwood
3/4 of the documents I’m getting back from /export are empty. This collection has four shards, so I’m querying the leader core on each shard with /export. The results start like this: {"numFound":912370,"docs":[{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{},{}, The final 1/4

Re: Solr query with long query

2019-05-30 Thread Tim Casey
Venkat, There is another way to do this. If you have a category of "thing" you are attempting to filter over, then you create a query and tag the documents with this category. So, create a 'categories' field and append 'thing' to the field updating the field if need be. (Be wary of over generat

Re: Solr query with long query

2019-05-30 Thread Erick Erickson
What version of Solr? Recent versions automatically use terms query parser for large, simple or clauses. Do look into using it anyway. And I'd set cache=false because I doubt you'll ever get a cache hit... On Thu, May 30, 2019, 16:21 Venkateswarlu Bommineni wrote: > Hello Team, > > I have got a

Re: Empty rows from /export?

2019-05-30 Thread Erick Erickson
This is odd. The only reason I know of that would happen is if there were no docValues for that field in those documents. By any chance were docValues added to an existing index without totally reindexing into a new collection? What happens if you just query the collection rather than the indivi

Re: Empty rows from /export?

2019-05-30 Thread Walter Underwood
That field was changed to docValues, but I optimized all the cores, which should rewrite every segment as docValues. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On May 30, 2019, at 7:37 PM, Erick Erickson wrote: > > This is odd. The only reason I

Re: Solr query with long query

2019-05-30 Thread Venkateswarlu Bommineni
Tim/Eric, @Tim : We do have category field in existing solr configuration. So the existing functionality is we will query based on category and get the results from solr and display them on PCAT. But as per new requirement , we need to invoke third party service to fetch the personalized products

Re: Boosting using Range

2019-05-30 Thread sachin gk
Hi Erik, We have indexed it as a double and has individual value Eg Price_Range: 10. On Thu, 30 May 2019 at 23:34, Erik Hatcher wrote: > The simplest given your example, with edismax add &boost=price:[10 TO 25] > > Or you literally have a price_range field?&boost=price_range:10_25 > (assumi