Re: Fetch parent and child document in solr 8.2

2019-11-19 Thread Mikhail Khludnev
There are some changes in nested docs, a kind of named scopes, or so. The query you provided violated of one of the block join principles. There should be caveat panel regarding this in the doc. On Fri, Nov 15, 2019 at 9:46 PM Gajjar, Jigar wrote: > Hello, > > > > I am trying to fetch parent and

Re: Changing the IP or a SOLR or Zookeeper host

2019-11-19 Thread Houston Putman
If you are changing the IP of a host running Zookeeper, it can be an issue. It depends on the version of zookeeper that you are using. There was an issue with ZK not re-resolving IP addresses on connection errors, but it was fixed in 3.4.13 ( https://issues.apache.org/jira/plugins/servlet/mobile#is

RE: async BACKUP under Solr8.3

2019-11-19 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
In some collections I am having problems with Solr8.1.1 through 8.3; with other collections it is fine in Solr8.1.1 through 8.3 I'm investigating what might be wrong with the collections which have the problems. Thanks -Original Message- From: Oakley, Craig (NIH/NLM/NCBI) [C] Sent: T

Changing the IP or a SOLR or Zookeeper host

2019-11-19 Thread dshih
If a SOLR or Zookeeper host is replaced such that the hostname comes back but it now resolves to a different IP, are SOLR nodes and SOLRJ clients expected to just continue working? I know that in this case replicas need to be re-created (and stale ones deleted). But I'm wondering if SOLRJ clien

Re: Fetch parent and child document in solr 8.2

2019-11-19 Thread Gajjar, Jigar
Can anyone please answer my question. Let me know if I am going in wrong direction. Thanks, Jigar Gajjar OCLC · Senior Software Engineer 6565 Kilgour Place, Dublin, OH, USA, 43017 M +1-408-334-6379 [OCLC] OCLC.org

Re: Updates blocked in Tlog solr cloud?

2019-11-19 Thread Wei
Hi Erick, I observed that the update request rate dropped from 20 per sec to 3 per sec for about 8 minutes. After that there is a huge burst of updates. This looks quite match the queue up behavior you mentioned. But I don't think the time out took that long. Is there a configurable setting for th

Re: How do I add my own Streaming Expressions?

2019-11-19 Thread Eric Pugh
The documentation in the StreamHandler suggests adding into Solrconfig some streamFunctions: * * org.apache.solr.client.solrj.io.stream.ReducerStream * org.apache.solr.client.solrj.io.stream.RecordCountStream * https://github.com/apache/lucene-solr/blob/master/solr/co

exact matches on a join

2019-11-19 Thread rhys J
I am trying to do a join, which I have working properly on 2 cores. One core has report_as, and the other core has debt_id. If I enter 'report_as: "Freeman", I expect to get 272 results. But I get 557. When I do a database search on the matched fields, it shows me that report_as: "Freeman" is ma

Re: 2 Async exceptions during distributed update issue...

2019-11-19 Thread Erick Erickson
First, please don’t use the “schemaless” mode (add-unknown-fields-to-schema in your solrconfig) while load testing. There’s quite a bit of work being done when Solr discovers an unknown field that’ll cause some instability under heavy load. Second, when you put a large batch against Solr, you h

2 Async exceptions during distributed update issue...

2019-11-19 Thread Fiz N
Hello Solr Experts, Just wanted to follow up in case my question.Would appreciate help on this. SOLR Version : 6.6.2 OS – Linux 3.1.2 JDK – 1.8 Shard – 16 – All are active. Xms – 16 gb Xmx – 16 gb Host has 64 cores. the update processor chain.attaching the complete updateRequestPro

Re: Upgrade solr from 7.2.1 to 8.2

2019-11-19 Thread Rahul Goswami
Hello, Just wanted to follow up in case my question fell through the cracks :) Would appreciate help on this. Thanks, Rahul On Fri, Nov 15, 2019 at 5:32 PM Rahul Goswami wrote: > Hello, > > We are planning to upgrade our SolrCloud cluster from 7.2.1 (hosted on > Windows server) to 8.2. > I rea

Metrics avgRequestsPerSecond and avgRequestsPerSecond from documentation gone?

2019-11-19 Thread Koen De Groote
Greetings, I'm using Solr 7.6 and have enabled JMX metrics. I ran into this page: https://lucene.apache.org/solr/guide/7_6/performance-statistics-reference.html#commonly-used-stats-for-request-handlers Which mentions "avgRequestsPerSecond" and "avgTimePerRequest" and some other attributes, which

Re: Explicit documentation regarding all JMX metrics?

2019-11-19 Thread Koen De Groote
Thanks. I also just now found https://lucene.apache.org/solr/guide/7_6/metrics-reporting.html I'm currently sticking to version 7.6 I've enabled JMX metrics and am accessing them via JmxTerm. There are indeed a lot, though filtering by key=value is easy enough. That being said, finding out what

Re: Zk upconfig command is appending local directory to default confdir

2019-11-19 Thread Walter Underwood
I found the zk uploading stuff to be under-documented. Plus, it requires installing Solr on the deployment machine. So I used the Python kazoo package and wrote my own uploader. wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) > On Nov 19, 2019, at 5:42 A

Possible synchronization bug in Solr reader

2019-11-19 Thread Bram Biesbrouck
Hi all, I think I might have discovered a synchronization bug when ingesting a lot of data into Solr, but want to check with the specialists first ;-) I'm using a little custom written map/reduce framework that boots a 20-something threads to do some heavy processing on data-preparation. When thi

RE: async BACKUP under Solr8.3

2019-11-19 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
FYI, I DO succeed in doing an async backup in Solr8.1 -Original Message- From: Oakley, Craig (NIH/NLM/NCBI) [C] Sent: Tuesday, November 19, 2019 9:03 AM To: solr-user@lucene.apache.org Subject: RE: async BACKUP under Solr8.3 This is on a test server: simple case: one node, one shard, on

RE: async BACKUP under Solr8.3

2019-11-19 Thread Oakley, Craig (NIH/NLM/NCBI) [C]
This is on a test server: simple case: one node, one shard, one replica In production we currently use Solr7.4 and the async BACKUP works fine. I could test whether I get the same symptoms on Solr8.1 and/or 8.2 Thanks -Original Message- From: Mikhail Khludnev Sent: Tuesday, November 1

Re: Updates blocked in Tlog solr cloud?

2019-11-19 Thread Erick Erickson
How long are updates blocked and how did the tlog replica on the bad hardware go down? Solr has to wait for an ack back from the tlog follower to be certain that the follower has all the documents in case it has to switch to that replica to become the leader. If the update to the follower times

Possible data corruption in JavaBinCodec in Solr 8.3 during distributed update?

2019-11-19 Thread Colvin Cowie
Hello Apologies for the lack of actual detail in this, we're still digging into it ourselves. I will provide more detail, and maybe some logs, once I have a better idea of what is actually happening. But I thought I might as well ask if anyone knows of changes that were made in the Solr 8.3 releas

Re: Use of TLog

2019-11-19 Thread Erick Erickson
There’s also the Collections API MOVEREPLICA command that does this all as a single command. > On Nov 19, 2019, at 5:21 AM, Sripra deep wrote: > > Got it, Thanks for helping me Emir. > > On Tue, Nov 19, 2019 at 12:36 PM Emir Arnautović < > emir.arnauto...@sematext.com> wrote: > >> Hi, >> Copy

RE: How to implement NOTIN operator with Solr

2019-11-19 Thread Raboah, Avi
It's working!!! thanks a lot :) -Original Message- From: Emir Arnautović [mailto:emir.arnauto...@sematext.com] Sent: Tuesday, November 19, 2019 2:54 PM To: solr-user@lucene.apache.org Subject: Re: How to implement NOTIN operator with Solr Right - didn’t read all your examples. In that cas

Re: Need to recreate collection when version-2 folder deleted in zookeeper

2019-11-19 Thread Erick Erickson
Almost certainly. You can recreate all the “state.json” znodes “by hand”, but that’ll be very, very difficult to get right. It’s possible you have ZK snapshot laying around you can restore, you’ll have to look. Best, Erick > On Nov 19, 2019, at 6:33 AM, vishal patel > wrote: > > I have cre

Re: Zk upconfig command is appending local directory to default confdir

2019-11-19 Thread Erick Erickson
And to make it more complicated, if you don’t have a version that has the CONFIGSET API, you can use bin/solr zk upconfig/downconfig… Best, Erick > On Nov 19, 2019, at 8:18 AM, Jörn Franke wrote: > > You can call it via curl and it is no more complicated then zk- in the long > run you will be

Re: Explicit documentation regarding all JMX metrics?

2019-11-19 Thread Erick Erickson
Here’s something that might be useful: https://support.lucidworks.com/s/article/What-should-you-monitor What version of Solr? For Solr 6.4+, you may want to use the /admin/metrics endpoint, see the reference guide for metrics. WARNING: there are a ton of metrics. The ref guide has information on

Explicit documentation regarding all JMX metrics?

2019-11-19 Thread Koen De Groote
Greetings, I've enabled JMX metrics on an install of mine and am going through the available beans. I've google for an explanation of what the beans all mean, but I'm coming up empty. For instance, these: :category=ADMIN,...,name=clientErrors,scope=/admin/file :category=ADMIN,...,name=clientErr

Re: Zk upconfig command is appending local directory to default confdir

2019-11-19 Thread Jörn Franke
You can call it via curl and it is no more complicated then zk- in the long run you will be happier > Am 19.11.2019 um 13:27 schrieb Michael Becker : > > Jörn, > > We're using Solr to index a website. Basically, we set up Solr and Zookeeper > once and let it run. The API is a bit too much ov

Re: How to implement NOTIN operator with Solr

2019-11-19 Thread Emir Arnautović
Right - didn’t read all your examples. In that case you can use span queries. In this case complexphrase query parser should do the trick: {!complexphrase df=text}”credit -card” Regards, Emir -- Monitoring - Log Management - Alerting - Anomaly Detection Solr & Elasticsearch Consulting Support Tra

RE: Zk upconfig command is appending local directory to default confdir

2019-11-19 Thread Michael Becker
Jörn, We're using Solr to index a website. Basically, we set up Solr and Zookeeper once and let it run. The API is a bit too much overhead for something we just set once. Mike -Original Message- From: Jörn Franke Sent: Tuesday, November 19, 2019 2:54 AM To: solr-user@lucene.apache.or

RE: Zk upconfig command is appending local directory to default confdir

2019-11-19 Thread Michael Becker
Domimique: That's what is odd. There IS a file named solrconfig.xml within that directory. The naming convention for the directory is the same in all three environments where we have Solr running. The command works fine in the other two environments. But for some reason, in this environment, So

Re: Solr 8.3.0

2019-11-19 Thread vishal patel
My autoAddReplicas is false. Is it necessary to change? Also, the replication factor is 1. Need to update? Regards, Vishal Sent from Outlook From: Erick Erickson Sent: Monday, November 18, 2019 9:47 PM To: solr-user@lucene.apache.org S

Need to recreate collection when version-2 folder deleted in zookeeper

2019-11-19 Thread vishal patel
I have created 2 shards of Solr 8.3.0. After I have created 10 collections and also re-indexed data. Some fields are changed in one collection. I deleted a version-2 folder from zoo_data and up config that collection. Is it necessary to create all collections again? Also indexing data again? R

Re: How to implement NOTIN operator with Solr

2019-11-19 Thread Alexandre Rafalovitch
I think the main question here is the compound word "credit card" always the same? If yes, you can preprocess it during indexing to something unique and discard (see Vincenzo's reply). You could even copyfield and process the copy to only leave standalone word "credit" in it, so it basically serves

Re: Use of TLog

2019-11-19 Thread Sripra deep
Got it, Thanks for helping me Emir. On Tue, Nov 19, 2019 at 12:36 PM Emir Arnautović < emir.arnauto...@sematext.com> wrote: > Hi, > Copying indices will work and it is a fine approach. An alternative would > be to join new node to a cluster, use add replica to copy cores to this new > node and th

RE: How to implement NOTIN operator with Solr

2019-11-19 Thread Raboah, Avi
In that case I got only doc1 -Original Message- From: Emir Arnautović [mailto:emir.arnauto...@sematext.com] Sent: Tuesday, November 19, 2019 11:51 AM To: solr-user@lucene.apache.org Subject: Re: How to implement NOTIN operator with Solr Hi Avi, There are span queries, but in this case you

RE: Active directory integration in Solr

2019-11-19 Thread Kommu, Vinodh K.
Thanks Charlie. We are already using Basic authentication in our existing clusters, however it's getting difficult to maintain number of users as we are getting too many requests for readonly access from support teams. So we desperately looking for active directory solution. Just wondering if s

NPE For Atomic Update on Solr 8.3

2019-11-19 Thread sayan.das
On upgrading to solr 8.3 also I am facing the same issue as SOLR-13523. I have added these on my schema Document present in solr: [{ "id": "parent1", "isInStock": 1, "parent": true, "_childDocuments_": [ { "id": "child 1", "isInStock": 0,

Re: How to implement NOTIN operator with Solr

2019-11-19 Thread Emir Arnautović
Hi Avi, There are span queries, but in this case you don’t need it. It is enough to simply filter out documents that are with “credit card”. Your query can be something like +text:credit -text:”credit card” If you prefer using boolean operators, you can write it as: text:credit AND NOT text: “cre

Re: How to implement NOTIN operator with Solr

2019-11-19 Thread Vincenzo D'Amore
This is a tricky problem, you’re trying to handle the meani using the words. A simple solution could be apply a synonym filter that convert “credit card” in two terms: “creditcard” and “card”. In this way searching credit will not match any term. Ciao, Vincenzo -- mobile: 3498513251 skype: fre

How to implement NOTIN operator with Solr

2019-11-19 Thread Raboah, Avi
I am trying to find the documents which hit this example: q=text:"credit" NOTIN "credit card" for that query I want to get all the documents which contain the term "credit" but not as part of the phrase "credit card". so: 1. I don't want to get the documents which include just "credit card

Re: Active directory integration in Solr

2019-11-19 Thread Charlie Hull
Not out of the box, there are a few authentication plugins bundled but not for AD https://lucene.apache.org/solr/guide/7_2/authentication-and-authorization-plugins.html - there's also some useful stuff in Apache ManifoldCF https://www.francelabs.com/blog/tutorial-on-authorizations-for-manifold-