Re: 7.3.1: Query of death - all nodes ran out of memory and had to be shut down

2018-08-21 Thread Ere Maijala
Hi, Just my short comment here. It's difficult to say for someone else, but we identified deep paging as the definite reason for running out of memory or at least grinding to semi-halt because of long stop-the-world garbage collection pauses in an application running on a similar SolrCloud. Y

Questions on optimizing RptWithGeometrySpatialField

2018-08-21 Thread Benoît Denis
Hello, I am indexing WKT polygons on a RptWithGeometrySpatialField defined as follows: I am currently experimenting on tuning the values of distErrPct and maxDistErr. >From my experiments, increasing the value of distErrPct from the default 0.15 >to 0.5 greatly increases indexing speed (5 tim

Re: Solr unable to start up after setting up SSL in Solr 7.4.0

2018-08-21 Thread Jan Høydahl
Hi, Now, the zkcli.bat error may in fact be a real bug, perhaps caused by SOLR-7887. I think you should file that one in a JIRA. As a workaround you may attempt using the equivalent (from memory): bin/solr zk upconfig -c collection1 -d /path/to/conf -z localhost:2181 -- Jan Høydahl, search solu

Re: 7.3.1: Query of death - all nodes ran out of memory and had to be shut down

2018-08-21 Thread Jan Høydahl
The solution is to move to cursors, but you may as a safety net try to apply the RequestSanitizerComponent to disallow large offsets, see https://github.com/cominvent/request-sanitizer-component -- Jan Høydahl, search solution architect

SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Ganesh Kumar J
Hi Team, We have an ejb application and deployment in weblogic cluster where the application uses SOLRJ java client to communicate with SOLR. Previously we were using solrj 5.4 and it was working fine. Recently we enabled kerberos in our cluster so we forced to upgrade

Re: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Jan Høydahl
Hi, I don't know what version of Weblogic and Java you use, but note that Solr, even SolrJ 7.x requires Java 8, while 5.x required Java 7. There seems to be several discussion on stackoverflow and elsewhere about similar issues: https://stackoverflow.com/questions/19152655/java-lang-arrayindexo

RE: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Ganesh Kumar J
Hi Jan Høydahl, Thank you so much for your reply. Unfortunately our production weblogic cluster runs in java 1.7 we are unable to upgrade to java 1.8 In this case do you have any idea how we can use solrj version below 7.x which can authenticate with kerberozied solr

Re: Solr unable to start up after setting up SSL in Solr 7.4.0

2018-08-21 Thread Shawn Heisey
On 8/20/2018 9:57 PM, Zheng Lin Edwin Yeo wrote: This is the error that I get: ERROR StatusLogger Unable to access file:/C:/Users/edwin/Desktop/edwin/solr- 7.4.0/server/scripts/cloud-scripts/file:C:/Users/edwin/Desktop/edwin/solr-7. 4.0/server/scripts/cloud-scripts/log4j2.xml java.io.FileNotFou

Re: SOLRJ 7.x library fails ejb deployment with weblogic

2018-08-21 Thread Shawn Heisey
On 8/21/2018 7:29 AM, Ganesh Kumar J wrote: Thank you so much for your reply. Unfortunately our production weblogic cluster runs in java 1.7 we are unable to upgrade to java 1.8 In this case do you have any idea how we can use solrj version below 7.x which can authenticate with kerberozied sol

Haystack, the search relevance conference comes to London on October 2nd 2018

2018-08-21 Thread Charlie Hull
Hi all, We're very happy to announce the first Haystack Europe conference in London on October 2nd. https://opensourceconnections.com/events/haystack-europe-2018/ Come and hear talks by Doug Turnbull, co-author of Relevant Search, Karen Renshaw, Head of Search and Content for Grainger Global

Re: Dataimport not working on solrcloud

2018-08-21 Thread Shawn Heisey
On 8/20/2018 10:00 PM, Sushant Vengurlekar wrote: I have a dataimport working on standalone solr instance but the same doesn't work on solrcloud. I keep on hitting this error Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.solr.handler.dataimport.DataImportH

Re: Handshake for NRT?

2018-08-21 Thread Walter Underwood
Thanks, that is exactly what I was curious about. All our updates are single documents. We need to track the availability of online tutors, so we don’t batch them. Right now, we have a replication factor of 36 (way too many), so that means each update means 3 x 35 internal communications. Basica

Re: Handshake for NRT?

2018-08-21 Thread Erick Erickson
A couple of notes: TLOG replicas will have the same issue. When I said that leaders forwarded to followers, what that's really about is that the follower guarantees that the docs have been written to the TLOG. So if you change your model to use TLOG replicas, don't expect a change. PULL replicas,

Re: Handshake for NRT?

2018-08-21 Thread Walter Underwood
The updates are fairly frequent (a few per minute) and have a tight freshness requirement. We really don’t want to show tutors who are not available. Luckily, it is a smallish collection, a few hundred thousand. The traffic isn’t a problem and the cluster is working very well. This is about unde

Re: 7.3.1: Query of death - all nodes ran out of memory and had to be shut down

2018-08-21 Thread Erick Erickson
bq. I meant to ask whether there is a high probability that that could be the correlated cause for the issue. Yes, I do tend to be pedantic on occasion, a personal failing ;) bq. Do you know why Solr itself isn't able to recover or is that to be expected with allowing such deep pagination. The

not range query in block join

2018-08-21 Thread Novin Novin
Hi Guys, I was try to do block join query with "not". I got not success, can anybody please help me out here. This works q=+_query_:"{!parent which=type_s:parent} +time_tdt:[2018-08-01T16:00:00Z TO 2018-08-04T15:59:59Z]" This works q=-time_tdt:[2018-08-01T16:00:00Z TO 2018-08-04T15:59:59Z] Thi

Re: not range query in block join

2018-08-21 Thread Erick Erickson
pure not queries are spottily supported and can work (or not) depending on where they're used, they often need to be translated from -some_clause to *:* -some_clause Solr/Lucene do not implement pure boolean logic, which often throws people. See: https://lucidworks.com/2011/12/28/why-not-and-or-

Re: 7.3.1: Query of death - all nodes ran out of memory and had to be shut down

2018-08-21 Thread Shawn Heisey
On 8/20/2018 9:55 PM, Ash Ramesh wrote: We ran a bunch of deep paginated queries (offset of 1,000,000) with a filter query. We set the timeout to 5 seconds and it did timeout. We aren't sure if this is what caused the irrecoverable failure, but by reading this - https://lucene.apache.org/solr/gui

Index Upgrader tool

2018-08-21 Thread Artjoms Laivins
Hello, We are running Solr cloud with 3 nodes v. 6.6.2 We started with version 5 so we have some old index that we need safely move over to v. 7 now. New data comes in several times per day. Our questions are: Should we run IndexUpgrader tool on one slave node that is down or it is safe to run

SOLR Issue

2018-08-21 Thread Sandesh Ingawale
Hi, We have ecommerce base web application and we used SOLR for search. Now we want to implement SOLR authentication and SOLR ranking feature with our application. We need to do this programmatically(C#), can you please suggest what should be approach we have? OR If you have any code snippets ple

Re: SOLR Issue

2018-08-21 Thread Shawn Heisey
On 8/21/2018 8:05 AM, Sandesh Ingawale wrote: We have ecommerce base web application and we used SOLR for search. Now we want to implement SOLR authentication and SOLR ranking feature with our application. We need to do this programmatically(C#), can you please suggest what should be approac

Re: Index Upgrader tool

2018-08-21 Thread Shawn Heisey
On 8/21/2018 2:29 AM, Artjoms Laivins wrote: We are running Solr cloud with 3 nodes v. 6.6.2 We started with version 5 so we have some old index that we need safely move over to v. 7 now. New data comes in several times per day. Our questions are: Should we run IndexUpgrader tool on one slave n

Atomic Update Failure With solr.UUID Field

2018-08-21 Thread Stephen Lewis Bianamara
Hello SOLR Community, I'm prototyping a collection on SOLR 6.6.3 with UUID fields, and I'm hitting some trouble with atomic updates. At a high level, here's the problem: suppose you have a schema with an optional field of type solr.UUID field, and a document with a value for that field. Any atomic

Re: Solr unable to start up after setting up SSL in Solr 7.4.0

2018-08-21 Thread Zheng Lin Edwin Yeo
Ok noted. Thank you. Regards, Edwin On Tue, 21 Aug 2018 at 21:40, Shawn Heisey wrote: > On 8/20/2018 9:57 PM, Zheng Lin Edwin Yeo wrote: > > This is the error that I get: > > ERROR StatusLogger Unable to access > file:/C:/Users/edwin/Desktop/edwin/solr- > > > 7.4.0/server/scripts/cloud-scripts/