Re: SolrCloud keeps crashing

2021-02-03 Thread TK Solr
Oops, I should have referenced this document rather: https://www.tenable.com/cve/CVE-2019-17558 On 2/3/21 2:42 PM, TK Solr wrote: Victor & Satish, Is your Solr accessible from the Internet by anyone? If so, your site is being attacked by a bot us

Re: SolrCloud keeps crashing

2021-02-03 Thread TK Solr
Victor & Satish, Is your Solr accessible from the Internet by anyone? If so, your site is being attacked by a bot using this security hole: https://www.tenable.com/blog/cve-2019-17558-apache-solr-vulnerable-to-remote-code-execution-zero-day-vulnerability If that is the case, try blocking the

Re: SolrCloud keeps crashing

2021-02-01 Thread Satish Silveri
I am facing the same issue. Did u find any solution for this? -- Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html

How to change the JVM Threads of SolrCloud

2021-01-21 Thread Issei Nishigata
Hello All, I'm running SolrCloud(1 shard,9 replicas) on Amazon EKS. The other day, when I accidentally stopped CoreDNS of EKS, the entire Solr cluster went down due to the inability to resolve names of each node. I restarted CoreDNS shortly afterwards, but the Solr node just repeated dow

Re: Solrcloud - Reads on specific nodes

2021-01-18 Thread Shawn Heisey
eader. If you want SolrCloud to emulate the old master/slave paradigm, my recommendation would be to create two TLOG replicas per shard and make the rest PULL. Then use shards.preference on queries to prefer PULL replicas. The PULL replicas can never become leader, so you can be sure that they

Re: Solrcloud - Reads on specific nodes

2021-01-17 Thread Doss
for writes and 6 nodes for selects? > > > > 2. We have a SOLR cloud setup for our customer facing applications, and > we > > would like to have two more SOLR nodes for some backend jobs. Is it good > > idea to form these nodes as slave nodes and making one node in the clo

Re: Solrcloud - Reads on specific nodes

2021-01-15 Thread Shawn Heisey
good idea to form these nodes as slave nodes and making one node in the cloud as Master? SolrCloud does not have masters or slaves. One thing you could do is set the replica types on four of those nodes to one type, and on the other nodes, use a different replica type. For instance, the four

Re: Solrcloud - Reads on specific nodes

2021-01-15 Thread Michael Gibney
I know you're asking about nodes, not replicas; but depending on what you're trying to achieve you might be as well off routing requests based on replica. Have you considered the various options available via the `shards.preference` param [1]? For instance, you could set up your "write" replicas as

Re: Replicaton SolrCloud

2021-01-15 Thread Shawn Heisey
On 1/15/2021 7:20 AM, Jae Joo wrote: Is non CDCR replication in SolrCloud still working in Solr 9.0? Solr 9 doesn't exist yet. Probably won't for at least a few months. The latest version is 8.7.0. Solr's replication feature is used by SolrCloud internally for recovery oper

Solrcloud - Reads on specific nodes

2021-01-15 Thread Doss
Dear All, 1. Suppose we have 10 node SOLR Cloud setup, is it possible to dedicate 4 nodes for writes and 6 nodes for selects? 2. We have a SOLR cloud setup for our customer facing applications, and we would like to have two more SOLR nodes for some backend jobs. Is it good idea to form these node

Replicaton SolrCloud

2021-01-15 Thread Jae Joo
Is non CDCR replication in SolrCloud still working in Solr 9.0? Jae

SolrCloud 8.7.0 with Zookeeper 3.4.5

2021-01-15 Thread Subhajit Das
Hi There, I am planning to implement Solr cloud 8.7.0 with existing Zookeeper 3.4.5. This is cloudera provided zookeeper. Is there any red flags, for such configuration, as I couldn’t find any compatibility matrix? Many thanks in advance. Regards, Subhajit

Re: solrcloud with EKS kubernetes

2021-01-14 Thread Abhishek Mishra
Hi Jonathan, it was really helpful. Some of the metrics were crossing threshold like network bandwidth etc. Regards, Abhishek On Sat, Dec 26, 2020 at 7:54 PM Jonathan Tan wrote: > Hi Abhishek, > > Merry Christmas to you too! > I think it's really a question regarding your indexing speed NFRs. >

What should I do when I see a collection "recovering" in SolrCloud?

2021-01-13 Thread ufuk yılmaz
Should I stop indexing new documents, or stop indexing and wait for collections to recover? Recently our disk got 100% full and Solr started to throw various errors. So I deleted some unnecessary documents and committed with expungeDeletes=true. It freed some space but many collections went int

Re: Solrcloud load balancing / failover

2020-12-26 Thread Dominique Bejean
ed and > the request may succeed. > > IMO, these are two weak areas of Solr right now. Suggestions/patches > are welcome :-) > > On 12/11/20, Dominique Bejean wrote: > > Hi, > > > > Is there in Solrcloud any load balancing based on CPU load on Solr nodes > ? >

Re: solrcloud with EKS kubernetes

2020-12-26 Thread Jonathan Tan
Hi Abhishek, Merry Christmas to you too! I think it's really a question regarding your indexing speed NFRs. Have you had a chance to take a look at your IOPS & write bytes/second graphs for that host & PVC? I'd suggest that's the first thing to go look at, so that you can find out whether you're

Re: solrcloud with EKS kubernetes

2020-12-23 Thread Abhishek Mishra
Hi Jonathan, Merry Christmas. Thanks for the suggestion. To manage IOPS can we do something on rate-limiting behalf? Regards, Abhishek On Thu, Dec 17, 2020 at 5:07 AM Jonathan Tan wrote: > Hi Abhishek, > > We're running Solr Cloud 8.6 on GKE. > 3 node cluster, running 4 cpus (configured) and 8

SolrCloud keeps crashing

2020-12-21 Thread Victor Kretzer
My setup: 3 SolrCloud 6.6.6 nodes and 3 zookeeper 3.4.14 nodes running on 3 Azure Ubuntu 18.04 LTS VMs (1 solr/1 zk per machine). My issue: Every few days (1-3 days usually) I come on to find 2 of me 3 nodes down. I'm looking at the logs and not seeing an out of memory error. I do see i

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread kshitij tyagi
stem needs to be tolerant of momentary > >> glitches due to network congestion, reading indexes into memory, etc. > >> Bypassing that assumption needs some justification…. > >> > >> Best, > >> Erick > >> > >>> On Dec 18, 2020, at 6:2

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread Erick Erickson
gt; >> The code is structured that way on the theory that you want the request >> to succeed and the system needs to be tolerant of momentary >> glitches due to network congestion, reading indexes into memory, etc. >> Bypassing that assumption needs some justification…. &

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread kshitij tyagi
> Best, > Erick > > > On Dec 18, 2020, at 6:23 AM, kshitij tyagi > wrote: > > > > Hi, > > > > We have a Solrcloud setup and are using CloudSolrClient, What we are > seeing > > is if socketTimeoutOccurs then the same request is sent to other

Re: solrCloud client socketTimeout initiates retries

2020-12-18 Thread Erick Erickson
, reading indexes into memory, etc. Bypassing that assumption needs some justification…. Best, Erick > On Dec 18, 2020, at 6:23 AM, kshitij tyagi wrote: > > Hi, > > We have a Solrcloud setup and are using CloudSolrClient, What we are seeing > is if socketTimeoutOccurs then t

solrCloud client socketTimeout initiates retries

2020-12-18 Thread kshitij tyagi
Hi, We have a Solrcloud setup and are using CloudSolrClient, What we are seeing is if socketTimeoutOccurs then the same request is sent to other solr server. So if I set socketTimeout to a very low value say 100ms and my query takes around 200ms then client tries to query second server, then

Re: solrcloud with EKS kubernetes

2020-12-16 Thread Jonathan Tan
Hi Abhishek, We're running Solr Cloud 8.6 on GKE. 3 node cluster, running 4 cpus (configured) and 8gb of min & max JVM configured, all with anti-affinity so they never exist on the same node. It's got 2 collections of ~13documents each, 6 shards, 3 replicas each, disk usage on each node is ~54gb (

Re: Solrcloud load balancing / failover

2020-12-14 Thread Shalin Shekhar Mangar
wrote: > Hi, > > Is there in Solrcloud any load balancing based on CPU load on Solr nodes ? > > If for shard a replica fails to handle a query, the query is sent to > another replica in order to be completed ? > > Regards > > Dominique > -- Regards, Shalin Shekhar Mangar.

Re: solrcloud with EKS kubernetes

2020-12-14 Thread Shalin Shekhar Mangar
FWIW, I have seen Solr exhaust the IOPS burst quota on AWS causing slow replication and high latency for search and indexing operations. You may want to dig into cloud watch metrics and see if you are running into a similar issue. The default IOPS quota on gp2 is very low (100?). Another thing to

Re: solrcloud with EKS kubernetes

2020-12-13 Thread Abhishek Mishra
Hi Houston, Sorry for the late reply. Each shard has a 9GB size around. Yeah, we are providing enough resources to pods. We are currently using c5.4xlarge. XMS and XMX is 16GB. The machine is having 32 GB and 16 core. No, I haven't run it outside Kubernetes. But I do have colleagues who did the sam

Solrcloud load balancing / failover

2020-12-11 Thread Dominique Bejean
Hi, Is there in Solrcloud any load balancing based on CPU load on Solr nodes ? If for shard a replica fails to handle a query, the query is sent to another replica in order to be completed ? Regards Dominique

Re: SolrCloud crashing due to memory error - 'Cannot allocate memory' (errno=12)

2020-12-10 Thread Walter Underwood
at 7:55 PM, Altamirano, Emmanuel > wrote: > > Hello, > > We have a SolrCloud(8.6) with 3 servers with the same characteristics and > configuration. We assigned32GB for heap memory each, and after some short > period of time sending 40 concurrent requests to th

SolrCloud crashing due to memory error - 'Cannot allocate memory' (errno=12)

2020-12-10 Thread Altamirano, Emmanuel
Hello, We have a SolrCloud(8.6) with 3 servers with the same characteristics and configuration. We assigned 32GB for heap memory each, and after some short period of time sending 40 concurrent requests to the SolrCloud using a load balancer, we are getting the following error that shutdown

Re: solrcloud with EKS kubernetes

2020-12-09 Thread Houston Putman
Hello Abhishek, It's really hard to provide any advice without knowing any information about your setup/usage. Are you giving your Solr pods enough resources on EKS? Have you run Solr in the same configuration outside of kubernetes in the past without timeouts? What type of storage volumes are yo

How can i poll Solrcloud via API to get the sum of index size of all shards and replicas?

2020-12-09 Thread Roman Ivanov
Hello! We have a Solrcloud(7.4) consisting of 90+ hosts(each of them running multiple nodes of solr, e.g. ports 8983, 8984, 8985), numerous shards(each having several replicas) and numerous collections. I was given a task to summarize the total index size(on disks) of a certain collection. First

solrcloud with EKS kubernetes

2020-12-08 Thread Abhishek Mishra
Hello guys, We are kind of facing some of the issues(Like timeout etc.) which are very inconsistent. By any chance can it be related to EKS? We are using solr 7.7 and zookeeper 3.4.13. Should we move to ECS? Regards, Abhishek

Re: SolrCloud shows cluster still healthy even the node data directory is deleted

2020-12-06 Thread Amy Bai
Hi community, I create a Solr Jira to track this issue. https://issues.apache.org/jira/browse/SOLR-15028 Regards, Amy From: Radar Lei Sent: Friday, November 20, 2020 5:13 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud shows cluster still healthy

Re: Migrate Legacy Solr Cores to SolrCloud

2020-12-05 Thread Erick Erickson
with Solr X-2 (i.e. Solr 6 or earlier and assuming you’re migrating to Solr 8) this will not work and you’ll have to re-index your data. This is not particular to SolrCloud, Lucene will refuse to open the index if it was created with any version of Solr earlier than the immediately prior major

Migrate Legacy Solr Cores to SolrCloud

2020-12-05 Thread Jay Mandal
Hello All, Please can some one from the Solr Lucene Community Provide me the Steps on how to migrate an existing Solr legacy Core, data and conf(manage schema,solrconfig.xml files to SolrCloud configuration with collections and shards and where to copy the existing files to reuse the data in

Re: SolrCloud shows cluster still healthy even the node data directory is deleted

2020-11-20 Thread Radar Lei
Hi Erick, I understand this is how the file handler works. But for the SolrCloud users, they didn't see the expected replica failover happens, then we can not say SolrCloud is totally HA enabled. Do we have plan to handle the HA for disk failures? Thanks. Regards, Radar From: Amy Bai

Re: Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-15 Thread Gajanan
Thanks for the replies. Wanted to make sure that I am not missing on something already available. Now that everything is clear, I may have to go for application re-design or choose an approach, not so elegant, as suggested. Thanks all. -Gajanan -- Sent from: https://lucene.472066.n3.nabble.com/

Re: Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-15 Thread Ilan Ginzburg
; This was working in non cloud mode with coreAdmin APIs. Now because of > > scaling requirements we want to shift to SolrCloud mode. we want to > continue > > with same application design. can you suggest, how to implement a similar > > solution in SolrCloud context. > > > > -Gajanan > > > > > > > > -- > > Sent from: https://lucene.472066.n3.nabble.com/Solr-User-f472068.html > >

Re: Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-15 Thread Erick Erickson
hem whenever required. > This was working in non cloud mode with coreAdmin APIs. Now because of > scaling requirements we want to shift to SolrCloud mode. we want to continue > with same application design. can you suggest, how to implement a similar > solution in SolrCloud context. &

Re: Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-15 Thread Gajanan
whenever required. This was working in non cloud mode with coreAdmin APIs. Now because of scaling requirements we want to shift to SolrCloud mode. we want to continue with same application design. can you suggest, how to implement a similar solution in SolrCloud context. -Gajanan -- Sent from: https

Setting up SolrCloud Behind Azure Application Gateway

2020-11-12 Thread Victor Kretzer
I'm attempting to set up SolrCloud for use with Sitecore 9.0.2. I want to set up my Azure Application Gateway with a TSL cert. I want a private IP for Sitecore and a public IP for accessing the Solr Admin Dashboard. My goal is to use Application Gateway for the TSL and then route to the ba

Re: Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-12 Thread Erick Erickson
As stated in the docs, using the core admin API when using SolrCloud is not recommended, for just reasons like this. While SolrCloud _does_ use the Core Admin API, it’s usage has to be very precise. You apparently didn’t heed this warning in the UNLOAD command for the collections API

How to unload and reload a solr collection in SolrCloud

2020-11-12 Thread Gajanan Watkar
I want to unload and reload all cores of a collection in SolrCloud mode (Solr 8.x.x). -- -Gajanan

Unloading and loading a Collection in SolrCloud with external Zookeeper ensemble

2020-11-12 Thread Gajanan
I have unloaded all cores of a collection in SolrCloud (8.x.x ) using coreAdmin APIs as UNLOAD collection is not available in collections API. Now I want reload the unloaded collection using APIs only. When trying with coreAdmin APIs I am getting "Non legacy mode CoreNodeName not found.&q

Re: SolrCloud shows cluster still healthy even the node data directory is deleted

2020-11-11 Thread Amy Bai
x27;t failover to other healthy replicas. Regards, Amy From: Erick Erickson Sent: Monday, November 9, 2020 8:43 PM To: solr-user@lucene.apache.org Subject: Re: SolrCloud shows cluster still healthy even the node data directory is deleted Depends. *nix systems have dele

Re: SolrCloud shows cluster still healthy even the node data directory is deleted

2020-11-09 Thread Erick Erickson
On Nov 9, 2020, at 3:30 AM, Amy Bai wrote: > > Hi community, > > I found that SolrCloud won't check the IO status if the SolrCloud process is > alive. > E.g. If I delete the SolrCloud data directory, there are no errors report, > and I can still log in to the SolrClo

SolrCloud shows cluster still healthy even the node data directory is deleted

2020-11-09 Thread Amy Bai
Hi community, I found that SolrCloud won't check the IO status if the SolrCloud process is alive. E.g. If I delete the SolrCloud data directory, there are no errors report, and I can still log in to the SolrCloud Admin UI to create/query collections. Is this reasonable? Can someone ex

Re: Solrcloud create collection ignores createNodeSet parameter

2020-10-27 Thread Erick Erickson
collection is created? BTW, I’ve always disliked the parameter name “maxShardsPerNode”, shards isn’t what it’s actually about. But I suppose “maxReplicasOfAnyIndividualShardOnASingleNode” is a little verbose... > On Oct 27, 2020, at 2:17 PM, Webster Homer > wrote: > > We have a solr

Solrcloud create collection ignores createNodeSet parameter

2020-10-27 Thread Webster Homer
We have a solrcloud set up with 2 nodes, 1 zookeeper and running Solr 7.7.2 This cloud is used for development purposes. Collections are sharded across the 2 nodes. Recently we noticed that one of the main collections we use had both replicas running on the same node. Normally we don'

Re: SolrCloud 6.6.2 suddenly crash due to slow queries and Log4j issue

2020-10-19 Thread Dominique Bejean
Shawn, According to the log4j description ( https://bz.apache.org/bugzilla/show_bug.cgi?id=57714), the issue is related to lock during appenders collection process. In addition to CONSOLE and file appenders in the default log4j.properties, my customer added 2 extra FileAppender dedicated to all r

Re: SolrCloud 6.6.2 suddenly crash due to slow queries and Log4j issue

2020-10-19 Thread Dominique Bejean
Hi Shawn, Thank you for your response. You are confirming my diagnosis. This is in fact a 8 nodes cluster with one single collection with 4 shards and 1 replica (8 cores). 4 Gb heap and 90 Gb Ram When no issue occurs nearly 50% of the heap is used. Num Docs in collection : 10.000.000 Num Do

Re: SolrCloud 6.6.2 suddenly crash due to slow queries and Log4j issue

2020-10-18 Thread Shawn Heisey
On 10/18/2020 3:22 AM, Dominique Bejean wrote: A few months ago, I reported an issue with Solr nodes crashing due to the old generation heap growing suddenly and generating OOM. This problem occurred again this week. I have threads dumps for each minute during the 3 minutes the problem occured. I

SolrCloud 6.6.2 suddenly crash due to slow queries and Log4j issue

2020-10-18 Thread Dominique Bejean
Hi, A few months ago, I reported an issue with Solr nodes crashing due to the old generation heap growing suddenly and generating OOM. This problem occurred again this week. I have threads dumps for each minute during the 3 minutes the problem occured. I am using fastthread.io in order to analyse

Add Hosts in SolrCloud

2020-09-28 Thread Massimiliano Randazzo
Hello everybody I have a SolrCloud consisting of 4 Servers, I have a collection with 2 shars in replica 2 Collection: bookReaderAttilioHortis Shard count: 2 configName: BookReader replicationFactor: 2 maxShardsPerNode: 2 router: compositeId autoAddReplicas: false I would like to add 2 more

Re: Issues deploying LTR into SolrCloud

2020-09-21 Thread krishan goyal
e: > > > Hi, > > > > There is a recent thread "Replication of Solr Model and feature store" on > > deploying LTR feature store and model into a master/slave Solr topology. > > > > I'm facing an issue of deploying into SolrCloud (solr 7.5.0), where

RE: SolrCloud (6.6.6) SSL Setup - Unable to create collection

2020-09-04 Thread Victor Kretzer
- From: Victor Kretzer Sent: Thursday, September 3, 2020 3:03 PM To: solr-user@lucene.apache.org Subject: SolrCloud (6.6.6) SSL Setup - Unable to create collection BACKGROUND: I'm attempting to setup SolrCloud (Solr 6.6.6) with an external zookeeper ensemble on Azure. I have three dedica

SolrCloud (6.6.6) SSL Setup - Unable to create collection

2020-09-03 Thread Victor Kretzer
BACKGROUND: I'm attempting to setup SolrCloud (Solr 6.6.6) with an external zookeeper ensemble on Azure. I have three dedicated vms for the zookeeper ensemble and two for solr all running Ubuntu 18.04 LTS. I'm new to Solr (and Linux) and have been heavily relying on the Solr Ref Guide

Re: Ranking issue when combining sorting and re-ranking on SolrCloud (multiple shards)

2020-08-28 Thread Dmitry Kan
a custom sorting > > function to get the first pass results (using the sort param), and then > we > > use LTR for re-ranking. This works fine, i.e. re-ranking is applied on > the > > topN, after sorting has completed and the order is correct. > > > > However, a

Re: Ranking issue when combining sorting and re-ranking on SolrCloud (multiple shards)

2020-08-28 Thread Dmitry Kan
then > > we > > > use LTR for re-ranking. This works fine, i.e. re-ranking is applied on > > the > > > topN, after sorting has completed and the order is correct. > > > > > > However, as we are migrating on SolrCloud (version 7.3.1) with multiple > &

Re: Ranking issue when combining sorting and re-ranking on SolrCloud (multiple shards)

2020-08-28 Thread Spyros Kapnissis
e. re-ranking is applied on > the > > topN, after sorting has completed and the order is correct. > > > > However, as we are migrating on SolrCloud (version 7.3.1) with multiple > > shards, this does not seem to work as expected. To my understanding, Solr > > col

Re: Ranking issue when combining sorting and re-ranking on SolrCloud (multiple shards)

2020-08-28 Thread Jörn Franke
n to get the first pass results (using the sort param), and then we > use LTR for re-ranking. This works fine, i.e. re-ranking is applied on the > topN, after sorting has completed and the order is correct. > > However, as we are migrating on SolrCloud (version 7.3.1) with multiple >

Re: Ranking issue when combining sorting and re-ranking on SolrCloud (multiple shards)

2020-08-28 Thread Dmitry Kan
ing the sort param), and then we > use LTR for re-ranking. This works fine, i.e. re-ranking is applied on the > topN, after sorting has completed and the order is correct. > > However, as we are migrating on SolrCloud (version 7.3.1) with multiple > shards, this does not seem

Re: Issues deploying LTR into SolrCloud

2020-08-26 Thread Dmitry Kan
topology. > > I'm facing an issue of deploying into SolrCloud (solr 7.5.0), where > collections have shards with replicas. This is the process I've been > following: > > 1. Deploy a feature store from a JSON file to each collection. > 2. Reload all collections as advi

Issues deploying LTR into SolrCloud

2020-08-25 Thread Dmitry Kan
Hi, There is a recent thread "Replication of Solr Model and feature store" on deploying LTR feature store and model into a master/slave Solr topology. I'm facing an issue of deploying into SolrCloud (solr 7.5.0), where collections have shards with replicas. This is the pr

Re: How to Write Autoscaling Policy changes to Zookeeper/SolrCloud using the autoscaling Java API

2020-08-24 Thread Howard Gonzalez
in the Policy class however I can't find how to use it. Thanks in advance From: Howard Gonzalez Sent: Friday, August 21, 2020 12:45 PM To: solr-user@lucene.apache.org Subject: How to Write Autoscaling Policy changes to Zookeeper/SolrCloud using the autoscal

How to Write Autoscaling Policy changes to Zookeeper/SolrCloud using the autoscaling Java API

2020-08-21 Thread Howard Gonzalez
Hello. I am trying to use the autoscaling Java API to write some cluster policy changes to a Zookeeper/SolrCloud cluster. However, I can't find the right way to do it. I can get all the autoscaling cluster policy clauses using: autoScalingConfig.getPolicy.getClusterPolicy However,

Re: Solrcloud tlog are not deleted

2020-08-14 Thread Jérôme ROUCOU
Hello, Thanks for your reply. Yes, the CDCR buffer is disable when we check it. We finally found that the increase of tlog files was due to the version of Zookeeper used. We re-installed Zookeeper in the same version as the one embedded by Solr, and this fixed the problem of non-deleted tlogs.

Re: DIH on SolrCloud

2020-08-14 Thread Jan Høydahl
problems with Zookeeper etc. First thing I’d do, while prearing to replace DIH with something else outside your cluster, is to get up to a recent Solr version. Version 4.10 has a lot of known issues wrt SolrCloud stability. Jan > 14. aug. 2020 kl. 03:55 skrev Issei Nishigata : > >

Re: DIH on SolrCloud

2020-08-13 Thread Issei Nishigata
mment for my understanding of the indexing architecture on SolrCloud, please? Thanks, Issei 2020年8月14日(金) 0:33 Jörn Franke : > DIH is deprecated in current Solr versions. The general recommendation is > to do processing outside the Solr server and use the update handler (the > normal one

Re: DIH on SolrCloud

2020-08-13 Thread Jörn Franke
error or a script error. > Am 13.08.2020 um 17:21 schrieb Issei Nishigata : > > Hi, All > > I'm using Solr4.10 with SolrCloud mode. > I have 10 Nodes. one of Nodes is Leader Node, the others is Replica.(I will > call this Node1 to Node10 for convenience) > -> 1 S

DIH on SolrCloud

2020-08-13 Thread Issei Nishigata
Hi, All I'm using Solr4.10 with SolrCloud mode. I have 10 Nodes. one of Nodes is Leader Node, the others is Replica.(I will call this Node1 to Node10 for convenience) -> 1 Shard, 1 Leader(Node1), 9 Replica(Node2-10) Indexing always uses DIH of Node2. Therefore, DIH may be executed when

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Bram Van Dam
On 11/08/2020 13:15, Erick Erickson wrote: > CDCR is being deprecated. so I wouldn’t suggest it for the long term. Ah yes, thanks for pointing that out. That makes Dominique's alternative less attractive. I guess I'll stick to my original proposal! Thanks Erick :-) - Bram

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Dominique Bejean
gt; On Aug 10, 2020, at 9:33 PM, Ashwin Ramesh > >> wrote: > >>> > >>> I would love an answer to this too! > >>> > >>> On Fri, Aug 7, 2020 at 12:18 AM Bram Van Dam > >> wrote: > >>> > >>>> Hey folks, > &

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Erick Erickson
; On Fri, Aug 7, 2020 at 12:18 AM Bram Van Dam >> wrote: >>> >>>> Hey folks, >>>> >>>> Been reading up about the various ways of creating backups. The whole >>>> "shared filesystem for Solrcloud backups"-thing is kind

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Dominique Bejean
; I would love an answer to this too! > > > > On Fri, Aug 7, 2020 at 12:18 AM Bram Van Dam > wrote: > > > >> Hey folks, > >> > >> Been reading up about the various ways of creating backups. The whole > >> "shared filesystem for Solrcloud

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Erick Erickson
p about the various ways of creating backups. The whole >> "shared filesystem for Solrcloud backups"-thing is kind of a no-go in >> our environment, so I've been looking for ways around that, and here's >> what I've come up with so far: >> >>

Re: Solrcloud tlog are not deleted

2020-08-11 Thread Dominique Bejean
Hi, Did you disable CDCR buffer ? solr//cdcr?action=DISABLEBUFFER You can check with "cdcr?action=STATUS" Regards Dominique Le mar. 11 août 2020 à 10:57, Michel Bamouni a écrit : > Hello, > > > We had setup a synchronization between our solr instances on 2 datacenters > by using the CDCR.

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-11 Thread Dominique Bejean
Hi, This procedure looks fine but it is a little complexe to automatize. Why not consider backup based on CDCR for Solrcloud or Replication for Solr standalone ? For Solrcloud, CDCR can be configured with source and target collections in the same Solrcloud cluster. The target collection can

Solrcloud tlog are not deleted

2020-08-11 Thread Michel Bamouni
Hello, We had setup a synchronization between our solr instances on 2 datacenters by using the CDCR. until now, every thing worked fine but after an upgrade from solr 7.3 to solr 7.7, we are facing an issue. Indeed, our tlog files are not deleted even if we see the new values on the two solr

Re: Backups in SolrCloud using snapshots of individual cores?

2020-08-10 Thread Ashwin Ramesh
I would love an answer to this too! On Fri, Aug 7, 2020 at 12:18 AM Bram Van Dam wrote: > Hey folks, > > Been reading up about the various ways of creating backups. The whole > "shared filesystem for Solrcloud backups"-thing is kind of a no-go in > our environment, so I

Replication not occurring to newly added SOLRCloud nodes

2020-08-10 Thread Shane Brooks
Main info: SOLRCloud 7.7.3, Zookeeper 3.4.14 I have a 2 node SOLRCloud installation, 3 zookeeper instances, configured in AWS to autoscale. I am currently testing with 9 collections. My issue is that when I scale out and a node is added to the SOLRCloud cluster, I get replication to the new

Backups in SolrCloud using snapshots of individual cores?

2020-08-06 Thread Bram Van Dam
Hey folks, Been reading up about the various ways of creating backups. The whole "shared filesystem for Solrcloud backups"-thing is kind of a no-go in our environment, so I've been looking for ways around that, and here's what I've come up with so far: 1. Stop applicat

Re: SolrCloud on PublicCloud

2020-08-03 Thread Shawn Heisey
On 8/3/2020 12:04 PM, Mathew Mathew wrote: Have been looking for architectural guidance on correctly configuring SolrCloud on Public Cloud (eg Azure/AWS) In particular the zookeeper based autoscaling seems to overlap with the auto scaling capabilities of cloud platforms. I have the following

SolrCloud on PublicCloud

2020-08-03 Thread Mathew Mathew
Have been looking for architectural guidance on correctly configuring SolrCloud on Public Cloud (eg Azure/AWS) In particular the zookeeper based autoscaling seems to overlap with the auto scaling capabilities of cloud platforms. I have the following questions. 1. Should the ZooKeeper

SolrCloud SSL Encryption

2020-08-03 Thread Mathew Mathew
According to the documentation. https://lucene.apache.org/solr/guide/8_6/enabling-ssl.html ZooKeeper does not support encrypted communication with clients like Solr. There are several related JIRA tickets where SSL support is being planned/worked on: ZOOKEEPER-235

Re: AtomicUpdate on SolrCloud is not working

2020-07-20 Thread Shawn Heisey
On 7/19/2020 1:37 AM, yo tomi wrote: I have no choice but use post-processor. However bug of SOLR-8030 makes me not feel like using it. Can you explain why you need the trim field and remove blank field processors to be post processors? When I think about these functionalities, they should w

Re: AtomicUpdate on SolrCloud is not working

2020-07-19 Thread yo tomi
Hi Jörn & shown "does not work properly" means pre-processors (TrimFieldUpdateProcessorFactory and RemoveBlankFieldUpdateProcessorFactory) don't trim and remove blank for string fields. example: When the following schema: --- --- update following documents with "Documents" of solr admin: -

Re: AtomicUpdate on SolrCloud is not working

2020-07-18 Thread Shawn Heisey
On 7/17/2020 1:32 AM, yo tomi wrote: When I did AtomicUpdate on SolrCloud by the following setting, it does not work properly. As Jörn Franke already mentioned, you haven't said exactly what "does not work properly" actually means in your situation. Without that information,

Re: AtomicUpdate on SolrCloud is not working

2020-07-17 Thread Issei Nishigata
I have the same problem in my Solr8. I think it's because in the first way, TrimFieldUpdateProcessorFactory and RemoveBlankFieldUpdateProcessorFactory is not taking effect. On SolrCloud, TrimFieldUpdateProcessorFactory, RemoveBlankFieldUpdateProcessorFactory and other processors only run o

Re: AtomicUpdate on SolrCloud is not working

2020-07-17 Thread Jörn Franke
not work properly. > --- > > > > > > > --- > And follows is working as expected. > --- > > > > > > > > --- > > Thanks, > Yoshiaki > > > 2020年7月17日(金) 16:32 yo tomi : > >> Hi, All >> When I did AtomicUpdate on SolrCloud by th

Re: AtomicUpdate on SolrCloud is not working

2020-07-17 Thread yo tomi
Hi All Sorry, above settings are contrary with each other. Actually, following setting does not work properly. --- --- And follows is working as expected. --- --- Thanks, Yoshiaki 2020年7月17日(金) 16:32 yo tomi : > Hi, All > When I did AtomicUpdate on SolrCloud

AtomicUpdate on SolrCloud is not working

2020-07-17 Thread yo tomi
Hi, All When I did AtomicUpdate on SolrCloud by the following setting, it does not work properly. --- --- When changed as follows and made it work, it became as expected. --- --- The later setting and the way of using post-processor could make the same result, I though, but

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Tran Van Hoan
ario.rigo...@comperio.it> wrote: > > > > > > What about a network issue? > > > > Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan > > ha scritto: > > > > > > > > > > dear all, > > > > > >  I have a s

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Tran Van Hoan
ith OS, hardware and network. > > I attached images about solr metrics 7 days and 12h. > > > > On Tuesday, June 23, 2020, 2:23:05 PM GMT+7, Dario Rigolin < > > dario.rigo...@comperio.it> wrote: > > > > > > What about a network issue? > > > >

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Rodrigo Oliveira
lin < > > dario.rigo...@comperio.it> wrote: > > > > > > What about a network issue? > > > > Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan > > ha scritto: > > > > > > > > > > dear all, > > > > >

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Tran Van Hoan
; > Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan > ha scritto: > > > > > > dear all, > > > >  I have a solr cloud 8.2.0 with 6 instance per 6 server (64G RAM), each > > instance has xmx = xms = 30G. > > > > Today almost nodes in

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Rodrigo Oliveira
have a solr cloud 8.2.0 with 6 instance per 6 server (64G RAM), each > > instance has xmx = xms = 30G. > > > > Today almost nodes in the solrcloud were dead 2 times from 8:00AM (5/6 > > nodes were down) and 1:00

Re: Almost nodes in Solrcloud dead suddently

2020-07-04 Thread Tran Van Hoan
about a network issue? Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan ha scritto: > > dear all, > >  I have a solr cloud 8.2.0 with 6 instance per 6 server (64G RAM), each > instance has xmx = xms = 30G. > > Today almost nodes in the solrcloud were dead 2 times fro

SolrCloud with custom package in dataimport

2020-06-26 Thread stefan
Hey, Is it possible to reference a custom java class during the dataimport? The dataimport looks something like this: ``` db-data-config.xml ``` Sadly I was unable to find any information on this topic. Thanks for your help!

  1   2   3   4   5   6   7   8   9   10   >