Re: [EXTERNAL] Getting rid of Master/Slave nomenclature in Solr

2020-06-23 Thread Noble Paul
Do we even call it the master/slave mode? I thought we had 2 modes * Standalone mode * SolrCloud mode On Wed, Jun 24, 2020 at 3:00 AM Tomás Fernández Löbbe wrote: > > I agree in general with what Trey and Jan said and have suggested. I > personally like to use "leader/follower". It's true that s

solr fq with contains not returning any results

2020-06-23 Thread yaswanth kumar
I am using solr 8.2 And when trying to do fq=auto_nsallschools:*bostonschool*, the data is not being returned. But if I do the same in solr 5.5 (which I already have and we are in process of migrating to 8.2 ) its returning results. if I do fq=auto_nsallschools:bostonschool or fq=auto_nsallschool

Restored collection cluster status rendering some values as Long (as opposed to String for other collections)

2020-06-23 Thread Aliaksandr Asiptsou
Hello Solr experts, Our team noticed the below behavior: 1. A collection is restored from a backup, and a replication factor is specified within the restore command: /solr/admin/collections?action=RESTORE&name=backup_name&location=/backups/solr&collection=collection_name&collection.configName=c

Re: replica deleted but directory remains

2020-06-23 Thread Erick Erickson
In a word, “yes”. What it looks like is that the information in Zookeeper has been updated to reflect the deletion. But since node for some mysterious reason wasn’t available when the replica was deleted, the data couldn’t be removed. Best, Erick > On Jun 23, 2020, at 12:58 PM, Odysci wrote: >

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread ChienHuaWang
Q1: I'm looking for the disk usage data in Solr admin - Solr Cloud/Nodes. Any way to get the Node data in table thru API call? Q2: Thanks for helpful information about deleting the data. The main issue I have now is for deleting collections, even if I delete by admin UI, this suppose not to hang

Re: [EXTERNAL] Getting rid of Master/Slave nomenclature in Solr

2020-06-23 Thread Tomás Fernández Löbbe
I agree in general with what Trey and Jan said and have suggested. I personally like to use "leader/follower". It's true that somewhat collides with SolrCloud terminology, but that's not a problem IMO, now that replica types exist, the “role” of the replica (leader vs. non-leader/follower) doesn’t

replica deleted but directory remains

2020-06-23 Thread Odysci
Hi, I've got a solrcloud configuration with 2 shards and 2 replicas each. For some unknown reason, one of the replicas was on "recovery" mode forever, so I decided to create another replica, which went fine. Then I proceeded to delete the old replica (using the SOlr UI). After a while the interface

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread Walter Underwood
We get disk usage on volumes using Telegraf. I’m planning on writing something that gathers size info (docs and bytes) by getting core info from the CLUSTERSTATUS request then using the CoreAdmin API to get the detailed info about cores. It doesn’t look hard, just complicated. Fire up Python and

Re: Almost nodes in Solrcloud dead suddently

2020-06-23 Thread Tran Van Hoan
I checked node exporter metrics and saw network no problem On Tuesday, June 23, 2020, 8:37:41 PM GMT+7, Tran Van Hoan wrote: I check node exporter, no problem with OS, hardware and network.I attached images about solr metrics 7 days and 12h. On Tuesday, June 23, 2020, 2:23:05 PM

Re: Index file on Windows fileshare..

2020-06-23 Thread Erick Erickson
The program I pointed you to should take about an hour to make work. But otherwise, you can try the post tool: https://lucene.apache.org/solr/guide/7_2/post-tool.html Best, Erick > On Jun 23, 2020, at 8:45 AM, Fiz N wrote: > > Thanks Erick. Is there easy way of doing this? Index files from win

Re: Index file on Windows fileshare..

2020-06-23 Thread Fiz N
Thanks Erick. Is there easy way of doing this? Index files from windows share folder to SOLR. This is for POC only. Thanks Nadian. On Mon, Jun 22, 2020 at 3:54 PM Erick Erickson wrote: > Consider running Tika in a client and indexing the docs to Solr. > At that point, you have total control ove

Re: Sorting in other collection in Solr 8.5.1

2020-06-23 Thread Erick Erickson
You have two separate collections with dissimilar data, so what does “sorting them in the same order” mean? Your example sorts on title, so why can’t you sort them both on title? That won’t work of course for any field that isn’t identical in both collections. These are actually pretty small colle

Re: Retrieve disk usage & release disk space after delete

2020-06-23 Thread Erick Erickson
Q1: If you’re talking about disk space used up by deleted documents, then yes, optimize or expungeDeletes will recover it. The former will recover it all, the latter will rewrite segments with > 10% deleted documents. HOWEVER: optimize is an expensive operation, and can have deleter

Re: Unable to set preferred leader

2020-06-23 Thread Erick Erickson
First of all, unless you have a lot of shards worrying about which one is the leader is not worth the effort. That code was put in there to deal with a situation where there were 100s of shards and when the system was cold-started they all could have their leader be on the same node. The extra

RE: Log4J Logging to Http

2020-06-23 Thread Krönert Florian
Hi Radu, thanks for your response. Your different approach is very valuable to me, so thanks for suggesting it. I'll take a look at the different tools you suggested. I hope there is some small and efficient solution for doing this, since throwing a whole Logstash, ElasticSearch and Kibana stac

RE: Log4J Logging to Http

2020-06-23 Thread Krönert Florian
Hi Shawn, thanks for your response, I'll take a look, it seems the slf4j jars are missing in there. The filesystem is not really something that I am going to tweak inside that Docker container, so I might take a look at different approaches as well. Kind Regards, Florian Krönert Senior Softwar

Unable to set preferred leader

2020-06-23 Thread Karl Stoney
Hey, We have a SolrCloud collection with 8 replicas, and one of those replicas has the `property.preferredleader: true` set. However when we perform a `REBALANCELEADERS` we get: ``` { "responseHeader": { "status": 0, "QTime": 62268 }, "Summary": { "Failure": "Not all active r

Retrieve disk usage & release disk space after delete

2020-06-23 Thread ChienHuaWang
Hi Solr users, Q1: Wondering if there is any way to retrieve disk usage by host? Could we get thru metrics API or any other methods? I know the data shows in Solr Admin UI, but have other approach for this kind of data. Q2: After delete the collections, it seems not physically removed from the d

Re: Almost nodes in Solrcloud dead suddently

2020-06-23 Thread Dario Rigolin
What about a network issue? Il giorno mar 23 giu 2020 alle ore 01:37 Tran Van Hoan ha scritto: > > dear all, > > I have a solr cloud 8.2.0 with 6 instance per 6 server (64G RAM), each > instance has xmx = xms = 30G. > > Today almost nodes in the solrcloud were dead 2 times from 8:00AM (5/6 > no