Re: How to disable the admin interface

Hi See if this article helps you. http://www.findbestopensource.com/article-detail/restrict-solr-admin-access It has settings with regard to tomcat. Regards Ganesh On 10/6/2015 2:21 AM, Shawn Heisey wrote: On 10/4/2015 3:07 PM, Siddhartha Singh Sandhu wrote: I am on page with you guys

Solr backup / replication internals

3. Backup command and Backup script does file copy. Is there any difference between them. Regards Ganesh

Restrict access to localhost

Hello all, 1) I want to restrict access to Solr only in localhost. How to acheive that? 2) If i want to allow the clients to search but not to delete? How to restric the access? Any thoughts? Regards Ganesh. Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now

PDF text extracted without spaces

. Could any one in this group could help me? I am using tika directly to extract the contents, which later gets indexed. Regards Ganesh Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now! http://messenger.yahoo.com/download.php

Re: Scale out design patterns

about the old users, their data will be still added to the server1. How to address this issue. Is rebuilding the index the only way. Could any one share their experience, How they solved scale out problems? Regards Ganesh - Original Message - From: "Anshum" To: Se

Re: Use Parallel Search

I am having similar kind of problem. I need to scale out. Could you explain how you have done distributed indexing and search using Lucene. Regards Ganesh - Original Message - From: "Gustavo Maia" To: Sent: Thursday, February 03, 2011 11:36 PM Subject: Use Parallel Search

Is facet could be used for Analytics

) /Articles/aaa (10) This is just an example. I think facet search will help to solve this kind of issue. Regards Ganesh Send free SMS to your Friends on Mobile from your Yahoo! Messenger. Download Now! http://messenger.yahoo.com/download.php

Solr document missing or not getting indexed though we get 200 ok status from server

Hi, we are keep sending documents to Solr from our app server. Single document per request, but in parallel of 10 request hits solr cloud in a second. We could see our post request ( update request ) hitting our solr 5.4 in localhost_access logs, and it's response as 200 Ok response. And also we

Re: Solr document missing or not getting indexed though we get 200 ok status from server

ll keys shd be unique. Else docs having same id will be replaced. On 04-Sep-2016 12:13 PM, "Ganesh M" mailto:mgane...@live.in>> wrote: > Hi, > we are keep sending documents to Solr from our app server. Single document > per request, but in parallel of 10 request hits solr

Re: Solr document missing or not getting indexed though we get 200 ok status from server

r any sort of help would be very much appreciated. On Sun, Sep 4, 2016 at 12:59 PM Ganesh M mailto:mgane...@live.in>> wrote: Nitin, Thanks for reply. Our each document has unique id and its hbase rowkey id. So it will be unique only. So there is no chance of duplicates id being send.

Re: Solr document missing or not getting indexed though we get 200 ok status from server

able to index it. If SOLR has returned error, we could have retry the document indexing. Is there any way we can make SOLR to return error instead of 200 when they fail to index ? Regards, Ganesh On Sun, Sep 4, 2016 at 10:11 PM Alexandre Rafalovitch wrote: > Can you identify the specific do

Re: Solr document missing or not getting indexed though we get 200 ok status from server

ard commit manually and tried optimize too from Admin screen. But the documents are not getting indexed. As I mentioned we are using autoSoftcommit as 1 sec and autohardcommit as 30 seconds. Regards, Ganesh On Mon, Sep 5, 2016 at 1:47 AM Dheerendra Kulkarni wrote: > Can you try this: &

Re: Solr document missing or not getting indexed though we get 200 ok status from server

gh SOLR is really NOT. Is there any limit that after number of threads / concurrency, SOLR behaves strange like this ? Any settings, configurations etc to control this ? Regards, Ganesh On Mon, Sep 5, 2016 at 8:13 AM Alexandre Rafalovitch wrote: > I can't tell anything from the docume

Re: Solr document missing or not getting indexed though we get 200 ok status from server

Hi Shawn, Good to know about this configuration in shardHandler. We will try this settings and keep you posted on status. Hopefully it resolved the issue. Regards, Ganesh On 05-Sep-2016 10:02 pm, "Shawn Heisey" wrote: > On 9/4/2016 10:02 PM, Ganesh M wrote: > > We have capt

Re: Solr document missing or not getting indexed though we get 200 ok status from server

Hi Shawn, Good to know about this configuration in shardHandler. We will try this settings and keep you posted on status. Hope setting changes will resolve the issue. Regards, Ganesh On 06-Sep-2016 10:32 pm, "Ganesh M" mailto:ganesh.sudhakar@gmail.com>> wrote: Hi Shaw

SUM Function performance

am planning to do summing using following statement http://localhost:8983/solr/query?q=*:*&; json.facet={x:'sum(price)'} How far is this operation is costly. Can we execute this for every hour for 10k documents? Regards, Ganesh

Re: SUM Function performance

Is anyone tried summation of numeric field with 10k to 100k documents very frequently and faced any performance issues ? Pls share your experience. On Sun 23 Oct, 2016 12:27 am Ganesh M, mailto:mgane...@live.in>> wrote: Hi, We will have 10K documents for every hour. We would like to find

Re: SUM Function performance

All, Thanks for reply. Regards, Ganesh On Sun 23 Oct, 2016 7:21 pm Yonik Seeley, wrote: > No reason to think it would be a problem. 10K documents isn't very much. > -Yonik > > > On Sun, Oct 23, 2016 at 3:14 AM, Ganesh M wrote: > > Is anyone tried summation of nume

Transactions behaviour on Batch insert / update

error even if one document in batch fails due to issue in data or invalid fields. In case of such errors, whether complete batch fails or only one specific document fails and we get error for that specific document. Pls let me know how SOLR behaves. Regards, Ganesh

Re: SolrCloud - Sharing zookeeper ensemble with Kafka

Even we use same zookeeper for HBase and SolrCloud with corresponding folder structure. On Tue 11 Jul, 2017 7:01 pm Joe Obernberger, wrote: > Vincenzo - we do this in our environment. Zookeeper handles, HDFS, > HBase, Kafka, and Solr Cloud. > > -Joe > > > On 7/11/2017 4:18 AM, Vincenzo D'Amore

Re: Solr client

Thank you all for the reply. I have updated the solr client list. Regards Ganesh On 31-08-2017 00:37, Leonardo Perez Pulido wrote: Hi, Apart from take a look at the Solr's wiki, I think one of the main reasons why these API's are all out dated is that Solr itself provides the &#x

fq performance

Hi, We have 1 million of documents and would like to query with multiple fq values. We have kept the access_control ( multi value field ) which holds information about for which group that document is accessible. Now to get the list of all the documents of an user, we would like to pass multip

Re: fq performance

Pls share your valuable inputs. On Thu, Mar 16, 2017 at 6:04 PM Shawn Heisey wrote: > On 3/16/2017 6:02 AM, Ganesh M wrote: > > We have 1 million of documents and would like to query with multiple fq > values. > > > > We have kept the access_control ( multi value field ) w

Graph traversel

{ "id":"122"}] Where as I expect result as 1,11,12,13,121, 122, 131. What's going wrong ? Can any body help us on this ? Is the graph traversal stable enough in SOLR 6.5 ? Regards, Ganesh

Re: Graph traversel

sponse":{"numFound":1,"start":0,"maxScore":1.0,"docs":[ { "id":"A"}] }} instead of "response":{"numFound":6,"start":0,"docs":[ { "id":"A" }, { "i

Re: Using multi valued field in solr cloud Graph Traversal Query

Hi Joel, Any idea from when multi value field is supported for gatherNodes ? I am using version 6.5 ? Is it already there ? Kindly update, Ganesh On Sat, Mar 11, 2017 at 7:51 AM Joel Bernstein wrote: > Currently gatherNodes only works on single value fields. You can seed a > gatherNode

Re: Poll: Master-Slave or SolrCloud?

We use zookeeper for Hadoop / HBase and so we use same ensemble for Solr too. We are using Solr Cloud in EC2 instances with 6 collections containing 4 shards and 2 replicas. We followed the one of the blog in the internet fo

SocketException when using Solr and Tomcat

org.apache.http.impl.client.DefaultRequestDirector tryExecute INFO: I/O exception (java.net.SocketException) caught when processing request: Connection reset Feb 3, 2013 3:58:20 PM org.apache.http.impl.client.DefaultRequestDirector tryExecute INFO: Retrying request Regards Ganesh

Best Open Source

Hello all, We have launched a new site hosting the best open source products and libraries across all categories. This site is powered by Solr search. There are many open source products available in all categories and it is sometimes difficult to identify which is the best. We identify the best.

Solr 7.2.1 Collection Backup Performance issue

Hi We are using Solr 7.2.1 with SolrCloud with 35 collections with 1 node ZK ensemble (in lower environment, we will have 3 nodes ensemble) in AWS. We are testing to see if we have Async Solr Cloud backup ( https://lucene.apache.org/solr/guide/7_2/collections-api.html#backup) done every time we a

Re: Solr 7.2.1 Collection Backup Performance issue

better without BACKUP, could be because there was minimal disk access, but with Backup running, reads (GET) are probably doing disk read for every request. Thanks, Ganesh On Tue, Sep 18, 2018 at 3:43 PM Shawn Heisey wrote: > On 9/18/2018 11:00 AM, Ganesh Sethuraman wrote: > > We are u

Re: Solr 7.2.1 Collection Backup Performance issue

ation. But BACKUP is changing this equation now. Are there any best practices to do backup during off peak hours? and do some kind of warm-up? (if so how to warm up) On Tue, Sep 18, 2018 at 5:48 PM Ganesh Sethuraman wrote: > Thanks for the information. I thought backup is going to be mor

Solr Cloud in recovering state & down state for long

tion is, being in this state can it cause data issue? How do we check that (distrib=false on collection count?)? We predominantly use Solr realtime GET by key in our application. Regards, Ganesh

Re: Solr Cloud in recovering state & down state for long

On Tue, Oct 2, 2018 at 11:46 PM Shawn Heisey wrote: > On 10/2/2018 8:55 PM, Ganesh Sethuraman wrote: > > We are using 2 node SolrCloud 7.2.1 cluster with external 3 node ZK > > ensemble in AWS. There are about 60 collections at any point in time. We > > have per JVM max h

Re: Solr Cloud in recovering state & down state for long

reads? 3. Is there any way to get notified/email if the servers has any replica gets into the recovery mode? On Wed, Oct 3, 2018 at 5:26 PM Ganesh Sethuraman wrote: > > > > On Tue, Oct 2, 2018 at 11:46 PM Shawn Heisey wrote: > >> On 10/2/2018 8:55 PM, Ganesh Sethuraman wrote

Re: Solr Cloud in recovering state & down state for long

m/ganeshmailbox/har/master/SolrLogFile Here is the GC Log: http://gceasy.io/my-gc-report.jsp?p=c2hhcmVkLzIwMTgvMTAvMy8tLTAxX3NvbHJfZ2MubG9nLjUtLTIxLTE5LTU3 Thanks Ganesh On Fri, Oct 5, 2018 at 10:13 AM Shawn Heisey wrote: > On 10/5/2018 5:15 AM, Ganesh Sethuraman wrote: > > 1. Does GC and Solr

Solr 7.2.1 Security

ection? or should i actually create a separate Solr cluster to do this. 3. I see the documentation for enabling SSL ( https://lucene.apache.org/solr/guide/7_2/enabling-ssl.html), is there any steps for this with certificates provided by certifying authority? say thawte, digicert, etc Regards, Ganesh

Solr Authentication Error - Error trying to proxy request for url

We are using Solr 7.2.1 in Solr Cloud mode, with embedded Zookeeper for test purposes. We enabled SSL and Authentication, and we are able to see the admin working fine with authentication. But queries through the UI or otherwise is failing with the following error. Request your help to resolve the

RESTORE does not create replica as defined

ation factor updated correction in the collection view, but in the Admin UI cloud view we see only one replica is created. 4. Try restart of Solr, still the same issue, the collection is restored but replica is not automatically created. Is this a known issue in Solr Restore? Regards, Ganesh

Re: RESTORE does not create replica as defined

Any help on this is much appreciated. On Wed, Feb 6, 2019 at 11:10 AM Ganesh Sethuraman wrote: > Hi > > We are using Solr Cloud 7.2.1. We are using the backup and restore > features, and we finding that the restore is not working as expected. The > restore is successful, but does

how to get high-availability for Solr csv update handler?

r for efficiency. 2. I can write a solrj client to update, but i am not sure if i will get the efficiency of bulk update? not sure about the simplicity of the curl as well. Any best practices for the same would be good to have. Regards Ganesh

Re: how to get high-availability for Solr csv update handler?

. Regarding the Solrj option, it certainly seems to be best option, do we have the python solr client to it which can be Solr Leader aware? like how it is done in the solrj (java) client. Regards, Ganesh On Mon, Feb 25, 2019 at 3:00 PM Shawn Heisey wrote: > On 2/25/2019 11:15 AM, Ganesh Sethura

Python Client for Solr Cloud - Leader aware

Ganesh

Solr streaming expression - options for Full Outer Join

I would to perform full outer join (emit documents from both left and right and if there are common combine them) with solr streaming decorators on two collections and "update" it to a new destination collection. I see merge decorator option exists, but this seems to return two JSON document for s

Re: Solr streaming expression - options for Full Outer Join

one typo in the above streaming expression sort, it is "id asc" in the collection col1 On Tue, Feb 13, 2018 at 1:38 PM, Ganesh Sethuraman wrote: > > I would to perform full outer join (emit documents from both left and > right and if there are common combine them)

Re: Solr streaming expression - options for Full Outer Join

Also want to add, i am trying to do this on Solr 7.2.1 On Tue, Feb 13, 2018 at 1:38 PM, Ganesh Sethuraman wrote: > > I would to perform full outer join (emit documents from both left and > right and if there are common combine them) with solr streaming decorators > on two col

Solr streaming expression - options for Full Outer Join

I am using Solr 7.2.1. I would to perform full outer join (emit documents from both left and right and if there are common combine them) with solr streaming decorators on two collections and "update" it to a new destination collection. I see "merge" decorator option exists, but this seems to retu

solr cloud unique key query request is sent to all shards!

y issue as unnecessarily all shards are being queried to get one document (by unique key). http://:8080/solr/col1/select?debug=true&q=id:69749278 Is there a way to query to reach the right shard based on the has of the unique key? Regards Ganesh

Re: solr cloud unique key query request is sent to all shards!

omas Fernandez Lobbe wrote: > I think real-time get should be directed to the correct shard. Try: > [COLLECTION]/get?id=[YOUR_ID] > > Sent from my iPhone > > > On Feb 18, 2018, at 3:17 PM, Ganesh Sethuraman > wrote: > > > > Hi > > > > I am using So

Re: solr cloud unique key query request is sent to all shards!

t; the unique key. > > The request should be in your case: http://:8080/api/ > collections/col1/get?id=69749398 > > See: https://lucene.apache.org/solr/guide/7_2/realtime-get.html > > Sent from my iPhone > > > On Feb 18, 2018, at 9:28 PM, Ganesh Sethuraman > wrote: &

Re: Solr 7.2 cannot see all running nodes

may be you can check int he Admin UI --> Cloud --> Tree --> /live_nodes. To see the list of live nodes before running. If it is less than what you expected, check the Zoo keeper logs? or make sure connectivity between the shards and zookeeper. On Thu, Mar 29, 2018 at 10:25 AM, Abhi Basu <9000r...@

Re: solr can't find my config set when creating a new collection

A Step before creation the schema, the config needs to be uploaded to the zoo keeper. You might want to upconfig bin/solr zk upconfig -n -d more details here... https://lucene.apache.org/solr/guide/6_6/using-zookeeper-to-manage-configuration-files.html Regards Ganesh On Sun, Apr 29, 2018 at 7

Linux command to print top slow performing query (/get) from solr logs

Is there a way to print using Linux commands to print top slow performing queries from Solr 7 logs (/get handler or /select handler)? In the reverse sorted order across log files will be very useful and handy to trouble shoot Regards Ganesh

Change/Override Solrconfig.xml across collections

this is not possible, is it possible to update only the solrconfig.xml into zookeeper for each collection, without the schema update? i have both schema and solrconfig.xml in the same directory Regards Ganesh

Re: CSVResponseWriter doesnt return non-stored field even when docValues is enabled

Yes, i have the same problem too. DocValues=True and Stored as false does not come out in CSV. It works fine in JSON format. On Fri, Jul 6, 2018 at 6:37 PM, Karthikeyan Shanmugasundaram < ksundaram...@gmail.com> wrote: > Yea i just tried again and below is the info, > > - Solr/Lucene Version

SolrCloud degraded during backup and batch CSV update

Hi We are using SolrCloud 7.2.1 with 3 node Zookeeper ensemble. We have 92 collection each on avg. having 8 shards and 2 replica with 2 EC2 nodes, with JVM size of 18GB (G1 GC). We need your help with the Issue we faced today: The issue is SolrCloud server went into a degraded collections (for

RE: SolrCloud degraded during backup and batch CSV update

increase the timeout setting in Solr or Zookeeper, if you can share parameters it will certainly help Regards Ganesh -Original Message- From: matthew sporleder Sent: Wednesday, April 29, 2020 11:47 AM To: solr-user@lucene.apache.org Subject: Re: SolrCloud degraded during backup and batch CSV

Re: SolrCloud degraded during backup and batch CSV update

Any other JVM settings change possible? On Tue, Apr 28, 2020, 10:15 PM Sethuraman, Ganesh wrote: > Hi > > We are using SolrCloud 7.2.1 with 3 node Zookeeper ensemble. We have 92 > collection each on avg. having 8 shards and 2 replica with 2 EC2 nodes, > with JVM size of 18GB (

Response Time Diff between Collection with low deletes

it once at the end? Regards, Ganesh

Re: Response Time Diff between Collection with low deletes

ed in your solr logs to insure > that the difference isn’t outside of Solr. > > While I can’t say what the exact problem is, I’m 99% sure that the number > of deleted docs isn’t the culprit. > > Best, > Erick > > > On May 9, 2020, at 6:22 PM, Ganesh Sethuraman > wr

Re: Response Time Diff between Collection with low deletes

have high response time, it is noticeable when test duration is small, the response time improve when the test is for longer duration. Hope this information helps. Regards Ganesh Regards Ganesh On Sun, May 10, 2020, 8:14 PM Shawn Heisey wrote: > On 5/10/2020 4:48 PM, Ganesh Sethuraman wr

Re: Response Time Diff between Collection with low deletes

As detailed below. The collection where we have issues have 16 shards with 2 replica each. On Sun, May 10, 2020, 9:10 PM matthew sporleder wrote: > Why so many shards? > > > On May 10, 2020, at 9:09 PM, Ganesh Sethuraman > wrote: > > > > We are using ded

Re: Terraform and EC2

to create a security group to attach to both zookeeper and solr. Ganesh On Thu, May 14, 2020, 7:57 PM Walter Underwood wrote: > Anybody building sharded clusters with Terraform on EC2? I’d love some > hints. > > wunder > Walter Underwood > wun...@wunderwood.org > http://ob

JMX metrics for solr cloud cluster state

replica down, etc? I couldn't find any metric on Solr documents. Regards Ganesh

Re: JMX metrics for solr cloud cluster state

ion I have found JMX in solr to be crazy > > unreliable but the admin/metrics web endpoint is pretty good. > > > > I have some (crappy) python for parsing it for datadog: > > https://github.com/msporleder/dd-solrcloud you might be able to ship > > something similar to in

Solr JVM performance challenge with Updates

No Problem GC Report https://gceasy.io/my-gc-report.jsp?p=YXJjaGl2ZWQvMjAxOS8xMC85Ly0tMDJfX3NvbHJfZ2MubG9nLjIuY3VycmVudC0tMjAtNDQtMjY=&channel=WEB Thanks &Regards, Ganesh

Solr JVM Turning - 7.2.1

8bf12437597198dec42771b3e%7C0%7C0%7C637068324577120430&sdata=AOqgAgpgBWri3a77%2F9I6JdrGzNkUpLltUdiZA056zPc%3D&reserved=0> Any help on the above question appreciated. Thanks &Regards, Ganesh

RE: Solr JVM Turning - 7.2.1

Solr Users, Any suggestion or insights on the Solr behavior will help. Regards Ganesh -Original Message- From: Sethuraman, Ganesh Sent: Wednesday, October 16, 2019 9:25 PM To: solr-user@lucene.apache.org Subject: Solr JVM Turning - 7.2.1 CAUTION: This email originated from outside

RE: Solr JVM Turning - 7.2.1 - with solrj updates

Dear Solr Users, appreciate any insight on this performance issue below. -Original Message- From: Sethuraman, Ganesh Sent: Wednesday, October 16, 2019 9:25 PM To: solr-user@lucene.apache.org Subject: Solr JVM Turning - 7.2.1 CAUTION: This email originated from outside of D&a

CDCR support with solr version 4.10.3

Hi Solr Team, We are using apache solr 4.10.3 version along with CDH 5.4.8. We like to know that the Cross Data Center Replication (CDCR) support with the solr version 4.10.3 We

SOLRJ 7.x library fails ejb deployment with weblogic

Hi Team, We have an ejb application and deployment in weblogic cluster where the application uses SOLRJ java client to communicate with SOLR. Previously we were using solrj 5.4 and it was working fine. Recently we enabled kerberos in our cluster so we forced to upgrade

RE: SOLRJ 7.x library fails ejb deployment with weblogic

cluster. Since keberozied authentication classes are available only from solrj7.x Thanks & Regards, J.Ganesh Kumar. From: Jan Høydahl [mailto:jan@cominvent.com] Sent: 21 August 2018 17:12 To: solr-user Cc: Ganesh Kumar J Subject: Re: SOLRJ 7.x library fails ejb deployment with weblogic