Re: Solr queries slow down over time

2020-09-25 Thread Goutham Tholpadi
Hi Mark, Thanks for confirming Dwane's advice from your own experience. I will shift to a streaming expressions implementation. Best Goutham On Fri, Sep 25, 2020 at 7:03 PM Mark H. Wood wrote: > On Fri, Sep 25, 2020 at 11:49:22AM +0530, Goutham Tholpadi wrote: > > I have around 30M documents in

Re: Solr queries slow down over time

2020-09-25 Thread Goutham Tholpadi
Thanks a ton, Dwane. I went through the article and the documentation link. This corresponds exactly to my use case. Best Goutham On Fri, Sep 25, 2020 at 2:59 PM Dwane Hall wrote: > Goutham I suggest you read Hossman's excellent article on deep paging and > why returning rows=(some large number

Re: solr performance with >1 NUMAs

2020-09-25 Thread Shawn Heisey
On 9/23/2020 7:42 PM, Wei wrote: Recently we deployed solr 8.4.1 on a batch of new servers with 2 NUMAs. I noticed that query latency almost doubled compared to deployment on single NUMA machines. Not sure what's causing the huge difference. Is there any tuning to boost the performance on multipl

Re: solr performance with >1 NUMAs

2020-09-25 Thread Wei
Thanks Dominique. I'll start with the -XX:+UseNUMA option. Best, Wei On Fri, Sep 25, 2020 at 7:04 AM Dominique Bejean wrote: > Hi, > > This would be a Java VM option, not something Solr itself can know about. > Take a look at this article in comments. May be it will help. > > https://blog.theta

Re: Solr 8.6.2 UI issue

2020-09-25 Thread Alexandre Rafalovitch
Sounds strange. If you had Solr installed previously, it could be cached Javascript. Force-reload or try doing it in an anonymous window. Also try starting with an example (solr/start -e techproducts). Finally, if you are up to it, see if there are any serious errors in the Browser's developer co

Solr 8.6.2 UI issue

2020-09-25 Thread Manisha Rahatadkar
Hello All I downloaded 8.6.2 and running it on windows 10 machine. Solr starts on 8983 port but whenever I click on any menu like Logging, Core Admin, Query it always shows only dashboard screen. Has anyone experienced this issue? Regards Manisha Rahatadkar Confidentiality Notice

SOLR Cursor Pagination Issue

2020-09-25 Thread vmakovsky
Good afternoon, Could you please suggest us a solution: during data updating process in solrCloud, requests with cursor mark return incorrect data. I suppose that the results do not follow each other during the indexation process, because the data doesn't have enough time to be replicated betwe

Re: Delete from Solr console fails

2020-09-25 Thread Dominique Bejean
Hi Goutham, I agree with Rahul, avoid large deletebyquery. It you can, prefere one query to get all the ids first than use ids with deletebyid Regards Dominique Le ven. 25 sept. 2020 à 06:50, Goutham Tholpadi a écrit : > I spoke too soon. I am getting the "Connection lost" error again. > > I

Re: solr performance with >1 NUMAs

2020-09-25 Thread Dominique Bejean
Hi, This would be a Java VM option, not something Solr itself can know about. Take a look at this article in comments. May be it will help. https://blog.thetaphi.de/2012/07/use-lucenes-mmapdirectory-on-64bit.html?showComment=1347033706559#c229885263664926125 Regards Dominique Le jeu. 24 sept.

Re: Solr 8.6.2 text_general

2020-09-25 Thread Erick Erickson
Uhhh, this is really dangerous. If you’ve indexed documents since upgrading, some were indexed with multiValued=false. Now you’ve changed the definition at a fundamental Lucene level and Things Can Go Wrong. You’re OK if (and only if) you have indexed _no_ documents since you upgraded. But

Re: Solr queries slow down over time

2020-09-25 Thread Mark H. Wood
On Fri, Sep 25, 2020 at 11:49:22AM +0530, Goutham Tholpadi wrote: > I have around 30M documents in Solr, and I am doing repeated *:* queries > with rows=1, and changing start to 0, 1, 2, and so on, in a > loop in my script (using pysolr). > > At the start of the iteration, the calls to

Re: Solr 8.6.2 text_general

2020-09-25 Thread Anuj Bhargava
It worked. I just added multiValued="true". Thanks for all your help. Regards, Anuj On Fri, 25 Sep 2020 at 18:08, Alexandre Rafalovitch wrote: > Ok, something is definitely not right. In those cases, I suggest > checking backwards from hard reality. Just in case the file you

Re: Solr 8.6.2 text_general

2020-09-25 Thread Alexandre Rafalovitch
Ok, something is definitely not right. In those cases, I suggest checking backwards from hard reality. Just in case the file you are looking at is NOT the one that is actually used when collection is actually setup. Happened to me more times than I can count. Point your Admin UI to the collection

Re: Any blog or url that explain step by step configure grafana dashboard to monitor solr metrics

2020-09-25 Thread Emir Arnautović
Hi, In case you decide to go with cloud solution, you can check how you can monitor Solr with Sematext: https://sematext.com/blog/solr-monitoring-made-easy-with-sematext/ Regards, Emir -- Monitoring - Log Management - Alerting

Re: Solr queries slow down over time

2020-09-25 Thread Dwane Hall
Goutham I suggest you read Hossman's excellent article on deep paging and why returning rows=(some large number) is a bad idea. It provides an thorough overview of the concept and will explain it better than I ever could (https://lucidworks.com/post/coming-soon-to-solr-efficient-cursor-based-ite

Re: Solr 8.6.2 text_general

2020-09-25 Thread Anuj Bhargava
Schema on both are the same Regards, Anuj On Thu, 24 Sep 2020 at 18:58, Alexandre Rafalovitch wrote: > These are field definitions for _text_ and text, your original > question was about the fields named "country"/"currency" and whatever > type they mapped to. > > Your text/_t