Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread ~$alpha`
When both solr4 and solr6 have concurrent hits: 1. 30 to 40 : Avg response time 470ms vs 380ms Load 6 vs 10 1. 80 to 90 : Avg response time 500ms vs 620ms (solr6 performing bad on peak hours) Load 11 vs 25 -- Sent from: http://lucene.472066.n3.nabble.c

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Greg Roodt
Thank you both for your very detailed answers. This is great to know. I knew that SolrJ had the cluster aware knowledge (via zookeeper), but I was wondering what something like curl would do. Great to know that internally the cluster will proxy queries to the appropriate place regardless. I am ru

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Tomas Fernandez Lobbe
On the last question: For Writes: Yes. Writes are going to be sent to the shard leader, and since PULL replicas can’t be leaders, it’s going to be a TLOG replica. If you are using CloudSolrClient, then this routing will be done directly from the client (since it will send the update to the lead

Re: Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Erick Erickson
Talking a little out of my depth here as I haven't ben in that code, so if there are corrections they're welcome. In general, there's nothing special between TLOG and PULL replicas in terms of query routing. For that matter, nothing special about either of these .vs. NRT replicas for _queries_. S

Request routing / load-balancing TLOG & PULL replica types

2018-02-11 Thread Greg Roodt
Hi I have a question around how queries are routed and load-balanced in a cluster of mixed TLOG and PULL replicas. I thought that I might have to put a load-balancer in front of the PULL replicas and direct queries at them manually as nodes are added and removed as PULL replicas. However, it seem

Re: Hard commits blocked | non-solrcloud v6.6.2

2018-02-11 Thread mmb1234
> https://github.com/mohsinbeg/datadump/tree/master/solr58f449cec94a2c75_core_256 I had uploaded the output at the above link. The OS has no swap configured. There are other processes on the host but <1GB or <5% CPU cumulatively but none inside the docker as `top` shows. Solr JVM heap is at 30GB

Re: Collection API Snapshots and Restore

2018-02-11 Thread Nicolas Bélisle
Thanks for the quick response. I tried the following and it works. 1. Take a snapshot of your index : http://localhost:8983/solr/admin/collections?action=CREATESNAPSHOT&collection= &commitName=backup1 2. Add a few documents. 3. List the files for the snapshot : http://localhost:8983/solr/admin/co

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Also can you please post the throughputs for both of your tests On 12 Feb 2018 00:35, "Deepak Goel" wrote: > Yup. Improvement of response time would hurt the cpu usage. The other > thing is more memory usage (cache) which gets included into the cpu usage. > > > > Deepak > "Please stop cruelty to

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Yup. Improvement of response time would hurt the cpu usage. The other thing is more memory usage (cache) which gets included into the cpu usage. Deepak "Please stop cruelty to Animals, help by becoming a Vegan" +91 73500 12833 deic...@gmail.com Facebook: https://www.facebook.com/deicool LinkedI

Solr4 To Solr6 CPU load issues

2018-02-11 Thread Birender Rawat
I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but overall the CPU load on solr6.6 is double the load on solr4.0 and hence I am not able to roll solr6.6 to 100% of my traffic. *Some Key Stats In Performance of Sol6 Vs Solr4* Document cache usage increased from .98 from .14

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread ~$alpha`
Other resource is not using the cpu. Its true that response is better to 300ms from 350ms but cpu usage almost doubled? -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Two things trouble me: 1. It is a shared resource, so results are unreliable 2. Since cache results have increased, memory access will increase and it will result in an increase in cpu usage. However response times will also improve To support more load you will have to increase server capacity

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread ~$alpha`
Config : 64GB RAM 32 CORE CPU but i have given 20Gb to solr JVM.. Also its a shared resource -- Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html

Re: Hard commits blocked | non-solrcloud v6.6.2

2018-02-11 Thread Shawn Heisey
On 2/10/2018 11:58 PM, mmb1234 wrote: Only `top` available on Photon OS is https://github.com/vmware/photon/blob/1.0/SPECS/procps-ng/procps-ng.spec. Those screenshots are attached. Attachments rarely make it to the mailing list.  I don't see any attachments. This is an example of what I am l

Re: Solr4 To Solr6 CPU load issues

2018-02-11 Thread Deepak Goel
Can you please give the configuration of your server? On 11 Feb 2018 19:17, "~$alpha`" wrote: > I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but > overall the CPU load on solr6.6 is double the load on solr4.0 and hence I > am > not able to roll solr6.6 to 100% of my tr

Re: Multi words query time synonyms

2018-02-11 Thread Dominique Bejean
Steve, According to your comment, I made this test : 1/ put the SynonymGraphFilterFactory after the StopFilterFactory in query time analyze chain 2/ remove the stop word in the synonyms file om, olympique marseille The parsed query s

Solr4 To Solr6 CPU load issues

2018-02-11 Thread ~$alpha`
I have upgraded Solr4.0 Beta to Solr6.6. The Cache results look Awesome but overall the CPU load on solr6.6 is double the load on solr4.0 and hence I am not able to roll solr6.6 to 100% of my traffic. *Some Key Stats In Performance of Sol6 Vs Solr4* Document cache usage increased from .98 from .14

Re: Multi words query time synonyms

2018-02-11 Thread Dominique Bejean
Hi Steve, Thank you for your response. The Jira was created : SOLR-11968 I let you add your comments. Regards. Dominique Le sam. 10 févr. 2018 à 20:30, Steve Rowe a écrit : > Hi Dominique, > > Looks like it’s a bug, not sure where exactly though. Can you please > create a JIRA? > > I can s