Re: solr query latency spike when replicating index

2015-04-04 Thread wei
seems "sar" is not installed. This is product machine, so I can't install it. We use ssd, and the gc throughput is about 95.8. We already throttle the replication to below 20M. We also have enough memory to hold both the jvm and index in memory. I am not sure when replicating the index, if both in

Re: solr query latency spike when replicating index

2015-04-03 Thread Shalin Shekhar Mangar
In Solr 5.0 you can throttle the replication and limit the bandwidth it uses. The Sematext guys wrote a nice blog post about it. See http://blog.sematext.com/2015/01/26/solr-5-replication-throttling/ On Thu, Apr 2, 2015 at 1:53 PM, wei wrote: > I noticed the solr query latency spike on slave nod

Re: solr query latency spike when replicating index

2015-04-03 Thread Timothy Ehlers
Replication uses allot of disk io. What kind of hardware is this do you have the specs? Can you provide sar -d and sar -b outputs. What is your GC throughput like? On Apr 2, 2015 3:55 PM, "wei" wrote: > I noticed the solr query latency spike on slave node when replicating index > from master. E

solr query latency spike when replicating index

2015-04-02 Thread wei
I noticed the solr query latency spike on slave node when replicating index from master. Especially when master just finished optimization, the slave node will copy the whole index, and the latency is really bad. Is there some way to fix it? Thanks, Wei