Re: CDCR performance issues

2018-03-23 Thread Tom Peters
etty sure CDCR uses HTTP/HTTPS rather than just TCP, so also >> check whether some proxy/load balancer between data centers is causing it >> to be a single connection per operation. That will *kill* performance. >> Some proxies default to HTTP/1.0 (open, send request, server send >> respo

Re: CDCR performance issues

2018-03-23 Thread Susheel Kumar
AM, Davis, Daniel (NIH/NLM) [C] < > > > > daniel.da...@nih.gov> wrote: > > > > >>> > > > > >>> These are general guidelines, I've done loads of networking, but > > may > > > > be less familiar with SolrCloud and CDC

Re: CDCR performance issues

2018-03-23 Thread Amrit Sarkar
centers using ping or > TCP > > > ping. Throughput tests may be high, but if Solr has to wait for a > > > response to a request before sending the next action, then just like > any > > > network protocol that does that, it will get slow. > > > >>&g

Re: CDCR performance issues

2018-03-23 Thread Susheel Kumar
st like any > > network protocol that does that, it will get slow. > > >>> > > >>> I'm pretty sure CDCR uses HTTP/HTTPS rather than just TCP, so also > > check whether some proxy/load balancer between data centers is causing it > > to be a single

Re: CDCR performance issues

2018-03-23 Thread Amrit Sarkar
hat will *kill* performance. > Some proxies default to HTTP/1.0 (open, send request, server send > response, close), and that will hurt. > >>> > >>> Why you should listen to me even without SolrCloud knowledge - > checkout paper "Latency performance of SOAP I

Re: CDCR performance issues

2018-03-12 Thread Tom Peters
roxies default to HTTP/1.0 (open, send request, server send response, >>> close), and that will hurt. >>> >>> Why you should listen to me even without SolrCloud knowledge - checkout >>> paper "Latency performance of SOAP Implementations". Same distr

Re: CDCR performance issues

2018-03-12 Thread Tom Peters
aper "Latency performance of SOAP Implementations". Same distribution of >> skills - I knew TCP well, but Apache Axis 1.1 not so well. I still >> improved response time of Apache Axis 1.1 by 250ms per call with 1-line of >> code. >> >> -Or

Re: CDCR performance issues

2018-03-09 Thread Erick Erickson
ten to me even without SolrCloud knowledge - checkout >>> paper "Latency performance of SOAP Implementations". Same distribution of >>> skills - I knew TCP well, but Apache Axis 1.1 not so well. I still >>> improved response time of Apache Axis 1.1 by 250ms

Re: CDCR performance issues

2018-03-09 Thread john spooner
s [mailto:tpet...@synacor.com] Sent: Wednesday, March 7, 2018 6:19 PM To: solr-user@lucene.apache.org Subject: CDCR performance issues I'm having issues with the target collection staying up-to-date with indexing from the source collection using CDCR. This is what I'm getting back in

Re: CDCR performance issues

2018-03-09 Thread Tom Peters
- > From: Tom Peters [mailto:tpet...@synacor.com] > Sent: Wednesday, March 7, 2018 6:19 PM > To: solr-user@lucene.apache.org > Subject: CDCR performance issues > > I'm having issues with the target collection staying up-to-date with indexing > from the source collection

RE: CDCR performance issues

2018-03-09 Thread Davis, Daniel (NIH/NLM) [C]
ednesday, March 7, 2018 6:19 PM To: solr-user@lucene.apache.org Subject: CDCR performance issues I'm having issues with the target collection staying up-to-date with indexing from the source collection using CDCR. This is what I'm getting back in terms of OPS: curl -s 'solr2-

Re: CDCR performance issues

2018-03-08 Thread Tom Peters
So I'm continuing to look into this and not making much headway, but I have additional questions now as well. I restarted the nodes in the source data center to see if it would have any impact. It appeared to initiate another bootstrap with the target. The lag and queueSize were brought back do

CDCR performance issues

2018-03-07 Thread Tom Peters
I'm having issues with the target collection staying up-to-date with indexing from the source collection using CDCR. This is what I'm getting back in terms of OPS: curl -s 'solr2-a:8080/solr/mycollection/cdcr?action=OPS' | jq . { "responseHeader": { "status": 0, "Q