Re: Solr TCP layer

2015-03-12 Thread Yago Riveiro
an you >> describe the benefits to Solr users of http/2? >> >> Do you expect HTTP/2 to be transparent at the application layer? >> >> -Original Message----- >> From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] >> Sent: Monday, March 09, 2015 6:

Re: Solr TCP layer

2015-03-10 Thread Shawn Heisey
On 3/10/2015 12:13 PM, Saumitra Srivastav wrote: > Now we want to do the same with Solr. While I do realize that this is going > to be a lot of work, but if its something that will reap benefit in long > run, then so be it. Datastax provides a netty based layer in their > enterprise version which f

Re: Solr TCP layer

2015-03-10 Thread Walter Underwood
I would strongly recommend taking a look at HTTP/2. It might not be fast enough for you, but it is fast enough for Google and there are already implementations. http://http2.github.io/faq/ wunder Walter Underwood wun...@wunderwood.org http://observer.wunderwood.org/ (my blog) On Mar 10, 2015,

Re: Solr TCP layer

2015-03-10 Thread Erick Erickson
Saumitra: We certainly don't mean to be overly discouraging, so have at it! There has been some talk of using Netty in the future as we pull the war-file distribution out of the distro. Now, I have no technical clue about the merits .vs. TCP. But that's another possibility you might want to put in

Re: Solr TCP layer

2015-03-10 Thread Saumitra Srivastav
Thanks everyone for the responses. My motivation for TCP is coming from a very heavy indexing pipeline where the smallest of optimization matters. I am working on a machine data parser which feeds data into Cassandra and Solr and we have SLAs based on how fast we can make data available in both th

Re: Solr TCP layer

2015-03-10 Thread Erick Erickson
efits to Solr users of http/2? > > Do you expect HTTP/2 to be transparent at the application layer? > > -Original Message- > From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] > Sent: Monday, March 09, 2015 6:23 AM > To: solr-user@lucene.apache.org > Su

RE: Solr TCP layer

2015-03-09 Thread Reitzel, Charles
ginal Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Monday, March 09, 2015 6:23 AM To: solr-user@lucene.apache.org Subject: Re: Solr TCP layer Hi Saumitra, I've been thinking of adding http/2 support for inter node communication initially and cli

Re: Solr TCP layer

2015-03-09 Thread Shalin Shekhar Mangar
Hi Saumitra, I've been thinking of adding http/2 support for inter node communication initially and client server communication next in Solr. There's a patch for SPDY support but now that spdy is deprecated and http/2 is the new standard we need to wait for Jetty 9.3 to release. That will take car

Re: Solr TCP layer

2015-03-08 Thread Walter Underwood
I agree. I have some servers that use a TCP socket protocol and they are beastly hard to monitor, load-balance, all that stuff. HTTP rules. I need a really big advantage to recommend a non-HTTP server. Understand that I helped design at least one socket protocol, HP JetDirect. This was designed

Re: Solr TCP layer

2015-03-08 Thread Shawn Heisey
On 3/8/2015 2:05 PM, Saumitra Srivastav wrote: > I want to start working on adding a TCP layer for client to node and > inter-node communication. > > I am not up to date on recent changes happening to Solr. So before I start > looking into code, I would like to know if there is already some work d