Re: httpclient.ProtocolException using Solrj

2009-04-16 Thread Otis Gospodnetic
.org > Sent: Thursday, April 9, 2009 5:47:11 PM > Subject: Re: httpclient.ProtocolException using Solrj > > Here is what I'm doing, > > SolrServer server = new StreamingUpdateSolrServer(url, 1000,5); > > server.addBeans(dataList); //where dataList is Listwith 10K elemen

Re: httpclient.ProtocolException using Solrj

2009-04-09 Thread vivek sar
Here is what I'm doing, SolrServer server = new StreamingUpdateSolrServer(url, 1000,5); server.addBeans(dataList); //where dataList is List with 10K elements I run two threads each using the same server object and then each call server.addBeans(...). I'm able to get 50K/sec inserted using that

Re: httpclient.ProtocolException using Solrj

2009-04-09 Thread Shalin Shekhar Mangar
On Thu, Apr 9, 2009 at 10:36 PM, vivek sar wrote: > I'm inserting 10K in a batch (using addBeans method). I read somewhere > in the wiki that it's better to use the same instance of SolrServer > for better performance. Would MultiThreadedConnectionManager help? How > do I use it? > If you are no

Re: httpclient.ProtocolException using Solrj

2009-04-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
using a single request is the fatest http://wiki.apache.org/solr/Solrj#head-2046bbaba3759b6efd0e33e93f5502038c01ac65 I could index at the rate of 10,000 docs/sec using this and BinaryRequestWriter On Thu, Apr 9, 2009 at 10:36 PM, vivek sar wrote: > I'm inserting 10K in a batch (using addBeans m

Re: httpclient.ProtocolException using Solrj

2009-04-09 Thread vivek sar
I'm inserting 10K in a batch (using addBeans method). I read somewhere in the wiki that it's better to use the same instance of SolrServer for better performance. Would MultiThreadedConnectionManager help? How do I use it? I also wanted to know how can use EmbeddedSolrServer - does my app needs to

Re: httpclient.ProtocolException using Solrj

2009-04-09 Thread Noble Paul നോബിള്‍ नोब्ळ्
how many documents are you inserting ? may be you can create multiple instances of CommonshttpSolrServer and upload in parallel On Thu, Apr 9, 2009 at 11:58 AM, vivek sar wrote: > Thanks Shalin and Paul. > > I'm not using MultipartRequest. I do share the same SolrServer between > two threads. I'

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread vivek sar
Thanks Shalin and Paul. I'm not using MultipartRequest. I do share the same SolrServer between two threads. I'm not using MultiThreadedHttpConnectionManager. I'm simply using CommonsHttpSolrServer to create the SolrServer. I've also tried StreamingUpdateSolrServer, which works much faster, but doe

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread Shalin Shekhar Mangar
Vivek, do you share the same SolrServer instance between your two threads? If so, are you using the MultiThreadedHttpConnectionManager when creating the HttpClient instance? On Wed, Apr 8, 2009 at 10:13 PM, vivek sar wrote: > single thread everything works fine. Two threads are fine too for a >

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread Noble Paul നോബിള്‍ नोब्ळ्
are you using multipartrequest? if you are using the latest solrj can you try with the batch add method add(Iterator ) or add(Iterator ) On Wed, Apr 8, 2009 at 10:13 PM, vivek sar wrote: > single thread everything works fine. Two threads are fine too for a > while and all the sudden problem s

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread vivek sar
single thread everything works fine. Two threads are fine too for a while and all the sudden problem starts happening. I tried indexing using REST services as well (instead of Solrj), but with that too I get following error after a while, 2009-04-08 10:04:08,126 ERROR [indexerThreadPool-5] Indexe

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread Noble Paul നോബിള്‍ नोब्ळ्
do you see the same problem when you use a single thread? what is the version of SolrJ that you use? On Wed, Apr 8, 2009 at 1:19 PM, vivek sar wrote: > Hi, > >  Any ideas on this issue? I ran into this again - once it starts > happening it keeps happening. One of the thread keeps failing. Here

Re: httpclient.ProtocolException using Solrj

2009-04-08 Thread vivek sar
Hi, Any ideas on this issue? I ran into this again - once it starts happening it keeps happening. One of the thread keeps failing. Here are my SolrServer settings, int socketTO = 0; int connectionTO = 100; int maxConnectionPerHost = 10; int maxTotalConnection = 50

httpclient.ProtocolException using Solrj

2009-04-04 Thread vivek sar
Hi, I'm sending 15K records at once using Solrj (server.addBeans(...)) and have two threads writing to same index. One thread goes fine, but the second thread always fails with, org.apache.solr.client.solrj.SolrServerException: org.apache.commons.httpclient.ProtocolException: Unbuffered entity