But look what you're asking Solr to do. 250K queries. Let's say you get 100 QPS, which for a single box isn't bad. That's still 2,500 seconds, roughly 40 minutes.
But you still haven't told us what QPS you're seeing. Or what you need to see. Or what kind of results you need from your queries. Perhaps you can index differently to speed things up.... I don't think you're going to get all these queries to run through a single box quickly, no matter what you do. It's a matter of deciding whether you're willing to wait or whether you can set up a series of machines running Solr and get some parallelism going. Best Erick On Fri, Oct 5, 2012 at 4:05 PM, Sushil jain <jain.ayushm...@gmail.com> wrote: > Thank you Erick for your quick response. > Yes, you are right about my problem. > > and indexes are on same machine and yes I am using single machine > I am using EmbeddedSolrServer class of SolrJ which removes HTTP layer. > But still it takes time. > > > On Fri, Oct 5, 2012 at 10:19 PM, Erick Erickson > <erickerick...@gmail.com>wrote: > >> Here's a reference, much of it is at the Lucene layer, but >> it might be helpful. >> >> http://wiki.apache.org/lucene-java/ImproveSearchingSpeed >> >> If I'm reading this right, you want to get through 250K queries. >> What kind of throughput are you seeing? What is your target >> speed? >> >> I suspect you're going to be kind of stuck if you require this to >> be on a single machine. If you want to get through this many >> queries as fast as possible, you're probably talking about >> putting Solr on a bunch of machines, fronting them with a >> load balancer, and having your client fire off these multiple >> threads to the load balancer. Essentially pretending you're >> a public site and want to increase capacity, the same >> strategies apply. >> >> Best >> Erick >> >> On Fri, Oct 5, 2012 at 12:33 PM, Sushil jain <jain.ayushm...@gmail.com> >> wrote: >> > Hi, >> > >> > I am using EmbeddedSolrServer to access indexed data. >> > >> > I have to query server around 250K with different query each time. >> > >> > I have already created queries. But every time querying solr takes time. >> > >> > As I am querying using threads and loop, but still it's not so fast. >> > >> > Is there any way to speed up this operations ? >> > >> > >> > Thanks & Regards, >> > Sushil Jain >>
