Re: Solr Query Slowliness

2013-12-27 Thread Jilal Oussama
Thank you guys for your replies, Sorry that I forgot to mention that I have allocated 10 GB of memory to the Java Heap. 2013/12/26 Shawn Heisey > On 12/26/2013 3:38 AM, Jilal Oussama wrote: > > Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB > memory > > & 840 GB storage)

Re: Solr Query Slowliness

2013-12-26 Thread Shawn Heisey
On 12/26/2013 3:38 AM, Jilal Oussama wrote: > Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB memory > & 840 GB storage) and contained several cores for different usage. > > When I manually executed a query through Solr Admin (a query containing > 10~15 terms, with some of the

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! It seems that the number of queries per second generated by your scripts may be too much for your Solr cluster to handle with the latency you want. Try launching your scripts one by one and see what is the bottle neck with your instance. I assume that for some number of scripts running at

Re: Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
This an example of a query: http://myip:8080/solr/TestCatMatch_shard12_replica1/select?q=Royal+Cashmere+RC+106+CS+Silk+Cashmere+V+Neck+Moss+Green+Men ^10+s+Sweater+Cashmere^3+Men^3+Sweaters^3+Clothing^3&rows=1&wt=json&indent=true in return : { "responseHeader":{ "status":0, "QTime":191

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! Different queries can have different execution time, that's why I asked about the details. When running the scripts, is Solr CPU fully utilized? To tell more I would like to see what queries are run against Solr from scripts. Do you have any information on network throughput between the se

Re: Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
Thanks Rafal for your reply, My scripts are running on other independent machines so they does not affect Solr, I did mention that the queries are not the same (that is why I removed the query cache from solrconfig.xml), and I only get 1 result from Solr (which is the top scored one so no sorting

Re: Solr Query Slowliness

2013-12-26 Thread Rafał Kuć
Hello! Could you tell us more about your scripts? What they do? If the queries are the same? How many results you fetch with your scripts and so on. -- Regards, Rafał Kuć Performance Monitoring * Log Analytics * Search Analytics Solr & Elasticsearch Support * http://sematext.com/ > Hi all, >

Solr Query Slowliness

2013-12-26 Thread Jilal Oussama
Hi all, I have multiple python scripts querying solr with the sunburnt module. Solr was hosted on an Amazon ec2 m1.large (2 vCPU with 4 ECU, 7.5 GB memory & 840 GB storage) and contained several cores for different usage. When I manually executed a query through Solr Admin (a query containing 10