Re: How to reduce the search speed of solrcloud

2014-04-08 Thread Sathya
Hi All, I found that which is taking more time. It is *server.query* SolrDataDAO dataDao = new SolrDataDAO(); QueryResponse resp = dataDao.queryData(0, 1, subject); SolrDocumentList data = resp.getResults(); System.out.println("len " + data.size()); System.out.println(); Subject is passed to he

Re: How to reduce the search speed of solrcloud

2014-04-08 Thread Sathya
Hi Anshum, I am using Solr 4.7. And i follow this tutorialto setup a solrcloud. I have only one collection in my solr. Kindly let me, if u need more details. On Fri, Apr 4, 2014 at 11:19 PM, Anshum Gupta [via Lucene] < ml-no

Re: How to reduce the search speed of solrcloud

2014-04-06 Thread Sathya
Hi, I use this link to setup a solrcloud http://myjeeva.com/solrcloud-cluster-single-collection-deployment.html And i use 5 different machine to setup this cloud. I use Unique id. On Sat, Apr 5, 2014 at 6:30 AM, Alexandre Rafalovitch [via Lucene] < ml-node+s472066n4129333...@n3.nabble.com> wrote

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Alexandre Rafalovitch
And 50 million records of 3 fields each should not become 50Gb of data. Something smells wrong there. Do you have unique IDs setup? Regards, Alex. Personal website: http://www.outerthoughts.com/ Current project: http://www.solr-start.com/ - Accelerating your Solr proficiency On Sat, Apr 5, 20

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Anshum Gupta
I am not sure if you setup your SolrCloud right. Can you also provide me with the version of Solr that you're running. Also, if you could tell me about how did you setup your SolrCloud cluster. Are the times consistent? Is this the only collection on the cluster? Also, if I am getting it right, yo

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya
Hi shawn, I have indexed 50 million data in 5 servers. 3 servers have 8gb ram. One have 24gb and another one have 64gb ram. I was allocate 4 gb ram to solr in each machine. I am using solrcloud. My total index size is 50gb including 5 servers. Each server have 3 zookeepers. Still I didnt check abo

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Shawn Heisey
On 4/4/2014 1:31 AM, Sathya wrote: > Hi All, > > Hi All, I am new to Solr. And i dont know how to increase the search speed > of solrcloud. I have indexed nearly 4 GB of data. When i am searching a > document using java with solrj, solr takes more 6 seconds to return a query > result. Any one plea

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Alexandre Rafalovitch
You said your request is 6 seconds when going through the SolrJ client. But it is 1 second (1000 ms) when going directly to Solr bypassing the SolrJ. So, the other 5 seconds must be added outside of Solr. Concentrate on that. Regarding your schema, you used example schema that has a lot of stuff y

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya
Hi, Sorry, i cant get u alex. Can you please explain me(if you can). Because now only i entered into solr. On Fri, Apr 4, 2014 at 2:20 PM, Alexandre Rafalovitch [via Lucene] < ml-node+s472066n4129077...@n3.nabble.com> wrote: > Well, if the direct browser query is 1000ms and your client query i

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Alexandre Rafalovitch
Well, if the direct browser query is 1000ms and your client query is 6seconds, then it is not Solr itself you need to worry about first. Something must be wrong at the client. Trying timing that bit. Maybe it is writing from the client to your ultimate consumer that's the problem. Regards, Alex

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya
Hi, I have attached my schema.xml file too. And you are right. I have 50 million documents. When i use solr browser to search a document, it will return within 1000 to 2000 ms. My query looks like this: http://10.10.1.14:5050/solr/set_recent_shard1_replica5/select?q=subject&indent=true On 4/4/1

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Alexandre Rafalovitch
What does your Solr query looks like (check the Solr backend log if you don't know)? And how many document is that? 50 million? Does not sound like much for 3 fields. And what's the definitions (schema.xml rather than solr.xml). And what happens if you issue the query directly to Solr rather than

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Sathya
Hi Alex, 33026985 Component Audio\:A Shopping List 2012-01-11 09:02:42.96 This is what i am indexed in solr. I have only 3 fields in index. And i am just indexing id, subject and date of the news articles. Nearly 5 crore documents. Also i have attached my solrconfig and solr.xml file. If u need

Re: How to reduce the search speed of solrcloud

2014-04-04 Thread Alexandre Rafalovitch
Show a sample query string that does that (takes 6 seconds to return). Including all defaults you may have put in solrconfig.xml (if any). That might give us a hint which features you are using and what possible direction you could go in next. For the bonus points, enable debug flag and rows=1 para