Re: Need Debug Direction on Performance Problem

2015-01-18 Thread Naresh Yadav
Toke, won't be able to use TermsComponent as i had complex filter criteria on other fields. Michael, i understood your idea of paging without using start=, will prototype it as it is possible in my usecase also and post here results i got with this approach. On Sun, Jan 18, 2015 at 10:05 PM, Mich

Re: Need Debug Direction on Performance Problem

2015-01-18 Thread Michael Sokolov
You can also implement your own cursor easily enough if you have a unique sortkey (not relevance score). Say you can sort by id, then you select batch 1 (50k docs, say) and record the last (maximum) id in the batch. For the next batch, limit it to id > last_id and get the first 50k docs (don't

RE: Need Debug Direction on Performance Problem

2015-01-18 Thread Toke Eskildsen
Naresh Yadav [nyadav@gmail.com] wrote: > Thanks for sharing solr internal's for my problem. I will definitely try > Cursor also but only problem is my current > solr version is 4.6.1 in which i guess cursor support is not there. I thinkt it was added in 4.7, so you are right that it will proba

Re: Need Debug Direction on Performance Problem

2015-01-18 Thread Naresh Yadav
Hi Toke, Thanks for sharing solr internal's for my problem. I will definitely try Cursor also but only problem is my current solr version is 4.6.1 in which i guess cursor support is not there. Any other option i have for this problem ?? Also as per your suggestion i will try to avoid regional uni

RE: Need Debug Direction on Performance Problem

2015-01-18 Thread Toke Eskildsen
Naresh Yadav [nyadav@gmail.com] wrote: > In both setups, we are reading in batches of 50k and each batch taking > Setup1 : approx 7 seconds and for completing all batches of total 10 lakh > results takes 1 to 2 minutes. > Setup2 : approx 2-3 minutes and for completing all batches of total 10 l