Re: Retrieval of large number of documents

2012-09-12 Thread Alexandre Rafalovitch
Have you tried asking for CSV as an output format? Then, you don't have any XML wrappers and you will get your IDs one per line. I tried it with returning about 40 rows and it was just fine. Regards, Alex. Personal blog: http://blog.outerthoughts.com/ LinkedIn: http://www.linkedin.com/in/al

Re: Retrieval of large number of documents

2012-09-12 Thread Paul Libbrecht
Isn't XSLT the bottleneck here? I have not yet met an incremental XSLT processor, although I heard XSLT 1 claimed it could be done in principle. If you start to do this kind of processing, I think you have no other choice than write your own output method. Paul Le 12 sept. 2012 à 15:47, Rohit

Retrieval of large number of documents

2012-09-12 Thread Rohit Harchandani
Hi all, I have a solr index with 5,000,000 documents and my index size is 38GB. But when I query for about 400,000 documents based on certain criteria, solr searches it really quickly but does not return data for close to 2 minutes. The unique key field is the only field i am requesting for. Also,