Re: Delete by query or Id very slow

2010-12-10 Thread bbarani
terms wont get refreshed unless you optimize your index.. Thanks, Barani -- View this message in context: http://lucene.472066.n3.nabble.com/Delete-by-query-or-Id-very-slow-tp2053699p2067952.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Delete by query or Id very slow

2010-12-09 Thread Tom Hill
I'd bet it's the optimize that's taking the time, and not the delete. You don't really need to optimize these days, and you certainly don't need to do it on every delete. And you can give solr a list of ids to delete, which would be more efficient. I don't believe you can tell which ones have fai

Re: Delete by query or Id very slow

2010-12-09 Thread Ravi Kiran
Thank you Tom for responding. On an average the docs are around 25-35 KB. The code is as follows, Kindly let me know if you see anything weird, a second pair of eyes always helps :-) public List deleteDocs(List ids) throws SolrCustomException { CommonsHttpSolrServer server = (CommonsHt

Re: Delete by query or Id very slow

2010-12-08 Thread Tom Hill
That''s a pretty low number of documents for auto complete. It means that when getting to 850,000 documents, you will create 8500 segments, and that's not counting merges. How big are your documents? I just created an 850,000 document (and a 3.5 m doc index) with tiny documents (id and title), and

Delete by query or Id very slow

2010-12-08 Thread Ravi Kiran
Hello, Iam using solr 1.4.1 when I delete by query or Id from solrj it is very very slow almost like a hang. The core form which Iam deleting has close to 850K documents in the index. In the solrconfig.xml autocommit is set as follows. Any idea how to speed up the deletion process. Pl