Re: Indexing Halts for long time and then restarts

2012-03-16 Thread Erick Erickson
Flattery will get you a lot ... Yeah, I expect you're hitting a merge issue. To test, set up autocommit to only trigger after a lot of docs are committed. You should see the time before the big pause change radically (perhaps disappear if you don't commit until the run is done). Note that it'll s

Indexing Halts for long time and then restarts

2012-03-16 Thread Husain, Yavar
Since Erick is really active answering now so posting a quick question :) I am using: DIH Solr 3.5 on Windows Building Auto Recommendation Utility Having around 1 Billion Query Strings (3-6 words each) in database. Indexing them using NGram. Merge Factor = 30 Auto Commit not set. DIH halted a