Re: Commits taking too long

2009-05-13 Thread vivek sar
Hi, This problem is still haunting us. I've reduced the merge factor to 50, but as my index get fat (anything over 20G), the commit starts taking much longer. Some info, 1) Less than 20 G index size, 5000 records commit takes around 15sec 2) Over 20G the commit starts taking 50-70sec for 5K rec

Re: Commits taking too long

2009-04-15 Thread Mark Miller
vivek sar wrote: Hi, I've index where I commit every 50K records (using Solrj). Usually this commit takes 20sec to complete, but every now and then the commit takes way too long - from 10 min to 30 min. I see more delays as the index size continues to grow - once it gets over 5G I start seeing

Commits taking too long

2009-04-15 Thread vivek sar
Hi, I've index where I commit every 50K records (using Solrj). Usually this commit takes 20sec to complete, but every now and then the commit takes way too long - from 10 min to 30 min. I see more delays as the index size continues to grow - once it gets over 5G I start seeing long commit cycles