Hi Qingdi, Hm, I've never encountered this problem. You didn't mention your Solr version. If I were you I would grab the nightly build tomorrow, because tonight's Solr nightly build should include the very latest Lucene jars. Of course, this means running Solr 1.4-dev.
Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch ________________________________ From: Qingdi <qin...@nextbio.com> To: solr-user@lucene.apache.org Sent: Tuesday, February 10, 2009 2:07:44 PM Subject: optimization failed Our index size is about 60G. Most of the time, the optimization works fine. But this morning, the optimization kept creating new segment files until all the free disk space (300G) was used up. Here is how the files generated during optimization look like: ============================================ .................................... -rw-r--r-- 1 root root 213464 Feb 10 07:33 _5w9a.tis -rw-r--r-- 1 root root 3039 Feb 10 07:33 _5w9a.tii -rw-r--r-- 1 root root 9360 Feb 10 07:33 _5w9a.prx -rw-r--r-- 1 root root 19824 Feb 10 07:33 _5w9a.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w9a.fnm -rw-r--r-- 1 root root 74884 Feb 10 07:33 _5w9a.fdx -rw-r--r-- 1 root root 3753944 Feb 10 07:33 _5w9a.fdt -rw-r--r-- 1 root root 212513 Feb 10 07:33 _5w99.tis -rw-r--r-- 1 root root 3005 Feb 10 07:33 _5w99.tii -rw-r--r-- 1 root root 9436 Feb 10 07:33 _5w99.prx -rw-r--r-- 1 root root 20052 Feb 10 07:33 _5w99.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w99.fnm -rw-r--r-- 1 root root 75492 Feb 10 07:33 _5w99.fdx -rw-r--r-- 1 root root 3795439 Feb 10 07:33 _5w99.fdt -rw-r--r-- 1 root root 215726 Feb 10 07:33 _5w98.tis -rw-r--r-- 1 root root 2994 Feb 10 07:33 _5w98.tii -rw-r--r-- 1 root root 9438 Feb 10 07:33 _5w98.prx -rw-r--r-- 1 root root 20058 Feb 10 07:33 _5w98.frq -rw-r--r-- 1 root root 27 Feb 10 07:33 _5w98.fnm -rw-r--r-- 1 root root 75508 Feb 10 07:33 _5w98.fdx -rw-r--r-- 1 root root 3779402 Feb 10 07:33 _5w98.fdt .................................... ============================================ This is the third time we encountered this issue. Any idea why the optimization keeps creating new files? (If we restart the solr server and run optimization again, the index files can be recovered.) Please let me know if you need more info.. Appreciate your help. Qingdi -- View this message in context: http://www.nabble.com/optimization-failed-tp21939498p21939498.html Sent from the Solr - User mailing list archive at Nabble.com.
