Re: index size tripled during optimization

2009-01-28 Thread Shalin Shekhar Mangar
Does you index stay at triple size after optimization? It is normal for Lucene to use 2x or upto 3x disk space during optimization but it should fall back to the normal numbers once optimization completes and unused segments are cleaned up due the index deletion policy. If you search for threads i

Re: index size tripled during optimization

2009-01-28 Thread Qingdi
Hi Ryuuichi, Thanks for your quick reply. I checked the setting of in solrconfig.xml, and the value is 'false'. Here is what in our solrconfig.xml. === false 1000 1 2147483647 10 1000

Re: index size tripled during optimization

2009-01-28 Thread Ryuuichi KUMAI
Hello Qingdi, Have you changed the "" setting in solrconfig.xml? In my experience, when using compound-file index ("true"), the size of index grows up to triple during optimization. My understanding is that when writing a new segment in compound format, Lucene writes the multifile format first and