Hello Qingdi,
Have you changed the "<useCompoundFile>" setting in solrconfig.xml?
In my experience, when using compound-file index
("<useCompoundFile>true</useCompoundFile>"),
the size of index grows up to triple during optimization.
My understanding is that when writing a new segment in compound format,
Lucene writes the multifile format first and then creates the compound index.
So in the state immediately before optimization ends the size almost triples.
Regards,
Ryuuichi Kumai.
2009/1/28 Qingdi <qin...@nextbio.com>:
>
>
> Hi,
>
> Starting about one week ago, our index size gets tripled during
> optimization.
>
> The current index statistics are:
> numDocs : 192702132
> size: 76G
> And we do optimization for every 6M docs update.
>
> Since we keep getting new data, the index size increases every day. Before,
> the index size was only doubled during optimization.
>
> Why the index size gets tripled instead of doubled during optimization? Is
> there anything we can do to keep the index only doubled during optimization?
>
> Thanks.
>
> Qingdi
> --
> View this message in context:
> http://www.nabble.com/index-size-tripled-during-optimization-tp21691596p21691596.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>
