On 10/15/2012 8:06 PM, Michael Ryan wrote:
Easiest way I know of without parsing any of the index files is to take the
size of the fdx file in bytes and divide by 8. This will give you the exact
number of documents before 4.0, and a close approximation in 4.0.
Though, the fdx file might not be on disk if you haven't committed.
When you are importing 12 million documentsfrom a database, you get LOTS
of completed segments even if there is no commit until the end. The
ramBuffer fills up pretty quick.
I intend to figure out how many documents are in the segments
(ramBufferSizeMB=256) and try out an autoCommit setting a little bit
lower than that. I had trouble with autoCommit on previous versions,
but with 4.0 I can turn off openSearcher, which may allow it to work right.
Thanks,
Shawn
