Hi,
Brief Description of my application:
We have a java program which reads a flat file, and adds document to solr
using cloudsolrserver.
And we index for every 1000 documents(bulk indexing).
And the Autocommit setting of my application is:
<autoCommit>
<maxDocs>100000</maxDocs>
<openSearcher>false</openSearcher>
</autoCommit>
So after every 100,000 documents are indexed, engine should perform a
HardCommit/AutoCommit. But still the OpenSearcher will be false.
Once the file is fully read, we are issuing a commit() from the
CloudSolrServer class. So this by default opens a new Searcher.
Also, from the Log, i can see that three times, Autocommit is happenning.
and Only with the last/final Autocommit, opensearcher is set to true.
So, till now all looks fine and working as expected.
But one strange issue i observed during the course of indexing.
Now, as per the documentation, the data that is being indexed should first
get written into tlog. When the Autocommit is performed, the data will be
flushed to disk.
So only at three times, there should have been size difference in the /index
folder. All the time only the size of the /tlog folder should have been
changing
But actually happened is, all the time, i see the size of the /index folder
getting increased in parallel to the size of the /tlog folder.
Actually it is increasing to certain limit and coming down. Again increasing
and coming down to a point.
So Now the bigger doubt is have is, during hard commit, is the data getting
written into both /index or /tlog folder??
I am using solr 4.5.1.
Some one please clear me how the hardcommit works. I am asumming the
following sequence:
1. Reads the data and writes to tlog
2. During hardcommit, flushes the data from tlog to index. If openSearcher
is false, should not open a new searcher
3. In the end, once all the datas are indexed, it should open a new
searcher.
If not please explain me..
Thanks in Advance
Radha
--
View this message in context:
http://lucene.472066.n3.nabble.com/The-way-Autocommit-works-in-solr-Wierd-tp4122558.html
Sent from the Solr - User mailing list archive at Nabble.com.
