On 1/30/2013 11:21 AM, adityab wrote:
Shawn,
i believe your point is valid ... if you see below my tlog.* file size is
huge. Bu shouldn't that be cleared if i am not using soft commit and do an
explicit hard commit?
After deleting this i was able to get my server up. Thanks for the
information/help. Also pleae let me know how to avoid such situation. For
now i can work with manually deleting the log but cant do it all the time.
[root@awbmmv030 tlog]# pwd
/storage/solrdata/tlog
[root@awbmmv030 tlog]# ls -l
total 27624908
-rw-r--r-- 1 root root 28260272185 Jan 29 15:44 tlog.0000000000000000001
[root@awbmmv030 tlog]#
I imagine that the reason that you do a large amount of indexing without
any commits is that you don't want the clients to see any change until
the entire index run is complete.
If you use autoCommit but make openSearcher false, then a hard commit
will be automatically performed every time you reach maxDocs or maxTime
milliseconds. What the openSearcher value of false does is make it so
the same IndexSearcher will continue to be used -- no change will be
visible to clients making queries, even if one of the things you do is
delete all documents before adding new documents.
I'm currently using a maxDocs of 25000 and a maxTime of 300000 (five
minutes). I don't think it ever takes five minutes to index 25000
documents.
Thanks,
Shawn
