On Sun, Mar 15, 2015 at 12:09 PM, Erick Erickson <erickerick...@gmail.com> wrote: > 1> Well, probably not. Hate to be confusing here, but if your ramBufferSizeMB > setting is exceeded, then internal buffers will be flushed to the > currently open segment in the > index directory.
It's even more confusing though... if you do a few adds and then do a soft commit, a new small segment will be created and flushed to the Directory, but not fsync'd. But by default, the directory we use is NRTCachingDirectory which caches small segments in memory, so those small segments won't even get written to disk until a hard commit forces them out of the cache. -Yonik > You still won't be able to search it since no commits > happened. You > really have little control over when this happens. > > And, to make it more confusing still, if your process abnormally terminates, > these docs _still_ won't be searchable when the node comes back up until > they're > replayed from the transaction log. Since the segment was never closed, the > docs > are invisible. But since they were in the tlog, they'll be recovered. Unclosed > segment files will be cleaned up though. > > So usually you're right, an update won't change anything in the index > directory. > Except sometimes ;). > > The net-net here is that if you're NOT issuing any commits for a long > time, you'll > see the tlog grow pretty steadily, _and_ upon occasion you'll see step-wise > jumps in the size of the index directory. > > 2> Nothing. This is just making stuff in the not-yet-committed state available > for searching, all in memory. > > 3> Not quite sure what you're asking here. The doc will be in memory > and the tlog, > optionally it may have been flushed to the current index segment > (although still not > searchable). > > > Best, > Erick > > On Sun, Mar 15, 2015 at 7:11 AM, vidit.asthana <vidit.astha...@gmail.com> > wrote: >> Thanks for reply Yonik. I am very new to solrcloud and trying to understand >> how the update requests are handled and what exactly happens at file system >> level. >> >> 1. So lets say I send an update request, and I don't issue any type of >> commit(neither hard nor soft), so will the document ever touch index >> directory? From the blog, I understand that it gets written to tlog >> directory. >> >> 2. Now if I issue a soft commit, then what will happen inside the index >> directory? >> >> 3. By the time I don't issue a soft commit, where will that document >> reside(completely in memory)? >> >> >> >> -- >> View this message in context: >> http://lucene.472066.n3.nabble.com/Solr-tlog-and-soft-commit-tp4193105p4193109.html >> Sent from the Solr - User mailing list archive at Nabble.com.
