Got it. Last question on this topic (maybe), wouldn't a commit at the very end take too long on a 1 billion items? Wouldn't a commit every, lets say 10,000 items be more efficient?
Steve On Thu, Mar 10, 2016 at 5:44 PM, Shawn Heisey <apa...@elyograg.org> wrote: > On 3/10/2016 3:29 PM, Steven White wrote: > > Thanks you for your insight Shawn, they are always valuable. > > > > Question, if I wait to the very end to issue a commit, wouldn't that > mean I > > could lose everything if there was an OOM or some other server issue? I > > don't have any commit setting set in my solrconfig.xml. > > This should not be a worry. The transaction log should keep everything > safe. > > As I said before, no matter what your intentions with commits are, you > do want to have autoCommit with openSearcher set to false and a > reasonably long maxTime. I recommend one minute or five minutes, but > you will see 15 seconds commonly recommended. I use the longer time > because I don't want Solr to be spending a lot of time doing commits. A > commit that doesn't open a new searcher is pretty quick, but it still > requires CPU/memory/IO resources. > > Thanks, > Shawn > >
