Anticipating your next question “why can’t you use an index created 2 or more versions ago”, these two quotes were helpful for me to get my head around it. It’s _always_ been the case that going from X to X+2 has been unsupported, it’s just that the failures wouldn’t necessarily be obvious. Lucene tries mightily to have version X handle X-1 created indexes, but trying to go back farther would lead to horribly complex code if it could be done at all.
Oh, and IndexUpgraderTool (IUT) is fairly horrible in that it really does an optimize down to one segment with all the problems that entails, see: https://lucidworks.com/2017/10/13/segment-merging-deleted-documents-optimize-may-bad/. This discussion is about “optimize”, which is what the IUT does, and that’s still true for Solr 7.5+ From Robert Muir: “I think the key issue here is Lucene is an index not a database. Because it is a lossy index and does not retain all of the user's data, its not possible to safely migrate some things automagically. In the norms case IndexWriter needs to re-analyze the text ("re-index") and compute stats to get back the value, so it can be re-encoded. The function is y = f(x) and if x is not available its not possible, so lucene can't do it.” From Mike McCandless: “This really is the difference between an index and a database: we do not store, precisely, the original documents. We store an efficient derived/computed index from them. Yes, Solr/ES can add database-like behavior where they hold the true original source of the document and use that to rebuild Lucene indices over time. But Lucene really is just a "search index" and we need to be free to make important improvements with time.” Best, Erick > On May 22, 2019, at 3:48 AM, Jan Høydahl <jan....@cominvent.com> wrote: > > Same as I answered in SOLR-13487: > > Note that you'll probably need to re-index from scratch due to changes in > 8.0, see > https://builds.apache.org/view/L/view/Lucene/job/Solr-reference-guide-8.0/javadoc/indexupgrader-tool.html > > <https://builds.apache.org/view/L/view/Lucene/job/Solr-reference-guide-8.0/javadoc/indexupgrader-tool.html> > : > If you are currently using a release two or more major versions older, such > as moving from Solr 6x to Solr 8x, you will need to reindex your content. > > See your error message. Does not matter if you upgraded from 6-7, Lucene 8 > will still complain since it sees that the index was first created with 6.x: > >> This index was initially created with Lucene 6.x while the current version >> is 8.1.0 and Lucene only supports reading the current and previous major >> versions.. This version of Lucene only supports indexes created with >> release 7.0 and later. > > > -- > Jan Høydahl, search solution architect > Cominvent AS - www.cominvent.com > >> 22. mai 2019 kl. 11:36 skrev Henrik B A <henrik.aron...@gmail.com>: >> >> I'm trying to upgrade a index from Lucene 6.x to 7.x, and then to 8.x, >> using IndexUpgrader [1]. But it never successfully upgrades to 7, and I >> cannot figure out why. >> >> I've also tried using CheckIndex [2] with the -exorcise option to fix the >> index first, but that doesn't help. >> >> Any ideas? I've added console output at the end of this mail. >> >> Cheers, >> Henrik >> >> [1] https://lucene.apache.org/solr/guide/7_7/indexupgrader-tool.html >> [2] >> https://lucene.apache.org/core/7_1_0/core/org/apache/lucene/index/CheckIndex.html#main-java.lang.String:A- >> >> >> >> user@dev-appsolr2535:/home/user> java -cp >> '/opt/common/apps/apache-solr-7.7.1/server/solr-webapp/webapp/WEB-INF/lib/*' >> org.apache.lucene.index.IndexUpgrader -delete-prior-commits -verbose >> /opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index >> IFD 0 [2019-05-22T09:24:14.317Z; main]: init: current segments file is >> "segments_505t"; >> deletionPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy@29774679 >> IFD 0 [2019-05-22T09:24:14.336Z; main]: init: load commit "segments_505t" >> IFD 0 [2019-05-22T09:24:14.346Z; main]: init: seg=_11nw3 set >> nextWriteFieldInfosGen=134 vs current=1 >> IFD 0 [2019-05-22T09:24:14.347Z; main]: init: seg=_11nw3 set >> nextWriteDocValuesGen=134 vs current=1 >> IFD 0 [2019-05-22T09:24:14.358Z; main]: now checkpoint >> "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" >> [5 segments ; isCommit = false] >> IFD 0 [2019-05-22T09:24:14.358Z; main]: 11 msec to checkpoint >> IW 0 [2019-05-22T09:24:14.359Z; main]: init: create=false reader=null >> IW 0 [2019-05-22T09:24:14.362Z; main]: >> dir=MMapDirectory@/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index >> lockFactory=org.apache.lucene.store.NativeFSLockFactory@14bf9759 >> index=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> version=7.7.1 >> analyzer=null >> ramBufferSizeMB=16.0 >> maxBufferedDocs=-1 >> mergedSegmentWarmer=null >> delPolicy=org.apache.lucene.index.KeepOnlyLastCommitDeletionPolicy >> commit=null >> openMode=CREATE_OR_APPEND >> similarity=org.apache.lucene.search.similarities.BM25Similarity >> mergeScheduler=ConcurrentMergeScheduler: maxThreadCount=-1, >> maxMergeCount=-1, ioThrottle=true >> codec=Lucene70 >> infoStream=org.apache.lucene.util.PrintStreamInfoStream >> mergePolicy=UpgradeIndexMergePolicy([TieredMergePolicy: maxMergeAtOnce=10, >> maxMergeAtOnceExplicit=30, maxMergedSegmentMB=5120.0, floorSegmentMB=2.0, >> forceMergeDeletesPctAllowed=10.0, segmentsPerTier=10.0, >> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1, >> deletesPctAllowed=33.0) >> indexerThreadPool=org.apache.lucene.index.DocumentsWriterPerThreadPool@5f341870 >> readerPooling=true >> perThreadHardLimitMB=1945 >> useCompoundFile=true >> commitOnClose=true >> indexSort=null >> checkPendingFlushOnUpdate=true >> softDeletesField=null >> writer=org.apache.lucene.index.IndexWriter@553f17c >> >> IW 0 [2019-05-22T09:24:14.363Z; main]: MMapDirectory.UNMAP_SUPPORTED=true >> IndexUpgrader 0 [2019-05-22T09:24:14.363Z; main]: Upgrading all pre-7.7.1 >> segments of index directory >> 'MMapDirectory@/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index >> lockFactory=org.apache.lucene.store.NativeFSLockFactory@14bf9759' to >> version 7.7.1... >> IW 0 [2019-05-22T09:24:14.364Z; main]: forceMerge: index now >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> IW 0 [2019-05-22T09:24:14.364Z; main]: now flush at forceMerge >> IW 0 [2019-05-22T09:24:14.364Z; main]: start flush: applyAllDeletes=true >> IW 0 [2019-05-22T09:24:14.365Z; main]: index before flush >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> DW 0 [2019-05-22T09:24:14.365Z; main]: startFullFlush >> DW 0 [2019-05-22T09:24:14.367Z; main]: main finishFullFlush success=true >> IW 0 [2019-05-22T09:24:14.367Z; main]: now apply all deletes for all >> segments buffered updates bytesUsed=0 reader pool bytesUsed=0 >> BD 0 [2019-05-22T09:24:14.367Z; main]: waitApply: no deletes to apply >> MP 0 [2019-05-22T09:24:14.368Z; main]: findForcedMerges: >> segmentsToUpgrade={} >> MS 0 [2019-05-22T09:24:14.371Z; main]: initDynamicDefaults spins=true >> maxThreadCount=1 maxMergeCount=6 >> MS 0 [2019-05-22T09:24:14.372Z; main]: now merge >> MS 0 [2019-05-22T09:24:14.372Z; main]: index: >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> MS 0 [2019-05-22T09:24:14.372Z; main]: no more merges pending; now return >> IndexUpgrader 0 [2019-05-22T09:24:14.372Z; main]: All segments upgraded to >> version 7.7.1 >> IndexUpgrader 0 [2019-05-22T09:24:14.373Z; main]: Enforcing commit to >> rewrite all index metadata... >> IW 0 [2019-05-22T09:24:14.373Z; main]: commit: start >> IW 0 [2019-05-22T09:24:14.373Z; main]: commit: enter lock >> IW 0 [2019-05-22T09:24:14.373Z; main]: commit: now prepare >> IW 0 [2019-05-22T09:24:14.373Z; main]: prepareCommit: flush >> IW 0 [2019-05-22T09:24:14.374Z; main]: index before flush >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> DW 0 [2019-05-22T09:24:14.374Z; main]: startFullFlush >> IW 0 [2019-05-22T09:24:14.374Z; main]: now apply all deletes for all >> segments buffered updates bytesUsed=0 reader pool bytesUsed=0 >> BD 0 [2019-05-22T09:24:14.375Z; main]: waitApply: no deletes to apply >> DW 0 [2019-05-22T09:24:14.375Z; main]: main finishFullFlush success=true >> IW 0 [2019-05-22T09:24:14.375Z; main]: startCommit(): start >> IW 0 [2019-05-22T09:24:14.376Z; main]: startCommit >> index=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> changeCount=2 >> IW 0 [2019-05-22T09:24:14.382Z; main]: startCommit: wrote pending segments >> file "pending_segments_505u" >> IW 0 [2019-05-22T09:24:14.387Z; main]: done all syncs: [_11oa0.si, >> _11oa0.fdx, _11nw3_3p.liv, _11oa0_Lucene50_0.doc, _11nw3.nvd, _11oa0.fdt, >> _11oa1_Lucene50_0.doc, _11nw3.si, _11o9p.cfe, _11nw3_Lucene50_0.pos, >> _11oa1.fdx, _11nw3_Lucene50_0.tim, _11nw3_Lucene50_0.tip, _11oa1.fdt, >> _11nw3.fdx, _11oa0_Lucene50_0.pos, _11oa1.fnm, _11oa1.nvm, _11oa1.si, >> _11nw3.fdt, _11o9p.cfs, _11oa0.nvd, _11o9z.si, _11o9z.cfs, >> _11oa0_Lucene50_0.tim, _11o9p.si, _11oa0_Lucene50_0.tip, >> _11oa1_Lucene50_0.tim, _11nw3.fnm, _11nw3.nvm, _11oa1_Lucene50_0.pos, >> _11oa1.nvd, _11o9z.cfe, _11oa1_Lucene50_0.tip, _11nw3_Lucene50_0.doc, >> _11oa0.fnm, _11oa0.nvm] >> IW 0 [2019-05-22T09:24:14.388Z; main]: commit: pendingCommit != null >> IW 0 [2019-05-22T09:24:14.389Z; main]: commit: done writing segments file >> "segments_505u" >> IFD 0 [2019-05-22T09:24:14.390Z; main]: now checkpoint >> "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" >> [5 segments ; isCommit = true] >> IFD 0 [2019-05-22T09:24:14.390Z; main]: deleteCommits: now decRef commit >> "segments_505t" >> IFD 0 [2019-05-22T09:24:14.391Z; main]: delete [segments_505t] >> IFD 0 [2019-05-22T09:24:14.391Z; main]: 1 msec to checkpoint >> IW 0 [2019-05-22T09:24:14.400Z; main]: commit: took 18.0 msec >> IW 0 [2019-05-22T09:24:14.401Z; main]: commit: done >> IndexUpgrader 0 [2019-05-22T09:24:14.401Z; main]: Committed upgraded >> metadata to index. >> IW 0 [2019-05-22T09:24:14.401Z; main]: now flush at close >> IW 0 [2019-05-22T09:24:14.401Z; main]: start flush: applyAllDeletes=true >> IW 0 [2019-05-22T09:24:14.401Z; main]: index before flush >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> DW 0 [2019-05-22T09:24:14.402Z; main]: startFullFlush >> DW 0 [2019-05-22T09:24:14.402Z; main]: main finishFullFlush success=true >> IW 0 [2019-05-22T09:24:14.402Z; main]: now apply all deletes for all >> segments buffered updates bytesUsed=0 reader pool bytesUsed=0 >> BD 0 [2019-05-22T09:24:14.402Z; main]: waitApply: no deletes to apply >> MS 0 [2019-05-22T09:24:14.403Z; main]: updateMergeThreads ioThrottle=true >> targetMBPerSec=10240.0 MB/sec >> MS 0 [2019-05-22T09:24:14.403Z; main]: now merge >> MS 0 [2019-05-22T09:24:14.403Z; main]: index: >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> MS 0 [2019-05-22T09:24:14.404Z; main]: no more merges pending; now return >> IW 0 [2019-05-22T09:24:14.404Z; main]: waitForMerges >> IW 0 [2019-05-22T09:24:14.404Z; main]: waitForMerges done >> IW 0 [2019-05-22T09:24:14.404Z; main]: commit: start >> IW 0 [2019-05-22T09:24:14.404Z; main]: commit: enter lock >> IW 0 [2019-05-22T09:24:14.404Z; main]: commit: now prepare >> IW 0 [2019-05-22T09:24:14.405Z; main]: prepareCommit: flush >> IW 0 [2019-05-22T09:24:14.405Z; main]: index before flush >> _11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> DW 0 [2019-05-22T09:24:14.405Z; main]: startFullFlush >> IW 0 [2019-05-22T09:24:14.405Z; main]: now apply all deletes for all >> segments buffered updates bytesUsed=0 reader pool bytesUsed=0 >> BD 0 [2019-05-22T09:24:14.406Z; main]: waitApply: no deletes to apply >> DW 0 [2019-05-22T09:24:14.406Z; main]: main finishFullFlush success=true >> IW 0 [2019-05-22T09:24:14.406Z; main]: startCommit(): start >> IW 0 [2019-05-22T09:24:14.406Z; main]: skip startCommit(): no changes >> pending >> IW 0 [2019-05-22T09:24:14.407Z; main]: commit: pendingCommit == null; skip >> IW 0 [2019-05-22T09:24:14.407Z; main]: commit: took 2.2 msec >> IW 0 [2019-05-22T09:24:14.407Z; main]: commit: done >> IW 0 [2019-05-22T09:24:14.407Z; main]: rollback >> IW 0 [2019-05-22T09:24:14.407Z; main]: all running merges have aborted >> IW 0 [2019-05-22T09:24:14.408Z; main]: rollback: done finish merges >> DW 0 [2019-05-22T09:24:14.408Z; main]: abort >> DW 0 [2019-05-22T09:24:14.408Z; main]: done abort success=true >> IW 0 [2019-05-22T09:24:14.409Z; main]: rollback: >> infos=_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> IFD 0 [2019-05-22T09:24:14.409Z; main]: now checkpoint >> "_11nw3(7.7.1):C16557/1395:[diagnostics={os=Linux, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, mergeMaxNumSegments=-1, os.arch=amd64, >> java.runtime.version=11.0.1+13, source=merge, mergeFactor=10, >> os.version=3.16.0-5-amd64, >> timestamp=1558499119537}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]:delGen=133 >> _11o9p(7.7.1):c798:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507559781}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11o9z(7.7.1):c797:[diagnostics={os=Linux, java.vendor=AdoptOpenJDK, >> java.version=11.0.1, java.vm.version=11.0.1+13, lucene.version=7.7.1, >> mergeMaxNumSegments=-1, os.arch=amd64, java.runtime.version=11.0.1+13, >> source=merge, mergeFactor=10, os.version=3.16.0-5-amd64, >> timestamp=1558507739341}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa0(7.7.1):C1:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507750723}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}] >> _11oa1(7.7.1):C2:[diagnostics={java.runtime.version=11.0.1+13, >> java.vendor=AdoptOpenJDK, java.version=11.0.1, java.vm.version=11.0.1+13, >> lucene.version=7.7.1, os=Linux, os.arch=amd64, os.version=3.16.0-5-amd64, >> source=flush, >> timestamp=1558507812631}]:[attributes={Lucene50StoredFieldsFormat.mode=BEST_SPEED}]" >> [5 segments ; isCommit = false] >> IFD 0 [2019-05-22T09:24:14.410Z; main]: 0 msec to checkpoint >> >> >> user@dev-appsolr2535:/home/user> java -cp >> '/opt/common/apps/apache-solr-8.1.0/server/solr-webapp/webapp/WEB-INF/lib/*' >> org.apache.lucene.index.IndexUpgrader -delete-prior-commits -verbose >> /opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index >> IW 0 [2019-05-22T09:24:25.031Z; main]: init: hit exception on init; >> releasing write lock >> Exception in thread "main" >> org.apache.lucene.index.IndexFormatTooOldException: Format version is not >> supported (resource >> BufferedChecksumIndexInput(MMapIndexInput(path="/opt/user/solr5-prog-fhh-storage-solr/solr/prog-fhh-storage-solr_shard4_replica_n259/data/index/segments_505u"))): >> This index was initially created with Lucene 6.x while the current version >> is 8.1.0 and Lucene only supports reading the current and previous major >> versions.. This version of Lucene only supports indexes created with >> release 7.0 and later. >> at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:318) >> at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:289) >> at org.apache.lucene.index.IndexWriter.<init>(IndexWriter.java:846) >> at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:167) >> at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:78) >> user@dev-appsolr2535:/home/user> >
