Dear all,
We start to upgrade a huge SolrCloud cluster from 5.4.1 to lastest version
8.5.1.
Context :
. Ubuntu 16.04, 64b, JVM Oracle 8 101 and now OpenJDK 8 252
. We can't reindex documents because old ones doesn't exist anymore, so no
other choices than upgrading indexes.
Our upgrading strategy is based on indexUpgrader Tool.
5.4.1 -> 5.5.5 : Ok
5.5.5 -> 6.6.6 : Ok
6.6.6 -> 7.7.3 : ok
Unable to upgrade 7.7.3 to 8.5.1 : here my problem using 8.5.1,
indexUpgrader :
Exception in thread "main" org.apache.lucene.index.IndexFormatTooOldException:
Format version is not supported (resource
BufferedChecksumIndexInput(MMapIndexInput(path="/data2/solr/nodes/node1/solr/insight_dw_shard3_replica_n69/data/index/segments_2nz0"))):
This index was initially created with Lucene 6.x while the current version is
8.5.1 and Lucene only supports reading the current and previous major
versions.. This version of Lucene only supports indexes created with release
7.0 and later.
at
org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:318)
at
org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:289)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:432)
at org.apache.lucene.index.SegmentInfos$1.doBody(SegmentInfos.java:429)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:680)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:632)
at
org.apache.lucene.index.SegmentInfos.readLatestCommit(SegmentInfos.java:434)
at
org.apache.lucene.index.DirectoryReader.listCommits(DirectoryReader.java:285)
at org.apache.lucene.index.IndexUpgrader.upgrade(IndexUpgrader.java:158)
at org.apache.lucene.index.IndexUpgrader.main(IndexUpgrader.java:78)
But when I check the index version with 7.7.3, the segment seems to be 7.7.3!
0.00% total deletions; 50756501 documents; 0 deleteions
Segments file=segments_2nz0 numSegments=1 version=7.7.3
id=ay2stfke7hwy9gippl8k77tdd userData={commitTimeMSec=1589314850951}
1 of 1: name=_2rr9t maxDoc=50756501
version=7.7.3
id=9pubpiwgt38rzyxr7litvgcu5
codec=Lucene70
compound=false
numFiles=10
size (MB)=338,143.905
diagnostics = {os=Linux, java.vendor=Oracle Corporation,
java.version=1.8.0_101, java.vm.version=25.101-b13, lucene.version=7.7.3,
mergeMaxNumSegments=1, os.arch=amd64, java.runtime.version=1.8.0_101-b13,
source=merge, mergeFactor=2, os.version=3.13.0-147-generic,
timestamp=1589484981711}
no deletions
test: open reader.........OK [took 2.779 sec]
When I read the different thread, some people say that when a segment is
"marked as v6 lucene index", this mark remains across upgrading, so we are
stucked in 7.7.3 version.
What are my options?
Many many thanks for your help,
Jean-Louis
Jean-Louis Vila, PhD
Directeur technique
Sword SAS
d +33 4 72 85 37 60
m +33 6 17 81 14 69
t +33 4 72 85 37 40
e
[email protected]<mailto:[email protected]>
9 avenue Charles de Gaulle
69771, Saint Didier au Mont d'Or
France
www.sword-group.com<http://www.sword-group.com/>
P Pensez à l'environnement avant d'imprimer ce message / Please consider the
environment before printing this mail note.
Ce message et toutes les pièces jointes (ci-après le "message") sont établis à
l'intention exclusive de ses destinataires et sont confidentiels. Si vous
recevez ce message par erreur, merci de le détruire et d'en avertir
immédiatement l'expéditeur. Toute utilisation de ce message non conforme à sa
destination, toute diffusion ou toute publication, totale ou partielle, est
interdite, sauf autorisation expresse. Internet ne permettant pas d'assurer
l'intégrité de ce message, le Groupe Sword (et ses filiales) décline(nt) toute
responsabilité au titre de ce message, dans l'hypothèse où il aurait été
modifié, altéré ou falsifié. Le Groupe Sword vous remercie de votre attention.
