Uhm right. I may have forgotten to mention that you do need to reload the core or maybe restart Solr server as well. If you literally just deleted the index, Solr is probably freaking out about suddenly gone files. It needs to redo the path of "is this the first time or do I reopen the indexes"
Regards, Alex. On Thu, 27 Aug 2020 at 14:29, Erick Erickson <erickerick...@gmail.com> wrote: > > “write.lock” is used by Lucene to insure that no two cores open the same > index because if they do, Bad Things Happen. > > The “NoSuchFileException” may be a bit misleading, is there any chance that > any other core is looking at the same directory? > > And your assertion: I then deleted the "data" under the > "/var/solr/data/dovecot/data", and it didn't get recreated. > makes me _strongly_ suspect that your Solr data directories aren’t where you > think they are. > > Hmmm, you start with: sudo -u solr /opt/solr/bin/solr create -c dovecot > > which makes me wonder if this is a permissions issue. What are the perms on > that directory? Is the user that > starts Solr able to write to them? > > Best, > Erick > > > > On Aug 27, 2020, at 2:13 PM, Francis Augusto Medeiros-Logeay > > <r...@med-lo.eu> wrote: > > > > Thanks Alex. > > > > Well, I just deleted the whole data, and configured it again, and get these > > errors from dovecot when indexing: > > > > doveadm(fran...@francisaugusto.com): Error: fts_solr: Indexing failed: 500 > > Server Error > > doveadm(fran...@francisaugusto.com): Error: Mailbox UOL: Mail search > > failed: Internal error occurred. Refer to server log for more information. > > [2020-08-27 20:09:36] > > doveadm(fran...@francisaugusto.com): Error: fts_solr: Indexing failed: 500 > > Server Error > > doveadm(fran...@francisaugusto.com): Error: Mailbox UOL: Transaction commit > > failed: FTS transaction commit failed: backend deinit > > doveadm(fran...@francisaugusto.com): Error: Mailbox All Mail: Mail search > > failed: Internal error occurred. Refer to server log for more information. > > [2020-08-27 20:09:36] > > doveadm(fran...@francisaugusto.com): Error: fts_solr: Indexing failed: 500 > > Server Error > > doveadm(fran...@francisaugusto.com): Error: Mailbox All Mail: Transaction > > commit failed: FTS transaction commit failed: backend deinit > > > > And so on. On Solr I see that I get two errors for each mailbox: > > > > org.apache.solr.common.SolrException: Error opening new searcher > > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2162) > > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2282) > > at > > org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:696) > > at > > org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:102) > > at > > org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:68) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1079) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1066) > > at > > org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:160) > > at > > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:281) > > at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188) > > at > > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) > > at > > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) > > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198) > > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2576) > > at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:803) > > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:582) > > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424) > > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351) > > at > > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) > > at > > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) > > at > > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) > > at > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) > > at > > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) > > at > > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) > > at > > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) > > at > > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) > > at > > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) > > at > > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:152) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at > > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at org.eclipse.jetty.server.Server.handle(Server.java:505) > > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) > > at > > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) > > at > > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) > > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) > > at > > org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) > > at > > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) > > at > > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) > > at > > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917) > > at java.base/java.lang.Thread.run(Thread.java:834) > > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter > > is closed > > at > > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681) > > at > > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695) > > at > > org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4946) > > at > > org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:293) > > at > > org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:282) > > at > > org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:260) > > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2073) > > ... 51 more > > Caused by: java.nio.file.NoSuchFileException: > > /var/solr/data/dovecot/data/index/write.lock > > at > > java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) > > at > > java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) > > at > > java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) > > at > > java.base/sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55) > > at > > java.base/sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:149) > > at > > java.base/sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99) > > at java.base/java.nio.file.Files.readAttributes(Files.java:1763) > > at > > org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:189) > > at > > org.apache.lucene.store.LockValidatingDirectoryWrapper.createOutput(LockValidatingDirectoryWrapper.java:43) > > at > > org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43) > > at > > org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:112) > > at > > org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) > > at > > org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) > > at > > org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) > > at > > org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) > > at > > org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:367) > > at > > org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:403) > > at > > org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250) > > at > > org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495) > > at > > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594) > > at > > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1586) > > at > > org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:971) > > at > > org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:344) > > at > > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291) > > at > > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:238) > > at > > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:76) > > at > > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:259) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doVersionAdd(DistributedUpdateProcessor.java:489) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.lambda$versionAdd$0(DistributedUpdateProcessor.java:339) > > at > > org.apache.solr.update.VersionBucket.runWithLock(VersionBucket.java:50) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:339) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:225) > > at > > org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103) > > at > > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261) > > ... 43 more > > > > null:org.apache.solr.common.SolrException: Error opening new searcher > > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2162) > > at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:2282) > > at > > org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:696) > > at > > org.apache.solr.update.processor.RunUpdateProcessor.processCommit(RunUpdateProcessorFactory.java:102) > > at > > org.apache.solr.update.processor.UpdateRequestProcessor.processCommit(UpdateRequestProcessor.java:68) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalCommit(DistributedUpdateProcessor.java:1079) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.processCommit(DistributedUpdateProcessor.java:1066) > > at > > org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processCommit(LogUpdateProcessorFactory.java:160) > > at > > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:281) > > at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188) > > at > > org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) > > at > > org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) > > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198) > > at org.apache.solr.core.SolrCore.execute(SolrCore.java:2576) > > at org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:803) > > at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:582) > > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424) > > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351) > > at > > org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) > > at > > org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) > > at > > org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) > > at > > org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) > > at > > org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) > > at > > org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) > > at > > org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) > > at > > org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249) > > at > > org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) > > at > > org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) > > at > > org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:152) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at > > org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335) > > at > > org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > > at org.eclipse.jetty.server.Server.handle(Server.java:505) > > at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) > > at > > org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) > > at > > org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) > > at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) > > at > > org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) > > at > > org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) > > at > > org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) > > at > > org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) > > at > > org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917) > > at java.base/java.lang.Thread.run(Thread.java:834) > > Caused by: org.apache.lucene.store.AlreadyClosedException: this IndexWriter > > is closed > > at > > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:681) > > at > > org.apache.lucene.index.IndexWriter.ensureOpen(IndexWriter.java:695) > > at > > org.apache.lucene.index.IndexWriter.nrtIsCurrent(IndexWriter.java:4946) > > at > > org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:293) > > at > > org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:282) > > at > > org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:260) > > at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:2073) > > ... 51 more > > Caused by: java.nio.file.NoSuchFileException: > > /var/solr/data/dovecot/data/index/write.lock > > at > > java.base/sun.nio.fs.UnixException.translateToIOException(UnixException.java:92) > > at > > java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:111) > > at > > java.base/sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:116) > > at > > java.base/sun.nio.fs.UnixFileAttributeViews$Basic.readAttributes(UnixFileAttributeViews.java:55) > > at > > java.base/sun.nio.fs.UnixFileSystemProvider.readAttributes(UnixFileSystemProvider.java:149) > > at > > java.base/sun.nio.fs.LinuxFileSystemProvider.readAttributes(LinuxFileSystemProvider.java:99) > > at java.base/java.nio.file.Files.readAttributes(Files.java:1763) > > at > > org.apache.lucene.store.NativeFSLockFactory$NativeFSLock.ensureValid(NativeFSLockFactory.java:189) > > at > > org.apache.lucene.store.LockValidatingDirectoryWrapper.createOutput(LockValidatingDirectoryWrapper.java:43) > > at > > org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:43) > > at > > org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(CompressingStoredFieldsWriter.java:112) > > at > > org.apache.lucene.codecs.compressing.CompressingStoredFieldsFormat.fieldsWriter(CompressingStoredFieldsFormat.java:128) > > at > > org.apache.lucene.codecs.lucene50.Lucene50StoredFieldsFormat.fieldsWriter(Lucene50StoredFieldsFormat.java:183) > > at > > org.apache.lucene.index.StoredFieldsConsumer.initStoredFieldsWriter(StoredFieldsConsumer.java:39) > > at > > org.apache.lucene.index.StoredFieldsConsumer.startDocument(StoredFieldsConsumer.java:46) > > at > > org.apache.lucene.index.DefaultIndexingChain.startStoredFields(DefaultIndexingChain.java:367) > > at > > org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:403) > > at > > org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250) > > at > > org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495) > > at > > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594) > > at > > org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1586) > > at > > org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:971) > > at > > org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:344) > > at > > org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291) > > at > > org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:238) > > at > > org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:76) > > at > > org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:259) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.doVersionAdd(DistributedUpdateProcessor.java:489) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.lambda$versionAdd$0(DistributedUpdateProcessor.java:339) > > at > > org.apache.solr.update.VersionBucket.runWithLock(VersionBucket.java:50) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:339) > > at > > org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:225) > > at > > org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103) > > at > > org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261) > > ... 43 more > > > > I then deleted the "data" under the "/var/solr/data/dovecot/data", and it > > didn't get recreated. > > > > I ran this after my installation: > > > > sudo -u solr /opt/solr/bin/solr create -c dovecot > > > > And imported the 7.7.0 schema and solrconfig from dovecot. > > > > So far, no go. Any other tips? > > > > Best, > > > > Francis > > > > > > On 2020-08-27 19:02, Alexandre Rafalovitch wrote: > >> Have you tried blowing the index directory away (usually 'data' > >> directory next to 'conf'). Because: > >> cannot change field "box" from index > >> options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index > >> options=DOCS > >> This implies that your field box had different definitions, you > >> updated it but the index files still remember the old stuff. When you > >> try to reindex, it fails as it does not know you will delete > >> everything in the end. > >> So, delete (backup/move just in case) the whole index and try again. > >> There may be other errors, but that's the first one. > >> Regards, > >> Alex. > >> On Thu, 27 Aug 2020 at 12:58, Francis Augusto Medeiros-Logeay > >> <r...@med-lo.eu> wrote: > >>> Hi, > >>> I have - for a long time now - hoped to use an fts engine with dovecot. > >>> My dovecot version is 2.3.7.2 under Ubuntu 20.04. > >>> I installed solr 7.7.3 and then 8.6.0 to see if this was a > >>> version-related error. I copied the schema from 7.7.0 as many people > >>> said this was fine. > >>> I get the following error when trying to reindex a user's mailbox: > >>> doveadm(fran...@francisaugusto.com): Error: fts_solr: Indexing failed: > >>> 400 Bad Request > >>> doveadm(fran...@francisaugusto.com): Error: Mailbox INBOX: Transaction > >>> commit failed: FTS transaction commit failed: backend deinit > >>> doveadm(fran...@francisaugusto.com): Debug: auth-master: conn > >>> unix:/var/run/dovecot/auth-userdb: Disconnected: Connection closed > >>> (fd=10) > >>> On Solr I get this error: > >>> org.apache.solr.common.SolrException: Exception writing document id > >>> 210/9fd7941e8297d25d91600000c3fdd3da/fran...@francisaugusto.com to the > >>> index; possible analysis error: cannot change field "box" from index > >>> options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=DOCS > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246) > >>> Parallel to this, I got some log messages on Solr before attempting to > >>> reindex the user (sorry for the garbadged text: > >>> Time (Local) Level Core Logger Message > >>> 7/21/2020, 6:38:47 PM WARN false x:dovecot > >>> SolrResourceLoader Solr > >>> loaded a deprecated plugin/analysis class [solr.TrieLongField]. Please > >>> consult documentation how to replace it accordingly. > >>> 7/21/2020, 6:38:47 PM WARN false x:dovecot > >>> SolrResourceLoader Solr > >>> loaded a deprecated plugin/analysis class [solr.SynonymFilterFactory]. > >>> Please consult documentation how to replace it accordingly. > >>> 7/21/2020, 6:38:47 PM WARN false x:dovecot > >>> SolrResourceLoader Solr > >>> loaded a deprecated plugin/analysis class > >>> [solr.WordDelimiterFilterFactory]. Please consult documentation how to > >>> replace it accordingly. > >>> 7/22/2020, 6:43:46 PM ERROR > >>> false x:dovecot RequestHandlerBase > >>> java.lang.IllegalStateException: Type > >>> mismatch: uid was indexed as SORTED_NUMERIC > >>> 7/22/2020, 6:43:46 PM ERROR > >>> false x:dovecot HttpSolrCall > >>> null:java.lang.IllegalStateException: Type > >>> mismatch: uid was indexed as SORTED_NUMERIC > >>> 7/22/2020, 6:43:49 PM ERROR > >>> false x:dovecot RequestHandlerBase > >>> java.lang.IllegalStateException: Type > >>> mismatch: uid was indexed as SORTED_NUMERIC > >>> 7/22/2020, 6:43:49 PM ERROR > >>> false x:dovecot HttpSolrCall > >>> null:java.lang.IllegalStateException: Type > >>> mismatch: uid was indexed as SORTED_NUMERIC > >>> 7/22/2020, 6:43:56 PM ERROR > >>> false x:dovecot RequestHandlerBase > >>> java.lang.IllegalStateException: Type > >>> mismatch: uid was indexed as SORTED_NUMERIC > >>> 7/22/2020, 6:43:56 PM ERROR > >>> false x:dovecot HttpSolrCall null:java.lang.IllegalSta > >>> I am tried again. I get no errors when doing a `doveadm fts rescan`, but > >>> get errors when trying this: > >>> doveadm index -u myu...@mydomain.com INBOX > >>> doveadm(myu...@mydomain.com): Error: fts_solr: Indexing failed: 400 Bad > >>> Request > >>> doveadm(myu...@mydomain.com): Error: Mailbox INBOX: Transaction commit > >>> failed: FTS transaction commit failed: backend deinit > >>> I guess this is a matter of waiting the reindex to be over? > >>> I get so many "Type mismatch" errors in Solr, except for this one that > >>> looks different and showed up after trying the doveadm index command > >>> above: > >>> ERROR true > >>> x:dovecot > >>> RequestHandlerBase > >>> org.apache.solr.common.SolrException: Exception writing document id > >>> 210/9fd7941e8297d25d91600000c3fdd3da/myu...@mydomain.com to the index; > >>> possible analysis error: cannot change field "box" from index > >>> options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=DOCS > >>> org.apache.solr.common.SolrException: Exception writing document id > >>> 210/9fd7941e8297d25d91600000c3fdd3da/myu...@mydomain.com to the index; > >>> possible analysis error: cannot change field "box" from index > >>> options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index options=DOCS > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:246) > >>> at > >>> org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:76) > >>> at > >>> org.apache.solr.update.processor.UpdateRequestProcessor.processAdd(UpdateRequestProcessor.java:55) > >>> at > >>> org.apache.solr.update.processor.DistributedUpdateProcessor.doLocalAdd(DistributedUpdateProcessor.java:259) > >>> at > >>> org.apache.solr.update.processor.DistributedUpdateProcessor.doVersionAdd(DistributedUpdateProcessor.java:489) > >>> at > >>> org.apache.solr.update.processor.DistributedUpdateProcessor.lambda$versionAdd$0(DistributedUpdateProcessor.java:339) > >>> at > >>> org.apache.solr.update.VersionBucket.runWithLock(VersionBucket.java:50) > >>> at > >>> org.apache.solr.update.processor.DistributedUpdateProcessor.versionAdd(DistributedUpdateProcessor.java:339) > >>> at > >>> org.apache.solr.update.processor.DistributedUpdateProcessor.processAdd(DistributedUpdateProcessor.java:225) > >>> at > >>> org.apache.solr.update.processor.LogUpdateProcessorFactory$LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:103) > >>> at > >>> org.apache.solr.handler.loader.XMLLoader.processUpdate(XMLLoader.java:261) > >>> at org.apache.solr.handler.loader.XMLLoader.load(XMLLoader.java:188) > >>> at > >>> org.apache.solr.handler.UpdateRequestHandler$1.load(UpdateRequestHandler.java:97) > >>> at > >>> org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:68) > >>> at > >>> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:198) > >>> at org.apache.solr.core.SolrCore.execute(SolrCore.java:2576) > >>> at > >>> org.apache.solr.servlet.HttpSolrCall.execute(HttpSolrCall.java:803) > >>> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:582) > >>> at > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:424) > >>> at > >>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:351) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1602) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:540) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:146) > >>> at > >>> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:548) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:257) > >>> at > >>> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1711) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:255) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1347) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:203) > >>> at > >>> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:480) > >>> at > >>> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1678) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:201) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1249) > >>> at > >>> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:144) > >>> at > >>> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:220) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:152) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > >>> at > >>> org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:335) > >>> at > >>> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132) > >>> at org.eclipse.jetty.server.Server.handle(Server.java:505) > >>> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:370) > >>> at > >>> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:267) > >>> at > >>> org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:305) > >>> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:103) > >>> at > >>> org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:117) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:333) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:310) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:168) > >>> at > >>> org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:126) > >>> at > >>> org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:366) > >>> at > >>> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:781) > >>> at > >>> org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:917) > >>> at java.base/java.lang.Thread.run(Thread.java:834) > >>> Caused by: java.lang.IllegalArgumentException: cannot change field "box" > >>> from index options=DOCS_AND_FREQS_AND_POSITIONS to inconsistent index > >>> options=DOCS > >>> at > >>> org.apache.lucene.index.FieldInfos$FieldNumbers.verifyConsistent(FieldInfos.java:375) > >>> at > >>> org.apache.lucene.index.FieldInfos$FieldNumbers.setIndexOptions(FieldInfos.java:441) > >>> at > >>> org.apache.lucene.index.DefaultIndexingChain.initIndexOptions(DefaultIndexingChain.java:701) > >>> at > >>> org.apache.lucene.index.DefaultIndexingChain.getOrAddField(DefaultIndexingChain.java:664) > >>> at > >>> org.apache.lucene.index.DefaultIndexingChain.processField(DefaultIndexingChain.java:440) > >>> at > >>> org.apache.lucene.index.DefaultIndexingChain.processDocument(DefaultIndexingChain.java:406) > >>> at > >>> org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(DocumentsWriterPerThread.java:250) > >>> at > >>> org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:495) > >>> at > >>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1594) > >>> at > >>> org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1586) > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.updateDocOrDocValues(DirectUpdateHandler2.java:971) > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.doNormalUpdate(DirectUpdateHandler2.java:344) > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.addDoc0(DirectUpdateHandler2.java:291) > >>> at > >>> org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:238) > >>> ... 53 more > >>> Last Check: 8/2/2020, 1:51:12 PM > >>> Show dates in UTC > >>> Auto-Refresh > >>> Any clue on what I could do here? I have hoped to use Solr but fail to > >>> see instructions that just work. I've been told things must be > >>> reindexed. and I tried that - although I don't know if I did it right. > >>> Could anyone offer some hints/tips on what to do to make it work? > >>> Best, > >>> Francis > >>> PS - I can show the full log of one of the type mismatch error as > >>> well... > > > > -- > > Francis Augusto Medeiros-Logeay > > Oslo, Norway >
