Hello, I am doing a solr6 pilot to try out the new features. We have Cross Data Center Replication (CDCR) setup as follows: Source cluster - 3 zk nodes, 3 solr instances Target cluster - 3 zk nodes, 3 solr instances
*Below are source and target solrconfig.xml files.* solrconfig.xml <http://lucene.472066.n3.nabble.com/file/n4306717/solrconfig.xml> solrconfig.xml <http://lucene.472066.n3.nabble.com/file/n4306717/solrconfig.xml> *Followed below steps :* 1. Stop solr in source and target clusters 2. Purge existing configs dir from both source and target zookeeper clusters 3. Upload source and target configs to corresponding zookeeper clusters 4. Rsync data dir from each source node to corresponding target node 5. Start solr on target nodes 6. Start solr on source nodes 7. Start CDCR on source leader 8. Disable buffer on target leader *Upon indexing a document to the source cluster:* 1. Doc was indexed in source solr nodes. 2. Doc was identified for replication and CdcrReplicator on source leader forwarded updates to target leader. 3. Looks like the document got indexed to the target cluster as well (looked in data and index directories on target leader and it was updated). 4. Search query in source solr admin UI and doc is indexed, numFound=1. 5. Same search query in target solr admin UI and doc is not indexed: numFound=0. There are no errors in any of the logs. Could you please let me know if any steps/ parameters are incorrect? Is there anything I am missing here? *Snippet from source leader log:* 2016-11-21 12:42:36.493 INFO (qtp1634198-129) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [publictraining_shard1_replica2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[cls1 (1551630500017209344)]} 0 75 2016-11-21 12:42:36.565 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 2016-11-21 12:42:36.565 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1f4bd77b 2016-11-21 12:42:36.611 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(MMapDirectory@/opt/solr-6.2.1/server/solr/publictraining_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64f63cba; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1} commit{dir=NRTCachingDirectory(MMapDirectory@/opt/solr-6.2.1/server/solr/publictraining_shard1_replica2/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@64f63cba; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2} 2016-11-21 12:42:36.611 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.SolrDeletionPolicy newest commit generation = 2 2016-11-21 12:42:36.613 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5b18f07[publictraining_shard1_replica2] main] 2016-11-21 12:42:36.614 INFO (searcherExecutor-27-thread-1-processing-n:172.31.72.200:8983_solr x:publictraining_shard1_replica2 s:shard1 c:publictraining r:core_node2) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.QuerySenderListener QuerySenderListener sending requests to Searcher@5b18f07[publictraining_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.1):C1)))} 2016-11-21 12:42:36.614 INFO (searcherExecutor-27-thread-1-processing-n:172.31.72.200:8983_solr x:publictraining_shard1_replica2 s:shard1 c:publictraining r:core_node2) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.QuerySenderListener QuerySenderListener done. 2016-11-21 12:42:36.614 INFO (searcherExecutor-27-thread-1-processing-n:172.31.72.200:8983_solr x:publictraining_shard1_replica2 s:shard1 c:publictraining r:core_node2) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.SolrCore [publictraining_shard1_replica2] Registered new searcher Searcher@5b18f07[publictraining_shard1_replica2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.2.1):C1)))} 2016-11-21 12:42:36.615 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.DirectUpdateHandler2 end_commit_flush 2016-11-21 12:42:36.615 INFO (qtp1634198-152) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [publictraining_shard1_replica2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://172.31.72.200:8983/solr/publictraining_shard1_replica2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 50 2016-11-21 12:42:36.657 INFO (qtp1634198-159) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.u.p.LogUpdateProcessorFactory [publictraining_shard1_replica2] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 94 2016-11-21 12:42:36.674 INFO (qtp1634198-122) [c:publictraining s:shard1 r:core_node2 x:publictraining_shard1_replica2] o.a.s.c.S.Request [publictraining_shard1_replica2] webapp=/solr path=/select params={q=*:*&rows=100&wt=javabin&version=2} hits=1 status=0 QTime=0 2016-11-21 12:42:37.231 INFO (cdcr-replicator-34-thread-2-processing-n:172.31.72.200:8983_solr) [ ] o.a.s.h.CdcrReplicator Forwarded 1 updates to target publictraining *Snippet from target leader log:* 2016-11-21 12:42:37.231 INFO (qtp1634198-15) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.S.Request [publictraining_shard1_replica3] webapp=/solr path=/update params={_stateVer_=publictraining:7&cdcr.update=&wt=javabin&version=2} status=0 QTime=146 2016-11-21 12:42:52.149 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false} 2016-11-21 12:42:52.150 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@2c70a7e3 2016-11-21 12:42:52.179 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=2 commit{dir=NRTCachingDirectory(MMapDirectory@/var/lib/solr/publictraining_shard1_replica3/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50bbeb46; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_1,generation=1} commit{dir=NRTCachingDirectory(MMapDirectory@/var/lib/solr/publictraining_shard1_replica3/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@50bbeb46; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2} 2016-11-21 12:42:52.179 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.SolrDeletionPolicy newest commit generation = 2 2016-11-21 12:42:52.184 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.s.SolrIndexSearcher Opening [Searcher@1cd2c8f8[publictraining_shard1_replica3] realtime] 2016-11-21 12:42:52.185 INFO (commitScheduler-23-thread-1) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.u.DirectUpdateHandler2 end_commit_flush 2016-11-21 12:42:57.536 INFO (qtp1634198-17) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.S.Request [publictraining_shard1_replica3] webapp=/solr path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=0 2016-11-21 12:42:57.574 INFO (qtp1634198-19) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.S.Request [publictraining_shard1_replica3] webapp=/solr path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=0 2016-11-21 12:43:57.539 INFO (qtp1634198-16) [c:publictraining s:shard1 r:core_node3 x:publictraining_shard1_replica3] o.a.s.c.S.Request [publictraining_shard1_replica3] webapp=/solr path=/cdcr params={action=LASTPROCESSEDVERSION&wt=javabin&version=2} status=0 QTime=0 Thank you for your help, Gayatri -- View this message in context: http://lucene.472066.n3.nabble.com/Solr6-CDCR-indexing-doc-to-source-replicates-to-target-doc-not-searchable-in-target-tp4306717.html Sent from the Solr - User mailing list archive at Nabble.com.
