Everytime I try to do a reload using the collections API my entire cloud goes down and I cannot search it. The solrconfig.xml and schema.xml are good because when I just restart tomcat everything works fine.
Here is the output of the collections api reload command: 59155087 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{ "operation":"reloadcollection", "name":"productindex"} 59155098 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Executing Collection Cmd : action=RELOAD 59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-1:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155099 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-4:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155100 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-2:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155102 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-5:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155103 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-3:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155105 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Collection Admin sending CoreAdmin cmd to solr-shard-6:8080/solr params:action=RELOAD&core=productindex&qt=%2Fadmin%2Fcores 59155108 [http-bio-8080-exec-7] INFO org.apache.solr.core.CoreContainer – Reloading SolrCore 'productindex' using instanceDir: /srv/solr/productindex 59155109 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – Check for collection zkNode:productindex 59155111 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – Collection zkNode exists 59155112 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – Load collection config from:/collections/productindex 59155114 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – new SolrResourceLoader for directory: '/srv/solr/productindex/' 59155166 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrConfig – Adding specified lib dirs to ClassLoader 59155167 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/bcmail-jdk15-1.45.jar' to classloader 59155168 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/metadata-extractor-2.6.2.jar' to classloader 59155168 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/apache-mime4j-core-0.7.2.jar' to classloader 59155168 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/vorbis-java-core-0.1.jar' to classloader 59155168 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/juniversalchardet-1.0.3.jar' to classloader 59155169 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/poi-3.8.jar' to classloader 59155169 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/rome-0.9.jar' to classloader 59155169 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/jdom-1.0.jar' to classloader 59155170 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/poi-ooxml-schemas-3.8.jar' to classloader 59155170 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/commons-compress-1.4.1.jar' to classloader 59155170 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/apache-mime4j-dom-0.7.2.jar' to classloader 59155170 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/icu4j-49.1.jar' to classloader 59155171 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/pdfbox-1.7.1.jar' to classloader 59155171 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/isoparser-1.0-RC-1.jar' to classloader 59155171 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/xercesImpl-2.9.1.jar' to classloader 59155172 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/tagsoup-1.2.1.jar' to classloader 59155172 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/poi-ooxml-3.8.jar' to classloader 59155172 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/bcprov-jdk15-1.45.jar' to classloader 59155172 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/netcdf-4.2-min.jar' to classloader 59155173 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/poi-scratchpad-3.8.jar' to classloader 59155173 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/jempbox-1.7.1.jar' to classloader 59155173 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/vorbis-java-tika-0.1.jar' to classloader 59155174 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/boilerpipe-1.1.0.jar' to classloader 59155174 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/fontbox-1.7.1.jar' to classloader 59155174 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/tika-core-1.3.jar' to classloader 59155174 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/dom4j-1.6.1.jar' to classloader 59155175 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/tika-parsers-1.3.jar' to classloader 59155175 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/xz-1.0.jar' to classloader 59155175 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/extraction/lib/xmlbeans-2.3.0.jar' to classloader 59155176 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-cell-4.3.0.jar' to classloader 59155177 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/simple-xml-2.6.4.jar' to classloader 59155177 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/jackson-core-asl-1.7.4.jar' to classloader 59155177 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/mahout-math-0.6.jar' to classloader 59155177 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/attributes-binder-1.0.1.jar' to classloader 59155178 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/jackson-mapper-asl-1.7.4.jar' to classloader 59155178 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/carrot2-mini-3.6.2.jar' to classloader 59155178 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/mahout-collections-1.0.jar' to classloader 59155179 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/clustering/lib/hppc-0.4.1.jar' to classloader 59155179 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-clustering-4.3.0.jar' to classloader 59155180 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/langid/lib/jsonic-1.2.7.jar' to classloader 59155180 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/langid/lib/langdetect-1.1-20120112.jar' to classloader 59155181 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-langid-4.3.0.jar' to classloader 59155182 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/velocity/lib/velocity-1.7.jar' to classloader 59155182 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/velocity/lib/commons-collections-3.2.1.jar' to classloader 59155182 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/velocity/lib/commons-beanutils-1.7.0.jar' to classloader 59155182 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/velocity/lib/velocity-tools-2.0.jar' to classloader 59155183 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-velocity-4.3.0.jar' to classloader 59155184 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/dataimporthandler/lib/mail-1.4.1.jar' to classloader 59155184 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/dataimporthandler/lib/data-import-transformers.jar' to classloader 59155184 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/dataimporthandler/lib/jtds-1.2.5.jar' to classloader 59155185 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/contrib/dataimporthandler/lib/activation-1.1.jar' to classloader 59155185 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-dataimporthandler-extras-4.3.0.jar' to classloader 59155186 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrResourceLoader – Adding 'file:/srv/solr/dist/solr-dataimporthandler-4.3.0.jar' to classloader 59155243 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrConfig – Using Lucene MatchVersion: LUCENE_43 59155315 [http-bio-8080-exec-7] INFO org.apache.solr.core.Config – Loaded SolrConfig: solrconfig.xml 59155318 [http-bio-8080-exec-7] INFO org.apache.solr.schema.IndexSchema – Reading Solr Schema from schema.xml 59155351 [http-bio-8080-exec-7] INFO org.apache.solr.schema.IndexSchema – Schema name=example 59155546 [http-bio-8080-exec-7] INFO org.apache.solr.schema.IndexSchema – unique key field: id 59155581 [http-bio-8080-exec-7] INFO org.apache.solr.schema.FileExchangeRateProvider – Reloading exchange rates from file currency.xml 59155593 [http-bio-8080-exec-7] INFO org.apache.solr.schema.FileExchangeRateProvider – Reloading exchange rates from file currency.xml 59155607 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – [productindex] Opening new SolrCore at /srv/solr/productindex/, dataDir=/srv/solr/productindex/data/ 59155607 [http-bio-8080-exec-7] INFO org.apache.solr.core.JmxMonitoredMap – JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@623199dc 59155608 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – [productindex] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]} 59155609 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – [productindex] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{}]} 59155610 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – New index directory detected: old=null new=/srv/solr/productindex/data/index/ 59155611 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – created json: solr.JSONResponseWriter 59155611 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – adding lazy queryResponseWriter: solr.VelocityResponseWriter 59155611 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – created velocity: solr.VelocityResponseWriter 59155611 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – created xslt: solr.XSLTResponseWriter 59155612 [http-bio-8080-exec-7] INFO org.apache.solr.response.XSLTResponseWriter – xsltCacheLifetimeSeconds=5 59155614 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /select: solr.SearchHandler 59155616 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /productQuery: solr.SearchHandler 59155617 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /query: solr.SearchHandler 59155618 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /get: solr.RealTimeGetHandler 59155619 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /update: solr.UpdateRequestHandler 59155620 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /update/json: solr.JsonUpdateRequestHandler 59155621 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /update/csv: solr.CSVRequestHandler 59155621 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.extraction.ExtractingRequestHandler 59155621 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /update/extract: solr.extraction.ExtractingRequestHandler 59155622 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.FieldAnalysisRequestHandler 59155622 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /analysis/field: solr.FieldAnalysisRequestHandler 59155622 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.DocumentAnalysisRequestHandler 59155623 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /analysis/document: solr.DocumentAnalysisRequestHandler 59155623 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /admin/: solr.admin.AdminHandlers 59155624 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /admin/ping: solr.PingRequestHandler 59155625 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /debug/dump: solr.DumpRequestHandler 59155626 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /replication: solr.ReplicationHandler 59155641 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /dataimport: org.apache.solr.handler.dataimport.DataImportHandler 59155641 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.SearchHandler 59155641 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /tvrh: solr.SearchHandler 59155642 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.SearchHandler 59155642 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /terms: solr.SearchHandler 59155642 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – adding lazy requestHandler: solr.SearchHandler 59155643 [http-bio-8080-exec-7] INFO org.apache.solr.core.RequestHandlers – created /elevate: solr.SearchHandler 59155644 [http-bio-8080-exec-7] INFO org.apache.solr.handler.loader.XMLLoader – xsltCacheLifetimeSeconds=60 59155644 [http-bio-8080-exec-7] INFO org.apache.solr.handler.loader.XMLLoader – xsltCacheLifetimeSeconds=60 59155645 [http-bio-8080-exec-7] INFO org.apache.solr.handler.loader.XMLLoader – xsltCacheLifetimeSeconds=60 59155658 [http-bio-8080-exec-7] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@391d58ad main 59155658 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – Hard AutoCommit: if uncommited for 15000ms; 59155659 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – Soft AutoCommit: disabled 59155660 [http-bio-8080-exec-7] INFO org.apache.solr.handler.component.SpellCheckComponent – Initializing spell checkers 59155660 [http-bio-8080-exec-7] INFO org.apache.solr.spelling.DirectSolrSpellChecker – init: {name=default,field=spell,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01} 59155660 [http-bio-8080-exec-7] INFO org.apache.solr.handler.component.SpellCheckComponent – No queryConverter defined, using default converter 59155661 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – Load collection config from:/collections/productindex 59155670 [http-bio-8080-exec-7] INFO org.apache.solr.handler.ReplicationHandler – Commits will be reserved for 10000 59155692 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@391d58ad main{StandardDirectoryReader(segments_2:1:nrt)} 59155694 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – [productindex] webapp=null path=null params={event=firstSearcher&distrib=false} hits=0 status=0 QTime=1 59155695 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 59155695 [searcherExecutor-13-thread-1] INFO org.apache.solr.handler.component.SpellCheckComponent – Loading spell index for spellchecker: default 59155699 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – [productindex] Registered new searcher Searcher@391d58ad main{StandardDirectoryReader(segments_2:1:nrt)} 59155704 [http-bio-8080-exec-7] INFO org.apache.solr.update.DefaultSolrCoreState – Creating new IndexWriter... 59155705 [http-bio-8080-exec-7] INFO org.apache.solr.update.DefaultSolrCoreState – Waiting until IndexWriter is unused... core=productindex 59155705 [http-bio-8080-exec-7] INFO org.apache.solr.update.DefaultSolrCoreState – Closing old IndexWriter... core=productindex 59155709 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – SolrDeletionPolicy.onInit: commits:num=1 commit{dir=NRTCachingDirectory(org.apache.lucene.store.MMapDirectory@/srv/solr/productindex/data/index lockFactory=org.apache.lucene.store.NativeFSLockFactory@7fb4dbe7; maxCacheMB=48.0 maxMergeSizeMB=4.0),segFN=segments_2,generation=2,filenames=[segments_2] 59155710 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – newest commit = 2[segments_2] 59155710 [http-bio-8080-exec-7] INFO org.apache.solr.update.DefaultSolrCoreState – New IndexWriter is ready to be used. 59155710 [http-bio-8080-exec-7] INFO org.apache.solr.search.SolrIndexSearcher – Opening Searcher@4acdd45c main 59155711 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – publishing core=productindex state=down 59155711 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – numShards not found on descriptor - reading it from system property 59155712 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener sending requests to Searcher@4acdd45c main{StandardDirectoryReader(segments_2:1:nrt)} 59155712 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – QuerySenderListener done. 59155715 [searcherExecutor-13-thread-1] INFO org.apache.solr.core.SolrCore – [productindex] Registered new searcher Searcher@4acdd45c main{StandardDirectoryReader(segments_2:1:nrt)} 59155716 [http-bio-8080-exec-7] INFO org.apache.solr.core.CoreContainer – replacing core: productindex 59155716 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – [productindex] CLOSING SolrCore org.apache.solr.core.SolrCore@202525a2 59155721 [http-bio-8080-exec-7] INFO org.apache.solr.update.UpdateHandler – closing DirectUpdateHandler2{commits=0,autocommit maxTime=15000ms,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0} 59155722 [http-bio-8080-exec-7] INFO org.apache.solr.core.SolrCore – [productindex] Closing main searcher on request. 59155723 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – Register replica - core:productindex address:http://solr-shard-4:8080/solr collection:productindex shard:shard1 59155731 [http-bio-8080-exec-7] INFO org.apache.solr.cloud.ZkController – We are http://solr-shard-4:8080/solr/productindex/ and leader is http://solr-shard-1:8080/solr/productindex/ 59155732 [http-bio-8080-exec-7] INFO org.apache.solr.common.cloud.ZkStateReader – Updating cloud state from ZooKeeper... 59155750 [http-bio-8080-exec-7] INFO org.apache.solr.servlet.SolrDispatchFilter – [admin] webapp=null path=/admin/cores params={action=RELOAD&core=productindex&wt=javabin&qt=/admin/cores&version=2} status=0 QTime=642 59155926 [localhost-startStop-1-EventThread] INFO org.apache.solr.cloud.DistributedQueue – Watcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged 59155926 [Overseer-89776537554780160-solr-shard-4:8080_solr-n_0000000000] INFO org.apache.solr.cloud.OverseerCollectionProcessor – Overseer Collection Processor: Message id:/overseer/collection-queue-work/qn-0000000000 complete, response:{success={solr-shard-6:8080_solr={responseHeader={status=0,QTime=635}},solr-shard-4:8080_solr={responseHeader={status=0,QTime=642}},solr-shard-2:8080_solr={responseHeader={status=0,QTime=683}},solr-shard-5:8080_solr={responseHeader={status=0,QTime=711}},solr-shard-3:8080_solr={responseHeader={status=0,QTime=727}},solr-shard-1:8080_solr={responseHeader={status=0,QTime=793}}}} 59157030 [Thread-2] INFO org.apache.solr.common.cloud.ZkStateReader – Updating cloud state from ZooKeeper... 59157032 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=null message={ "operation":"state", "core_node_name":"solr-shard-4:8080_solr_productindex", "numShards":null, "shard":"shard1", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-4:8080_solr", "base_url":"http://solr-shard-4:8080/solr"} 59157044 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=null message={ "operation":"state", "core_node_name":"solr-shard-6:8080_solr_productindex", "numShards":null, "shard":"shard3", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-6:8080_solr", "base_url":"http://solr-shard-6:8080/solr"} 59157054 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=null message={ "operation":"state", "core_node_name":"solr-shard-2:8080_solr_productindex", "numShards":null, "shard":"shard2", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-2:8080_solr", "base_url":"http://solr-shard-2:8080/solr"} 59157062 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=null message={ "operation":"state", "core_node_name":"solr-shard-5:8080_solr_productindex", "numShards":null, "shard":"shard2", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-5:8080_solr", "base_url":"http://solr-shard-5:8080/solr"} 59157071 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=null message={ "operation":"state", "core_node_name":"solr-shard-3:8080_solr_productindex", "numShards":null, "shard":"shard3", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-3:8080_solr", "base_url":"http://solr-shard-3:8080/solr"} 59157081 [Thread-2] INFO org.apache.solr.cloud.Overseer – Update state numShards=3 message={ "operation":"state", "core_node_name":"solr-shard-1:8080_solr_productindex", "numShards":"3", "shard":"shard1", "roles":null, "state":"down", "shard_state":"active", "core":"productindex", "collection":"productindex", "shard_range":null, "node_name":"solr-shard-1:8080_solr", "base_url":"http://solr-shard-1:8080/solr"} 59157092 [localhost-startStop-1-EventThread] INFO org.apache.solr.common.cloud.ZkStateReader – A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 6) Here is a picture of my cloud after the reload: http://d.pr/i/vN1A Here is the output when I try to do a search: <response> <lst name="responseHeader"> <int name="status">503</int> <int name="QTime">111</int> <lst name="params"> <str name="q">*:*</str> </lst> </lst> <lst name="error"> <str name="msg">no servers hosting shard:</str> <int name="code">503</int> </lst> </response> Any help is greatly appreciated as I often have to tweak my configs on my production cloud. -- View this message in context: http://lucene.472066.n3.nabble.com/Collections-API-Reload-killing-my-cloud-tp4067141.html Sent from the Solr - User mailing list archive at Nabble.com.