Lutz Weischer created SOLR-15218: ------------------------------------ Summary: check failed on AArch64, Fedora 33 Key: SOLR-15218 URL: https://issues.apache.org/jira/browse/SOLR-15218 Project: Solr Issue Type: Bug Security Level: Public (Default Security Level. Issues are Public) Environment: ... > Task :solr:core:test
org.apache.solr.cloud.HttpPartitionOnCommitTest > test FAILED org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40783/hi/cd: Underlying core creation failed while creating collection: control_collection at __randomizedtesting.SeedInfo.seed([1B496941ED7913D9:931D569B43857E21]:0) at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:698) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:269) at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:251) at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:390) at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:360) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1164) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:927) at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:861) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:229) at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:246) at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:340) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1085) at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1058) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819) at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470) at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951) at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836) at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887) at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:51) at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) at org.junit.rules.RunRules.evaluate(RunRules.java:20) at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826) at java.base/java.lang.Thread.run(Thread.java:834) org.apache.solr.cloud.HttpPartitionOnCommitTest > test suite's output saved to /data/jw/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.HttpPartitionOnCommitTest.txt, copied below: 2> 494483 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/data/jw/solr/solr/server/solr/configsets/_default/conf' 2> 494485 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Created dataDir: /data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/data-dir-17-001 2> 494487 WARN (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=5 numCloses=5 2> 494487 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false 2> 494490 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776") 2> 494491 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom 2> 494491 INFO (SUITE-HttpPartitionOnCommitTest-seed#[1B496941ED7913D9]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /hi/cd 2> 494528 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER 2> 494529 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 2> 494529 INFO (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Starting server 2> 494535 WARN (ZkTestServer Run Thread) [ ] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2> 494629 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer start zk server on port: 34913 2> 494629 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:34913 2> 494630 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34913 2> 494630 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34913 2> 494637 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 494644 INFO (zkConnectionManagerCallback-2220-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 494644 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 494654 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 494660 INFO (zkConnectionManagerCallback-2222-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 494660 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 494666 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml 2> 494674 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml 2> 494683 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml 2> 494691 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt 2> 494699 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt 2> 494707 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml 2> 494715 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml 2> 494723 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json 2> 494731 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt 2> 494739 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt 2> 494747 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer put /data/jw/solr/solr/core/build/resources/test/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt 2> 494755 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise 2> 496084 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.s.e.JettySolrRunner Start Jetty (configured port=0, binding port=0) 2> 496085 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.s.e.JettySolrRunner Trying to start Jetty on port 0 try number 2 ... 2> 496085 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.Server jetty-9.4.34.v20201102; built: 2020-11-02T14:15:39.302Z; git: e46af88704a893fc12cb0e3bf46e2c7b48a009e7; jvm 11.0.10+9 2> 496089 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0 2> 496089 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.session No SessionScavenger set, using defaults 2> 496089 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.session node0 Scavenging every 600000ms 2> 496091 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@550fe249{/hi/cd,null,AVAILABLE} 2> 496103 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@67721ca1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:42291} 2> 496103 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.s.Server Started @496176ms 2> 496103 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/hi/cd, solr.data.dir=/data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/tempDir-001/control/data, hostPort=40783, coreRootDirectory=/data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001/cores} 2> 496105 ERROR (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete. 2> 496105 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter Using logger factory org.apache.logging.slf4j.Log4jLoggerFactory 2> 496105 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 9.0.0 2> 496105 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null 2> 496105 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: /data/jw/solr/solr 2> 496105 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2021-03-05T12:49:39.331683Z 2> 496106 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter Solr Home: /data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001 (source: servlet config: solr.solr.home) 2> 496111 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 496118 INFO (zkConnectionManagerCallback-2224-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 496119 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 496229 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper) 2> 496229 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001/solr.xml 2> 496242 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@6153229c, but no JMX reporters were configured - adding default JMX reporter. 2> 500268 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.h.c.HttpShardHandlerFactory Host whitelist initialized: WhitelistHostChecker [whitelistHosts=null, whitelistHostCheckingEnabled=false] 2> 500278 WARN (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@57604885[provider=null,keyStore=null,trustStore=null] 2> 500278 WARN (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@57604885[provider=null,keyStore=null,trustStore=null] 2> 500295 WARN (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.u.s.S.config Trusting all certificates configured for Client@7ada3e3f[provider=null,keyStore=null,trustStore=null] 2> 500296 WARN (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.e.j.u.s.S.config No Client EndPointIdentificationAlgorithm configured for Client@7ada3e3f[provider=null,keyStore=null,trustStore=null] 2> 500303 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34913/solr 2> 500318 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 500331 INFO (zkConnectionManagerCallback-2234-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 500332 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 500442 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 500448 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 500455 INFO (zkConnectionManagerCallback-2236-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 500455 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 501016 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 501036 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:40783_hi%2Fcd 2> 501041 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.Overseer Overseer (id=72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) starting 2> 501074 INFO (OverseerStateUpdate-72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.Overseer Starting to work on the main queue : 127.0.0.1:40783_hi%2Fcd 2> 501075 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40783_hi%2Fcd 2> 501081 INFO (OverseerStateUpdate-72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 501092 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.p.PackageLoader /packages.json updated to version -1 2> 501094 WARN (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 501096 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 505218 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.h.a.MetricsHistoryHandler No .system collection, keeping metrics history in memory. 2> 505441 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6153229c 2> 505520 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6153229c 2> 505521 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6153229c 2> 505529 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001/cores 2> 505573 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 505579 INFO (zkConnectionManagerCallback-2251-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected 2> 505579 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 505584 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 505589 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34913/solr ready 2> 505592 INFO (SocketProxy-Acceptor-40783) [ ] o.a.s.c.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=59986,localport=40783], receiveBufferSize: 65536 2> 505626 INFO (SocketProxy-Acceptor-40783) [ ] o.a.s.c.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=42291,localport=34676], receiveBufferSize=65536 2> 505674 INFO (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection 2> 505814 INFO (OverseerStateUpdate-72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.o.SliceMutator createReplica() { 2> "operation":"ADDREPLICA", 2> "collection":"control_collection", 2> "shard":"shard1", 2> "core":"control_collection_shard1_replica_n1", 2> "state":"down", 2> "node_name":"127.0.0.1:40783_hi%2Fcd", 2> "type":"NRT", 2> "waitForFinalState":"false"} 2> 505924 INFO (zkCallback-2235-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 505930 INFO (SocketProxy-Acceptor-40783) [ ] o.a.s.c.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60014,localport=40783], receiveBufferSize: 65536 2> 505932 INFO (SocketProxy-Acceptor-40783) [ ] o.a.s.c.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=42291,localport=34704], receiveBufferSize=65536 2> 505946 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT 2> 505948 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores 2> 506005 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 9.0.0 2> 506116 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Schema name=test 2> 506159 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id 2> 506230 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from configset conf1, trusted=true 2> 506232 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@6153229c 2> 506233 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001/control-001/cores/control_collection_shard1_replica_n1/data/] 2> 506245 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=36, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2422745827581971] 2> 506253 WARN (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A, b=B}}} 2> 510929 ERROR (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CollectionHandlingUtils Error from shard: http://127.0.0.1:40783/hi/cd 2> => org.apache.solr.client.solrj.SolrServerException: Total timeout 5000 ms elapsed 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.onFailure(Http2SolrClient.java:412) 2> org.apache.solr.client.solrj.SolrServerException: Total timeout 5000 ms elapsed 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.onFailure(Http2SolrClient.java:412) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:197) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.ResponseNotifier.notifyFailure(ResponseNotifier.java:189) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpReceiver.abort(HttpReceiver.java:548) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpChannel.abortResponse(HttpChannel.java:156) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpChannel.abort(HttpChannel.java:149) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpExchange.abort(HttpExchange.java:257) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpConversation.abort(HttpConversation.java:149) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.HttpRequest.abort(HttpRequest.java:812) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.client.TimeoutCompleteListener.onTimeoutExpired(TimeoutCompleteListener.java:51) ~[jetty-client-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.io.CyclicTimeout$Wakeup.run(CyclicTimeout.java:282) ~[jetty-io-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) ~[?:?] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?] 2> at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304) ~[?:?] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> Caused by: java.util.concurrent.TimeoutException: Total timeout 5000 ms elapsed 2> ... 8 more 2> 510937 ERROR (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CollectionHandlingUtils Cleaning up collection [control_collection]. 2> 510948 INFO (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CollectionHandlingUtils Executing Collection Cmd=action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true&deleteMetricsHistory=true, asyncId=null 2> 510956 WARN (qtp797393267-5672) [n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 ] o.a.s.c.CoreContainer Cannot unload non-existent core 'control_collection_shard1_replica_n1' 2> 510958 ERROR (qtp797393267-5672) [n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Cannot unload non-existent core [control_collection_shard1_replica_n1] 2> at org.apache.solr.core.CoreContainer.unload(CoreContainer.java:1839) 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$1(CoreAdminOperation.java:108) 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367) 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397) 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181) 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214) 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:836) 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:800) 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:545) 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:518) 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:432) 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) 2> at org.eclipse.jetty.server.Server.handle(Server.java:516) 2> at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) 2> at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335) 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) 2> at java.base/java.lang.Thread.run(Thread.java:834) 2> 2> 510959 INFO (qtp797393267-5672) [n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={deleteInstanceDir=true&deleteMetricsHistory=true&core=control_collection_shard1_replica_n1&qt=/admin/cores&deleteDataDir=true&action=UNLOAD&wt=javabin&version=2} status=400 QTime=4 2> 510965 ERROR (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CollectionHandlingUtils Error from shard: http://127.0.0.1:40783/hi/cd 2> => org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at null: Cannot unload non-existent core [control_collection_shard1_replica_n1] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.processErrorsAndResponse(Http2SolrClient.java:769) 2> org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at null: Cannot unload non-existent core [control_collection_shard1_replica_n1] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.processErrorsAndResponse(Http2SolrClient.java:769) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient.processErrorsAndResponse(Http2SolrClient.java:463) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.client.solrj.impl.Http2SolrClient$1.lambda$onHeaders$0(Http2SolrClient.java:396) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:218) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> 510977 INFO (zkCallback-2235-thread-1) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 510977 INFO (zkCallback-2235-thread-2) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 510977 INFO (zkCallback-2235-thread-3) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 510978 INFO (zkCallback-2235-thread-4) [ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDeleted path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1]) 2> 510994 INFO (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.CreateCollectionCmd Cleaned up artifacts for failed create collection for [control_collection] 2> 510995 ERROR (OverseerThreadFactory-2241-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.a.c.OverseerCollectionMessageHandler Collection: control_collection operation: create failed:org.apache.solr.common.SolrException: Underlying core creation failed while creating collection: control_collection 2> at org.apache.solr.cloud.api.collections.CreateCollectionCmd.call(CreateCollectionCmd.java:372) 2> at org.apache.solr.cloud.api.collections.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:157) 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:531) 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:218) 2> at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) 2> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 2> at java.base/java.lang.Thread.run(Thread.java:834) 2> 2> 511002 INFO (qtp797393267-5658) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:40783_hi%252Fcd&wt=javabin&version=2} status=400 QTime=5350 2> 511136 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=175146702 2> 511137 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:40783_hi%2Fcd 2> 511139 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.c.ZkController Publish this node as DOWN... 2> 511139 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.c.ZkController Publish node=127.0.0.1:40783_hi%2Fcd as DOWN 2> 511140 INFO (zkCallback-2235-thread-2) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 511147 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 511147 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6ffc8159: rootName = null, domain = solr.node, service url = null, agent id = null] for registry solr.node/com.codahale.metrics.MetricRegistry@29a0f4db 2> 511202 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 511203 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19b76a02: rootName = null, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm/com.codahale.metrics.MetricRegistry@7da75445 2> 511228 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 511228 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@63e60e8c: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty/com.codahale.metrics.MetricRegistry@25f16b08 2> 511228 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster tag=null 2> 511231 INFO (closeThreadPool-2261-thread-1) [ ] o.a.s.c.Overseer Overseer (id=72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) closing 2> 511232 INFO (OverseerStateUpdate-72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:40783_hi%2Fcd 2> 511236 INFO (closeThreadPool-2261-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) closing 2> 511340 INFO (closeThreadPool-2256-thread-2) [ ] o.a.s.c.Overseer Overseer (id=72120814289813508-127.0.0.1:40783_hi%2Fcd-n_0000000000) closing 2> 511351 INFO (closeThreadPool-2256-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@67721ca1{HTTP/1.1, (http/1.1, h2c)}{127.0.0.1:0} 2> 511353 INFO (closeThreadPool-2256-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@550fe249{/hi/cd,null,STOPPED} 2> 511353 INFO (closeThreadPool-2256-thread-2) [ ] o.e.j.s.session node0 Stopped scavenging 2> 511505 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog 2> 511505 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536 2> 511517 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Hard AutoCommit: disabled 2> 511517 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.CommitTracker Soft AutoCommit: disabled 2> 511524 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=18, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0] 2> 511531 ERROR (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.r.ManagedResourceStorage Failed to get config name due to 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/control_collection 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/control_collection 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.6.2.jar:3.6.2] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.6.2.jar:3.6.2] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) ~[zookeeper-3.6.2.jar:3.6.2] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkStateReader.readConfigName(ZkStateReader.java:253) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT ddbd3b88ec8a9c3acc55e351f94f370a11f514b5 [snapshot build, details omitted]] 2> at org.apache.solr.rest.ManagedResourceStorage.newStorageIO(ManagedResourceStorage.java:94) [main/:?] 2> at org.apache.solr.core.SolrCore.initRestManager(SolrCore.java:2938) [main/:?] 2> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1033) [main/:?] 2> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:928) [main/:?] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1443) [main/:?] 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1324) [main/:?] 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95) [main/:?] 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367) [main/:?] 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397) [main/:?] 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181) [main/:?] 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:836) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:800) [main/:?] 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:545) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:518) [main/:?] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:432) [main/:?] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) [main/:?] 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) [jetty-servlet-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) [jetty-rewrite-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.Server.handle(Server.java:516) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335) [jetty-server-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) [jetty-util-9.4.34.v20201102.jar:9.4.34.v20201102] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> 511541 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@4c3b0e5e 2> 511541 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.control_collection.shard1.replica_n1 tag=SolrCore@4c3b0e5e 2> 511542 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@40d80ab2: rootName = null, domain = solr.core.control_collection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.control_collection.shard1.replica_n1/com.codahale.metrics.MetricRegistry@535c8478 2> 511544 INFO (searcherExecutor-2253-thread-1-processing-n:127.0.0.1:40783_hi%2Fcd x:control_collection_shard1_replica_n1 c:control_collection s:shard1 r:core_node2) [n:127.0.0.1:40783_hi%2Fcd c:control_collection s:shard1 r:core_node2 x:control_collection_shard1_replica_n1 ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher autowarm time: 0 ms 2> 511775 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.control_collection.shard1.leader tag=SolrCore@4c3b0e5e 2> 511783 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.u.DirectUpdateHandler2 Committing on IndexWriter.close() ... SKIPPED (unnecessary). 2> 511793 ERROR (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.h.RequestHandlerBase org.apache.solr.common.SolrException: Error CREATEing SolrCore 'control_collection_shard1_replica_n1': Unable to create core [control_collection_shard1_replica_n1] Caused by: KeeperErrorCode = Session expired for /collections/control_collection 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1363) 2> at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:95) 2> at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:367) 2> at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:397) 2> at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:181) 2> at org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:214) 2> at org.apache.solr.servlet.HttpSolrCall.handleAdmin(HttpSolrCall.java:836) 2> at org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:800) 2> at org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:545) 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:518) 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:432) 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:166) 2> at org.eclipse.jetty.servlet.FilterHolder.doFilter(FilterHolder.java:193) 2> at org.eclipse.jetty.servlet.ServletHandler$Chain.doFilter(ServletHandler.java:1601) 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:548) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1612) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:233) 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1434) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:188) 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:501) 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1582) 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:186) 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1349) 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141) 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) 2> at org.eclipse.jetty.rewrite.handler.RewriteHandler.handle(RewriteHandler.java:322) 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:716) 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) 2> at org.eclipse.jetty.server.Server.handle(Server.java:516) 2> at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:383) 2> at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:556) 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:375) 2> at org.eclipse.jetty.server.HttpChannel.run(HttpChannel.java:335) 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:773) 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:905) 2> at java.base/java.lang.Thread.run(Thread.java:834) 2> Caused by: org.apache.solr.common.SolrException: Unable to create core [control_collection_shard1_replica_n1] 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1464) 2> at org.apache.solr.core.CoreContainer.create(CoreContainer.java:1324) 2> ... 38 more 2> Caused by: org.apache.solr.common.SolrException: Failed to load config name for collection:control_collection due to: 2> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1084) 2> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:928) 2> at org.apache.solr.core.CoreContainer.createFromDescriptor(CoreContainer.java:1443) 2> ... 39 more 2> Caused by: org.apache.solr.common.SolrException: Failed to load config name for collection:control_collection due to: 2> at org.apache.solr.rest.ManagedResourceStorage.newStorageIO(ManagedResourceStorage.java:97) 2> at org.apache.solr.core.SolrCore.initRestManager(SolrCore.java:2938) 2> at org.apache.solr.core.SolrCore.<init>(SolrCore.java:1033) 2> ... 41 more 2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/control_collection 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:2358) 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:351) 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:79) 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:351) 2> at org.apache.solr.common.cloud.ZkStateReader.readConfigName(ZkStateReader.java:253) 2> at org.apache.solr.rest.ManagedResourceStorage.newStorageIO(ManagedResourceStorage.java:94) 2> ... 43 more 2> 2> 511793 INFO (qtp797393267-5669) [n:127.0.0.1:40783_hi%2Fcd ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=400 QTime=5849 2> 511796 WARN (closeThreadPool-2256-thread-2) [ ] o.a.s.c.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:40783/hi/cd, target: http://127.0.0.1:42291/hi/cd 2> 511797 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer Shutting down ZkTestServer. 2> 512021 WARN (ZkTestServer Run Thread) [ ] o.a.s.c.ZkTestServer Watch limit violations: 2> Maximum concurrent create/delete watches above limit: 2> 2> 4 /solr/collections/control_collection/state.json 2> 2 /solr/aliases.json 2> 2 /solr/clusterprops.json 2> 2> Maximum concurrent data watches above limit: 2> 2> 5 /solr/collections/control_collection/state.json 2> 2> Maximum concurrent children watches above limit: 2> 2> 10 /solr/overseer/queue 2> 5 /solr/overseer/collection-queue-work 2> 4 /solr/live_nodes 2> 4 /solr/collections/control_collection/state.json 2> 4 /solr/collections 2> 2> 512044 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:34913 2> 512044 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:34913 2> 512044 INFO (TEST-HttpPartitionOnCommitTest.test-seed#[1B496941ED7913D9]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1 34913 > org.apache.solr.client.solrj.impl.BaseHttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:40783/hi/cd: Underlying core creation failed while creating collection: control_collection > at __randomizedtesting.SeedInfo.seed([1B496941ED7913D9:931D569B43857E21]:0) > at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:698) > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:269) > at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:251) > at org.apache.solr.client.solrj.impl.LBSolrClient.doRequest(LBSolrClient.java:390) > at org.apache.solr.client.solrj.impl.LBSolrClient.request(LBSolrClient.java:360) > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.sendRequest(BaseCloudSolrClient.java:1164) > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.requestWithRetryOnStaleState(BaseCloudSolrClient.java:927) > at org.apache.solr.client.solrj.impl.BaseCloudSolrClient.request(BaseCloudSolrClient.java:861) > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:229) > at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:246) > at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:340) > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1085) > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1058) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44) > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45) > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:819) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:470) > at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:951) > at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:836) > at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:887) > at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:898) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:38) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:51) > at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44) > at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60) > at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:47) > at org.junit.rules.RunRules.evaluate(RunRules.java:20) > at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36) > at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:370) > at com.carrotsearch.randomizedtesting.ThreadLeakControl.lambda$forkTimeoutingTask$0(ThreadLeakControl.java:826) > at java.base/java.lang.Thread.run(Thread.java:834) 2> NOTE: reproduce with: gradlew test --tests HttpPartitionOnCommitTest.test -Dtests.seed=1B496941ED7913D9 -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=nnh -Dtests.timezone=Africa/Bamako -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1 2> NOTE: leaving temporary files on disk at: /data/jw/solr/solr/core/build/tmp/tests-tmp/solr.cloud.HttpPartitionOnCommitTest_1B496941ED7913D9-001 2> NOTE: test params are: codec=Asserting(Lucene90): {}, docValues:{}, maxPointsInLeafNode=1300, maxMBSortInHeap=5.443372453557522, sim=Asserting(RandomSimilarity(queryNorm=true): {}), locale=nnh, timezone=Africa/Bamako 2> NOTE: Linux 5.10.13-200.fc33.aarch64 aarch64/Red Hat, Inc. 11.0.10 (64-bit)/cpus=48,threads=1,free=148544192,total=270532608 2> NOTE: All tests run in this JVM: [SolrInfoBeanTest, DistributedDebugComponentTest, DistributedSpellCheckComponentTest, SpellCheckComponentTest, BinaryUpdateRequestHandlerTest, TestContainerPlugin, TestSolrConfigHandlerConcurrent, CoreMergeIndexesAdminHandlerTest, SegmentsInfoRequestHandlerTest, V2CollectionsAPIMappingTest, TestDocumentBuilder, TestCharFilters, ActionThrottleTest, AsyncCallRequestStatusResponseTest, SimpleCollectionCreateDeleteTest, ClusterStateUpdateTest, DeleteShardTest, HttpPartitionOnCommitTest] WARNING: Test org.apache.solr.TestDistributedSearch wrote 28,111,550 bytes of output. > Task :lucene:core:test :lucene:core:test (SUCCESS): 5258 test(s), 190 skipped > Task :solr:contrib:analytics:test :solr:contrib:analytics:test (SUCCESS): 472 test(s) > Task :solr:contrib:clustering:test :solr:contrib:clustering:test (SUCCESS): 15 test(s) > Task :solr:contrib:extraction:test :solr:contrib:extraction:test (SUCCESS): 20 test(s) > Task :solr:contrib:jaegertracer-configurator:test :solr:contrib:jaegertracer-configurator:test (SUCCESS): 3 test(s) > Task :solr:contrib:langid:test :solr:contrib:langid:test (SUCCESS): 43 test(s) > Task :solr:contrib:prometheus-exporter:test :solr:contrib:prometheus-exporter:test (SUCCESS): 20 test(s), 5 skipped > Task :solr:contrib:scripting:test :solr:contrib:scripting:test (SUCCESS): 22 test(s), 1 skipped > Task :solr:solr-ref-guide:prepareLocalJavadocLinksSiteSources Syncing source files to /data/jw/solr/solr/solr-ref-guide/build/local-jdoc-links-site-content using props: htmlSolrJavadocs -> link:../../../documentation/build/site htmlLuceneJavadocs -> link:../../../../lucene/documentation/build/site htmlOutDir -> ../local-jdoc-links-site javadocLink -> https://docs.oracle.com/en/java/javase/11/docs/api/ solrGuideDraftStatus -> DRAFT solrRootPath -> /data/jw/solr/solr/ solrDocsVersion -> 9.0 solrGuideVersionPath -> 9_0 buildDate -> 2021-03-05 buildYear -> 2021 ivyCommonsCodec -> 1.13 ivyDropwizardMetrics -> 4.1.5 ivyLog4j -> 2.13.2 ivyOpennlpTools -> 1.9.1 ivyTika -> 1.24 ivyZookeeper -> 3.6.2 Building up tree of all known pages WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by org.jruby.util.SecurityHelper (file:/home/jw/.gradle/caches/modules-2/files-2.1/org.jruby/jruby-core/9.2.6.0/653601d48b38528e76840c6eac1ae46e2dae1a74/jruby-core-9.2.6.0.jar) to field java.lang.reflect.Field.modifiers WARNING: Please consider reporting this to the maintainers of org.jruby.util.SecurityHelper WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Looping over pages to build nav data Creating /data/jw/solr/solr/solr-ref-guide/build/local-jdoc-links-site-content/_data/scrollnav.json Creating /data/jw/solr/solr/solr-ref-guide/build/local-jdoc-links-site-content/_data/sidebar.json > Task :solr:solr-ref-guide:buildLocalJavadocLinksSite WARNING: An illegal reflective access operation has occurred WARNING: Illegal reflective access by com.headius.backport9.modules.Modules (file:/home/jw/.gradle/caches/modules-2/files-2.1/org.jruby/jruby-complete/9.2.9.0/8e44ce7a1417966d89957bd766a148601e28828b/jruby-complete-9.2.9.0.jar) to method sun.nio.ch.NativeThread.signal(long) WARNING: Please consider reporting this to the maintainers of com.headius.backport9.modules.Modules WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations WARNING: All illegal access operations will be denied in a future release Configuration file: /data/jw/solr/solr/solr-ref-guide/build/local-jdoc-links-site-content/_config.yml Source: /data/jw/solr/solr/solr-ref-guide/build/local-jdoc-links-site-content Destination: ../local-jdoc-links-site Incremental build: disabled. Enable with --incremental Generating... asciidoctor: WARNING: skipping reference to missing attribute: config_name asciidoctor: WARNING: skipping reference to missing attribute: file_name done in 102.624 seconds. Auto-regeneration: disabled. Use --watch to enable. > Task :solr:solr-ref-guide:checkSite Processed 2493 links (1799 relative) to 3741 anchors in 252 files > Task :solr:contrib:ltr:test :solr:contrib:ltr:test (SUCCESS): 158 test(s), 1 skipped > Task :solr:core:test WARNING: Test org.apache.solr.search.facet.TestCloudJSONFacetSKGEquiv wrote 17,382,993 bytes of output. WARNING: Test org.apache.solr.TestRandomFaceting wrote 13,698,296 bytes of output. > Task :solr:solrj:test :solr:solrj:test (SUCCESS): 1677 test(s), 24 skipped > Task :solr:core:test WARNING: Test org.apache.solr.search.facet.TestJsonFacets wrote 29,551,184 bytes of output. WARNING: Test org.apache.solr.schema.DocValuesTest wrote 11,280,730 bytes of output. WARNING: Test org.apache.solr.schema.TestCloudSchemaless wrote 11,610,076 bytes of output. :solr:core:test (FAILURE): 4672 test(s), 1 failure(s), 203 skipped 4672 tests completed, 1 failed, 203 skipped > Task :solr:core:test FAILED ERROR: The following test(s) have failed: - org.apache.solr.cloud.HttpPartitionOnCommitTest.test (:solr:core) Test output: /data/jw/solr/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.HttpPartitionOnCommitTest.txt Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.cloud.HttpPartitionOnCommitTest.test" -Ptests.jvms=12 -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=1B496941ED7913D9 -Ptests.file.encoding=ISO-8859-1 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':solr:core:test'. > There were failing tests. See the results at: > file:///data/jw/solr/solr/core/build/test-results/test/ * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 1h 14m 51s 924 actionable tasks: 769 executed, 155 up-to-date [jw@cn06 solr]$ Reporter: Lutz Weischer -- This message was sent by Atlassian Jira (v8.3.4#803005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org