Re: Solr 9.1.1 bugfix release

2022-12-23 Thread David Smiley
Thanks for volunteering!

I'd like to propose that the upgrades to dependencies due to CVEs be
back-ported to 9.1.1.  I can help with this.  One example I see is
woodstox-core.

~ David Smiley
Apache Lucene/Solr Search Developer
http://www.linkedin.com/in/davidwsmiley


On Thu, Dec 22, 2022 at 9:45 AM Michael Gibney 
wrote:

> I'd like to get the ball rolling on a 9.1.1 bugfix release, and
> volunteer to be release manager. There aren't very many bugfixes
> accumulated since 9.1.0 on `branch_9_1`, but SOLR-16585 in particular
> (NPE on MatchAllDocs pagination) should be fixed asap.
>
> I'm thinking to build a release candidate as early as possible in the new
> year.
>
> Are there any outstanding bugfixes that anyone would like to backport
> to `branch_9_1` before preparing the release?
>
> Michael
>
> -
> To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
> For additional commands, e-mail: dev-h...@solr.apache.org
>
>


Enable different schemas per shard based on core.properties

2022-12-23 Thread Bram Van Dam

Greetings,

We ran into a pretty hairy problem on 7.7. TL;DR; we had to enable 
docValues on the unique key field in a large SolrCloud instance, without 
being able to reindex old data.


This kind of worked, by specifying different config sets in 
core.properties for different shards, where new shards would get the 
schema from ZK and newly indexed data would (correctly) use DocValues, 
while old data in older shards remained unaffected.


This broke when old data was modified: Solr would use the new schema for 
the updates, and the index would get corrupted because documents with 
and without docValues would be mixed in the same segment in the same 
core, which resulted in errors when retrieving the documents (curiously, 
not when merging the segments?).


The linked patch, by my colleague Danny, allows Solr to use the correct 
schema when updating data in these old shards (based on the 
configuration in core.properties).


We realize that this is a pretty ugly hack for a rather specific 
problem. But at the same time, Solr allows for different configSets to 
be specified for different cores, and this patch sort of improves 
support for that.


This applies cleanly on (the admittedly ancient) branch_7_7. All tests 
are green, precommit checks are OK.


If there is any interest in this patch, we might be able to look in to 
making it available on master or branch_9x.


https://foss.intix.eu/solr/2022-12-solr-schema.patch

Any feedback is of course greatly appreciated.

Thanks, and season's greetings!

 - Bram

-
To unsubscribe, e-mail: dev-unsubscr...@solr.apache.org
For additional commands, e-mail: dev-h...@solr.apache.org



Re: [JENKINS] Solr-main-Linux (64bit/jdk-18) - Build # 9105 - Unstable!

2022-12-23 Thread Kevin Risden
One of these two changes is causing a bunch of test failures.


   1. SOLR-10461: move setAliveCheckInterval from clients into Builder
   (#1217)
   2. SOLR-10462: migrate to using the Builder setting the pollQueueTime
   (#1219)


These aren't specific to an os or Java version. There are ~30 something
test failures per build.

Kevin Risden

On Thu, Dec 22, 2022, 13:48 Policeman Jenkins Server 
wrote:

> Build: https://jenkins.thetaphi.de/job/Solr-main-Linux/9105/
> Java: 64bit/jdk-18 -XX:+UseCompressedOops -XX:+UseSerialGC
>
> 37 tests failed.
> FAILED:  org.apache.solr.DistributedIntervalFacetingTest.test
>
> Error Message:
> org.apache.solr.client.solrj.SolrServerException: Timeout occurred while
> waiting response from server at: http://127.0.0.1:40425/_n/collection1
>
> Stack Trace:
> org.apache.solr.client.solrj.SolrServerException: Timeout occurred while
> waiting response from server at: http://127.0.0.1:40425/_n/collection1
> at
> __randomizedtesting.SeedInfo.seed([E50DD76075E7F7C1:6D59E8BADB1B9A39]:0)
> at
> app//org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:743)
> at
> app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:248)
> at
> app//org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
> at
> app//org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:234)
> at
> app//org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:927)
> at
> app//org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:940)
> at
> app//org.apache.solr.BaseDistributedSearchTestCase.queryServer(BaseDistributedSearchTestCase.java:700)
> at
> app//org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:738)
> at
> app//org.apache.solr.BaseDistributedSearchTestCase.query(BaseDistributedSearchTestCase.java:711)
> at
> app//org.apache.solr.DistributedIntervalFacetingTest.doTestQuery(DistributedIntervalFacetingTest.java:205)
> at
> app//org.apache.solr.DistributedIntervalFacetingTest.testRandom(DistributedIntervalFacetingTest.java:174)
> at
> app//org.apache.solr.DistributedIntervalFacetingTest.test(DistributedIntervalFacetingTest.java:44)
> at java.base@18
> /jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104)
> at java.base@18/java.lang.reflect.Method.invoke(Method.java:577)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1758)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:946)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:982)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:996)
> at
> app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:1165)
> at
> app//org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:1136)
> at
> app//com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:80)
> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at
> app//org.apache.lucene.tests.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:44)
> at
> app//org.apache.lucene.tests.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:43)
> at
> app//org.apache.lucene.tests.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:45)
> at
> app//org.apache.lucene.tests.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:60)
> at
> app//org.apache.lucene.tests.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:44)
> at app//org.junit.rules.RunRules.evaluate(RunRules.java:20)
> at
> app//com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
> at
> app//com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:390)
> at
> app//com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:843)
> at
> app//com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:490)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:955)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:840)
> at
> app//com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:891)
> at
> app//com.carrotsearch.randomizedtesting.Randomized