rmuir commented on code in PR #633:
URL: https://github.com/apache/lucene/pull/633#discussion_r866919777
##########
lucene/test-framework/src/java/org/apache/lucene/tests/index/MockRandomMergePolicy.java:
##########
@@ -86,6 +86,20 @@ public MergeSpecification findMerges(
return mergeSpec;
}
+ @Override
+ public MergeSpecification findMerges(CodecReader... readers) throws
IOException {
+ if (random.nextBoolean() == true) {
+ return super.findMerges(readers);
+ } else {
+ // create a oneMerge for each reader to let them get concurrently
processed by addIndexes()
Review Comment:
> Is it that randomized tests (without concurrency) cannot always be
reproduced with their random seed (like
[LUCENE-10529](https://issues.apache.org/jira/browse/LUCENE-10529)? And so,
with mixing randomized tests and concurrency, we blend two unknowns. We are not
sure if we're missing the params with which the test failed, or if the random
seed worked but it's a race condition issue..
you got it.
> We should probably do that for tests that are validating some
non-concurrent logic, and not asserting any CMS specific behavior. On similar
lines, what do you think about moving concurrency tests for an area, into a
separate class/test suite - like `TestAddIndexesConcurrency` for `addIndexes`?.
Then, for changes that touch concurrency, contributors can separately run those
test suites on repeat to get better confidence. It would also be easier to
setup such classes for concurrency (like using n threads in CMS), and avoid
adding any randomness to it.
I really like this idea of just introducing a "convention" for test naming
so that when such a test fails (e.g. in CI), it is very clear that the issue
may be concurrency related! And making it easy for ppl with lots of cpus to
"beast" concurrency tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]