rmuir commented on code in PR #633: URL: https://github.com/apache/lucene/pull/633#discussion_r866919777
########## lucene/test-framework/src/java/org/apache/lucene/tests/index/MockRandomMergePolicy.java: ########## @@ -86,6 +86,20 @@ public MergeSpecification findMerges( return mergeSpec; } + @Override + public MergeSpecification findMerges(CodecReader... readers) throws IOException { + if (random.nextBoolean() == true) { + return super.findMerges(readers); + } else { + // create a oneMerge for each reader to let them get concurrently processed by addIndexes() Review Comment: > Is it that randomized tests (without concurrency) cannot always be reproduced with their random seed (like [LUCENE-10529](https://issues.apache.org/jira/browse/LUCENE-10529)? And so, with mixing randomized tests and concurrency, we blend two unknowns. We are not sure if we're missing the params with which the test failed, or if the random seed worked but it's a race condition issue.. you got it. > We should probably do that for tests that are validating some non-concurrent logic, and not asserting any CMS specific behavior. On similar lines, what do you think about moving concurrency tests for an area, into a separate class/test suite - like `TestAddIndexesConcurrency` for `addIndexes`?. Then, for changes that touch concurrency, contributors can separately run those test suites on repeat to get better confidence. It would also be easier to setup such classes for concurrency (like using n threads in CMS), and avoid adding any randomness to it. I really like this idea of just introducing a "convention" for test naming so that when such a test fails (e.g. in CI), it is very clear that the issue may be concurrency related! And making it easy for ppl with lots of cpus to "beast" concurrency tests. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@lucene.apache.org For additional commands, e-mail: issues-h...@lucene.apache.org