Public bug reported:
[Impact]
jtreg version 5.0 or later added a '-match' option that is basically the
reverse of '-exclude': it allows the user to set a file containing the tests
that should be run - files not on the list are 'excluded'.
As an OpenJDK maintainer I would like to have the option to set a
'include' list of tests to be run, so I can easily separate tests
between 'stable' and 'flaky' tests by defining a list of tests that are
known to always pass (and where we actually care for regressions).
[Test Case]
1) Create an inclusion list with a single line
$ echo "compiler/aot/RecompilationTest.java" > /tmp/include-list
2) Run the openjdk-lts hotspot test with -watch
$ jtreg -workDir:"/tmp/work" -reportDir:"/tmp/report"
-jdk:/usr/lib/jvm/default-java -match:/tmp/include-list
-dir:/tmp/openjdk-lts/test/hotspot/jtreg -listtests :hotspot_compiler
Testsuite: /tmp/openjdk-lts/test/hotspot/jtreg
compiler/aot/RecompilationTest.java
Tests found: 1
jtreg from xenial and bionic currently fail as they have no support for
'-match'.
[Where problems could occur]
This adds code that has been highly tested on jtreg 5.0+ to previous versions,
so it could possibly trigger different code paths and regress in some corner
cases. This would probably show up as previously excluded tests no longer being
excluded, since exclusion is now defined as "!match".
Any tool that directly calls 'jtreg -match' - instead of looking for its
version - might consider this is a newer version of jtreg and assume it can
also user other newer features, which would fail.
[Other Info]
** Affects: jtreg (Ubuntu)
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1904072
Title:
jtdiff on xenial and bionic should accept an include file list
To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/jtreg/+bug/1904072/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
