[
https://issues.apache.org/jira/browse/GEODE-8709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531301#comment-17531301
]
Donal Evans commented on GEODE-8709:
------------------------------------
The above failure also shows a degradation in PartitionedPutAllLongBenchmark,
which is tracked by GEODE-7572.
It's worth noting that of the 5 repeats that we allow for benchmark instability
to be minimized, 4 failed due to java.io.EOFException, which is a common
occurrence in the benchmark runs, so we didn't get a chance to re-run the
benchmarks showing the degradation to see if it was reproducible. Given the
known instability in the benchmarks, these degradations seem like a stability
issue rather than a real degradation.
> ReplicatedFunctionExecutionBenchmark failing
> ---------------------------------------------
>
> Key: GEODE-8709
> URL: https://issues.apache.org/jira/browse/GEODE-8709
> Project: Geode
> Issue Type: Bug
> Components: benchmarks
> Affects Versions: 1.15.0
> Reporter: John Hutchison
> Priority: Major
> Labels: benchmark
>
>
>
> org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionWithFiltersBenchmark
>
> average ops/second Baseline: 546625.03 Test: 537316.10 Difference: -1.7%
> ops/second standard error Baseline: 776.77 Test: 709.95 Difference: -8.6%
> s/second standard deviation Baseline: 13431.54 Test: 12276.10 Difference:
> -8.6%
> YS 99th percentile latency Baseline: 1700.00 Test: 1750.00 Difference: +2.9%
> median latency Baseline: 1213439.00 Test: 1215487.00 Difference: +0.2%
> 90th percentile latency Baseline: 1465343.00 Test: 1518591.00 Difference:
> +3.6%
> 99th percentile latency Baseline: 4517887.00 Test: 4636671.00 Difference:
> +2.6%
> 99.9th percentile latency Baseline: 18202623.00 Test: 19234815.00
> Difference: +5.7%
> average latency Baseline: 1315053.32 Test: 1337898.07 Difference: +1.7%
> latency standard deviation Baseline: 1303983.91 Test: 1335112.23 Difference:
> +2.4%
> latency standard error Baseline: 101.85 Test: 105.17 Difference: +3.3%
> average ops/second Baseline: 546531.56 Test: 537283.96 Difference: -1.7%
> BENCHMARK FAILED:
> org.apache.geode.benchmark.tests.ReplicatedFunctionExecutionBenchmark average
> latency is 5% worse than baseline.
--
This message was sent by Atlassian Jira
(v8.20.7#820007)
