[
https://issues.apache.org/jira/browse/GEODE-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17231608#comment-17231608
]
John Hutchison commented on GEODE-7616:
---------------------------------------
11/3
org.apache.geode.benchmark.tests.ReplicatedPutAllLongBenchmark
average ops/second Baseline: 854.09 Test: 850.53 Difference: -0.4%
ops/second standard error Baseline: 2.82 Test: 2.52 Difference: -10.8%
ops/second standard deviation Baseline: 48.86 Test: 43.51 Difference: -10.9%
YS 99th percentile latency Baseline: 20099.00 Test: 20099.00 Difference: +0.0%
median latency Baseline: 164757503.00 Test: 165543935.00 Difference: +0.5%
90th percentile latency Baseline: 249036799.00 Test: 245366783.00 Difference:
-1.5%
99th percentile latency Baseline: 328466431.00 Test: 319029247.00 Difference:
-2.9%
99.9th percentile latency Baseline: 407896063.00 Test: 383778815.00
Difference: -5.9%
average latency Baseline: 168732913.71 Test: 169570366.99 Difference: +0.5%
latency standard deviation Baseline: 61216607.41 Test: 57135462.90 Difference:
-6.7%
latency standard error Baseline: 121028.48 Test: 113222.36 Difference: -6.4%
average ops/second Baseline: 852.91 Test: 848.79 Difference: -0.5%
BENCHMARK FAILED: org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark
average latency is 5% worse than baseline.
> ReplicatedPutAllBenchmark average latency is 5% worse than baseline
> -------------------------------------------------------------------
>
> Key: GEODE-7616
> URL: https://issues.apache.org/jira/browse/GEODE-7616
> Project: Geode
> Issue Type: Bug
> Components: benchmarks
> Reporter: Bill Burcham
> Assignee: Jacob Barrett
> Priority: Major
>
> Three runs in a row have failed with {{ReplicatedPutAllBenchmark average
> latency is 5% worse than baseline}} starting with:
> https://concourse.apachegeode-ci.info/teams/main/pipelines/apache-develop-main/jobs/Benchmark_base/builds/23
> e.g.
> {code}
> org.apache.geode.benchmark.tests.ReplicatedPutAllBenchmark
> average ops/second Baseline: 900.64 Test: 828.40
> Difference: -8.0%
> ops/second standard error Baseline: 2.71 Test: 2.47
> Difference: -8.9%
> ops/second standard deviation Baseline: 46.91 Test: 42.76
> Difference: -8.9%
> YS 99th percentile latency Baseline: 20099.00 Test: 20099.00
> Difference: +0.0%
> median latency Baseline: 158728191.00 Test: 172359679.00
> Difference: +8.6%
> 90th percentile latency Baseline: 228458495.00 Test: 244449279.00
> Difference: +7.0%
> 99th percentile latency Baseline: 299368447.00 Test: 319815679.00
> Difference: +6.8%
> 99.9th percentile latency Baseline: 354156543.00 Test: 387710975.00
> Difference: +9.5%
> average latency Baseline: 160197744.39 Test: 174083983.05
> Difference: +8.7%
> latency standard deviation Baseline: 53484962.25 Test: 55775317.05
> Difference: +4.3%
> latency standard error Baseline: 103053.88 Test: 111997.05
> Difference: +8.7%
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
