[ 
https://issues.apache.org/jira/browse/CASSANDRA-19813?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17871243#comment-17871243
 ] 

Michael Semb Wever edited comment on CASSANDRA-19813 at 8/7/24 9:23 AM:
------------------------------------------------------------------------

CI
 - 5.0 dtest-upgrade-large:  [^CASSANDRA-19813_5-0_138_ci_summary.html]  
[^CASSANDRA-19813_5-0_138_results_details.tar.xz] 
 - 5.0 pre-commit w/ upgrades:  [^CASSANDRA-19813_5-0_140_ci_summary.html]  
[^CASSANDRA-19813_5-0_140_results_details.tar.xz] (3 unrelated failures)
 - 5.0 dtest-upgrade-large: 
https://ci-cassandra.apache.org/job/Cassandra-devbranch-5/40/  
[^CASSANDRA-19813_5-0_40_ci_summary.html]  
[^CASSANDRA-19813_5-0_40_results_details.tar.xz] 
 - 5.0 all dtests: 
https://ci-cassandra.apache.org/job/Cassandra-devbranch-5/42/  
[^CASSANDRA-19813_5-0_42_ci_summary.html]  
[^CASSANDRA-19813_5-0_42_results_details.tar.xz] 
 - trunk all dtests:  [^CASSANDRA-19813_trunk_146_ci_summary.html] ,  
[^CASSANDRA-19813_trunk_146_results_details.tar.xz] 

Full trunk CI didn't produce sharable results (because of the known 
timeouts/failures from CASSANDRA-19783 ← CASSANDRA-19239 ← CASSANDRA-19281) but 
run 63,209 tests with otherwise only one (unrelated) failure. see  !Screenshot 
2024-08-07 at 11.21.32.png,width=150!


was (Author: michaelsembwever):
CI
 - 5.0 dtest-upgrade-large:  [^CASSANDRA-19813_5-0_138_ci_summary.html]  
[^CASSANDRA-19813_5-0_138_results_details.tar.xz] 
 - 5.0 pre-commit w/ upgrades:  [^CASSANDRA-19813_5-0_140_ci_summary.html]  
[^CASSANDRA-19813_5-0_140_results_details.tar.xz] (3 unrelated failures)
 - 5.0 dtest-upgrade-large: 
https://ci-cassandra.apache.org/job/Cassandra-devbranch-5/40/  
[^CASSANDRA-19813_5-0_40_ci_summary.html]  
[^CASSANDRA-19813_5-0_40_results_details.tar.xz] 
 - 5.0 all dtests: 
https://ci-cassandra.apache.org/job/Cassandra-devbranch-5/42/  
[^CASSANDRA-19813_5-0_42_ci_summary.html]  
[^CASSANDRA-19813_5-0_42_results_details.tar.xz] 
 - trunk all dtests:  [^CASSANDRA-19813_trunk_146_ci_summary.html] ,  
[^CASSANDRA-19813_trunk_146_results_details.tar.xz] 

Full trunk CI didn't produce sharable results (because of the known 
timeouts/failures from CASSANDRA-19783 ← CASSANDRA-19239 ← CASSANDRA-19281) but 
run 63,209 tests with otherwise only one (unrelated) failure. see  !Screenshot 
2024-08-07 at 11.21.32.png! 

> timeout on  
> upgrade_tests/upgrade_through_versions_test.py::TestProtoV3Upgrade_AllVersions_RandomPartitioner_EndsAt_Trunk_HEAD::test_parallel_upgrade
> -----------------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: CASSANDRA-19813
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-19813
>             Project: Cassandra
>          Issue Type: Bug
>          Components: CI
>            Reporter: Michael Semb Wever
>            Assignee: Michael Semb Wever
>            Priority: Normal
>             Fix For: 5.0-rc, 5.x
>
>         Attachments: CASSANDRA-19813_5-0_138_ci_summary.html, 
> CASSANDRA-19813_5-0_138_results_details.tar.xz, 
> CASSANDRA-19813_5-0_140_ci_summary.html, 
> CASSANDRA-19813_5-0_140_results_details.tar.xz, 
> CASSANDRA-19813_5-0_40_ci_summary.html, 
> CASSANDRA-19813_5-0_40_results_details.tar.xz, 
> CASSANDRA-19813_5-0_42_ci_summary.html, 
> CASSANDRA-19813_5-0_42_results_details.tar.xz, 
> CASSANDRA-19813_trunk_146_ci_summary.html, 
> CASSANDRA-19813_trunk_146_results_details.tar.xz, 
> Cassandra-devbranch-5_40_ci_summary.html, 
> Cassandra-devbranch-5_40_results_details.tar.xz, Screenshot 2024-08-07 at 
> 11.21.32.png, test_rolling_upgrade.122.log, test_rolling_upgrade.123-1.log, 
> test_rolling_upgrade.123-2.log, test_rolling_upgrade.134.log, 
> test_rolling_upgrade.257.good.log, test_rolling_upgrade.261-1.log, 
> test_rolling_upgrade.261-2.log
>
>
>  The 
> upgrade_tests/upgrade_through_versions_test.py::TestProtoV3Upgrade_AllVersions_RandomPartitioner_EndsAt_Trunk_HEAD::test_parallel_upgrade
>   test is taking longer than usual.
> CI in 5.0 is timing out the dtest-upgrade-large 59/64 split always now.
> Our 5.0-rc testing results are tainted because these time outs always abort 
> the 5.0 pipeline runs.
> It looks like that split is taking 16x times as long now… 
> This appears to be caused from either/both
> - 
> https://github.com/apache/cassandra/commit/08e1fecf36507397cf3122d77f84aa23150da588
> - 
> https://github.com/apache/cassandra-dtest/commit/2b17c1293056068bb3e94c332d6fb99df6a0b0fa
> Example of good run.
>  [^test_rolling_upgrade.257.good.log] (ci-cassandra.a.o)
> Examples of bad runs.
>  [^test_rolling_upgrade.122.log],  [^test_rolling_upgrade.123-2.log],  
> [^test_rolling_upgrade.123-1.log],  [^test_rolling_upgrade.134.log]  
> (internal ci)
>  [^test_rolling_upgrade.261-1.log] ,  [^test_rolling_upgrade.261-2.log]  
> (ci-cassandra.a.o)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to