adriangbot commented on PR #23565: URL: https://github.com/apache/datafusion/pull/23565#issuecomment-5783700534
Benchmark for [this request](https://github.com/apache/datafusion/pull/23565#issuecomment-5783079245) failed before finishing (Kubernetes reason: `BackoffLimitExceeded`). Benchmarks requested: `spill_views` <details><summary>Runner log (last 40 lines)</summary> ``` Compiling datafusion-datasource-json v55.1.0 (/workspace/datafusion-branch/datafusion/datasource-json) Compiling datafusion-datasource-arrow v55.1.0 (/workspace/datafusion-branch/datafusion/datasource-arrow) Compiling datafusion-catalog-listing v55.1.0 (/workspace/datafusion-branch/datafusion/catalog-listing) Compiling datafusion-functions-table v55.1.0 (/workspace/datafusion-branch/datafusion/functions-table) Compiling datafusion-datasource-parquet v55.1.0 (/workspace/datafusion-branch/datafusion/datasource-parquet) Compiling datafusion-physical-optimizer v55.1.0 (/workspace/datafusion-branch/datafusion/physical-optimizer) Compiling datafusion v55.1.0 (/workspace/datafusion-branch/datafusion/core) Compiling datafusion-proto v55.1.0 (/workspace/datafusion-branch/datafusion/proto) Compiling datafusion-benchmarks v55.1.0 (/workspace/datafusion-branch/benchmarks) Finished `bench` profile [optimized] target(s) in 10m 29s Running benches/sql.rs (/workspace/datafusion-branch/target/release/deps/sql-2af2193982da74c5) Gnuplot not found, using plotters backend Benchmarking spill_views/q01_sort_string_1_distinct_repeated Benchmarking spill_views/q01_sort_string_1_distinct_repeated: Warming up for 3.0000 s Benchmarking spill_views/q01_sort_string_1_distinct_repeated: Collecting 10 samples in estimated 5.4214 s (60 iterations) Benchmarking spill_views/q01_sort_string_1_distinct_repeated: Analyzing Benchmarking spill_views/q02_sort_string_1000_distinct_repeated Benchmarking spill_views/q02_sort_string_1000_distinct_repeated: Warming up for 3.0000 s Benchmarking spill_views/q02_sort_string_1000_distinct_repeated: Collecting 10 samples in estimated 5.9142 s (60 iterations) Benchmarking spill_views/q02_sort_string_1000_distinct_repeated: Analyzing Benchmarking spill_views/q03_sort_binary_1000_distinct_repeated Benchmarking spill_views/q03_sort_binary_1000_distinct_repeated: Warming up for 3.0000 s Benchmarking spill_views/q03_sort_binary_1000_distinct_repeated: Collecting 10 samples in estimated 5.9238 s (60 iterations) Benchmarking spill_views/q03_sort_binary_1000_distinct_repeated: Analyzing Benchmarking spill_views/q04_sort_string_all_distinct_distinct Benchmarking spill_views/q04_sort_string_all_distinct_distinct: Warming up for 3.0000 s Benchmarking spill_views/q04_sort_string_all_distinct_distinct: Collecting 10 samples in estimated 5.4204 s (30 iterations) Benchmarking spill_views/q04_sort_string_all_distinct_distinct: Analyzing Benchmarking spill_views/q05_group_by_string_all_distinct_distinct Benchmarking spill_views/q05_group_by_string_all_distinct_distinct: Warming up for 3.0000 s Benchmarking spill_views/q05_group_by_string_all_distinct_distinct: Collecting 10 samples in estimated 5.9546 s (40 iterations) thread 'main' (16297) panicked at benchmarks/src/sql_benchmark_runner.rs:224:25: Failed to run benchmark q05_group_by_string_all_distinct_distinct: ResourcesExhausted("Additional allocation failed for FinalHashAggregateStream[3] with top memory consumers (across reservations) as:\n FinalHashAggregateStream[1]#5932(can spill: true) consumed 29.3 MB, peak 29.3 MB,\n FinalHashAggregateStream[2]#5934(can spill: true) consumed 29.3 MB, peak 29.3 MB,\n FinalHashAggregateStream[0]#5941(can spill: true) consumed 27.1 MB, peak 27.1 MB,\n RepartitionExec[0]#5939(can spill: true) consumed 4.8 MB, peak 4.8 MB,\n RepartitionExec[2]#5942(can spill: true) consumed 2.4 MB, peak 2.4 MB.\nError: Failed to allocate additional 2.3 MB for FinalHashAggregateStream[3] with 0.0 B already allocated for this reservation - 2.1 MB remain available for the total memory pool: greedy(used: 93.9 MB, pool_size: 96.0 MB)") note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace thread 'main' (16297) panicked at benchmarks/benches/sql.rs:55:27: failed to run SQL benchmarks: Execution("criterion benchmark failed: Failed to run benchmark q05_group_by_string_all_distinct_distinct: ResourcesExhausted(\"Additional allocation failed for FinalHashAggregateStream[3] with top memory consumers (across reservations) as:\\n FinalHashAggregateStream[1]#5932(can spill: true) consumed 29.3 MB, peak 29.3 MB,\\n FinalHashAggregateStream[2]#5934(can spill: true) consumed 29.3 MB, peak 29.3 MB,\\n FinalHashAggregateStream[0]#5941(can spill: true) consumed 27.1 MB, peak 27.1 MB,\\n RepartitionExec[0]#5939(can spill: true) consumed 4.8 MB, peak 4.8 MB,\\n RepartitionExec[2]#5942(can spill: true) consumed 2.4 MB, peak 2.4 MB.\\nError: Failed to allocate additional 2.3 MB for FinalHashAggregateStream[3] with 0.0 B already allocated for this reservation - 2.1 MB remain available for the total memory pool: greedy(used: 93.9 MB, pool_size: 96.0 MB)\")") error: bench failed, to rerun pass `--bench sql` ``` </details> <details><summary>Kubernetes message</summary> ``` Job has reached the specified backoff limit ``` </details> --- [File an issue](https://github.com/adriangb/datafusion-benchmarking/issues) against this benchmark runner -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
