[PR] feat: support sort_array expression [datafusion-comet]

2026-03-14 Thread via GitHub
grorge123 opened a new pull request, #3706: URL: https://github.com/apache/datafusion-comet/pull/3706 ## Which issue does this PR close? Closes #3159. ## Rationale for this change Currently, comet does not support `sort_array` expression, so using `sort_array(...)` w

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062321361 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) `Linux bench-c4062317495-268-chlhb 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062321323 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) `Linux bench-c4062317495-270-29lsz 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062321363 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) `Linux bench-c4062317495-269-qsrw2 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4062324967 QQuery 32 seems a bit faster, but perhaps not worth the trouble yet -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] DataFrame API: allow aggregate functions in `select()` [datafusion]

2026-03-14 Thread via GitHub
cj-zhukov commented on issue #17874: URL: https://github.com/apache/datafusion/issues/17874#issuecomment-4062325731 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062339666 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) Details ``` Comparing HEAD and avoid_concat

Re: [PR] feature: sort by/cluster by/distribute by [datafusion]

2026-03-14 Thread via GitHub
github-actions[bot] closed pull request #16310: feature: sort by/cluster by/distribute by URL: https://github.com/apache/datafusion/pull/16310 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [I] [Feature] Support Spark expression: sort_array [datafusion-comet]

2026-03-14 Thread via GitHub
grorge123 commented on issue #3159: URL: https://github.com/apache/datafusion-comet/issues/3159#issuecomment-4062114204 take -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] chore: [branch-0.14] Remove `-SNAPSHOT` from version [datafusion-comet]

2026-03-14 Thread via GitHub
andygrove merged PR #3697: URL: https://github.com/apache/datafusion-comet/pull/3697 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062348606 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062349745 Benchmark for [this request](https://github.com/apache/datafusion/pull/20944#issuecomment-4062349128) failed. Last 20 lines of output: Click to expand ```

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062349638 🤖 Criterion benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062349128) `Linux bench-c4062349128-271-fczfh 6.12.55+ #1 SMP Sun F

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062350279 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062349128) `Linux bench-c4062349128-272-55d6x 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062349128 run benchmark tpcds10 tpch10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062355604 run benchmark tpcds10 tpch10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062360467 🤖 Criterion benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062355604) `Linux bench-c4062355604-273-w7srt 6.12.55+ #1 SMP Sun F

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062360648 Benchmark for [this request](https://github.com/apache/datafusion/pull/20944#issuecomment-4062355604) failed. Last 20 lines of output: Click to expand ```

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062360215 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062355604) `Linux bench-c4062355604-274-j26cd 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062351383 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062317495) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062350651 Benchmark for [this request](https://github.com/apache/datafusion/pull/20944#issuecomment-4062349128) failed. Last 20 lines of output: Click to expand ``` C

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062382131 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062355604) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062395363 run benchmark tpch10 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062399217 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062395363) `Linux bench-c4062395363-275-p4474 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches in hash join [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4062418541 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4062395363) Details ``` Comparing HEAD and avoid_concat

[PR] fix: route file-not-found errors through SparkError JSON path [datafusion-comet]

2026-03-14 Thread via GitHub
andygrove opened a new pull request, #3699: URL: https://github.com/apache/datafusion-comet/pull/3699 ## Which issue does this PR close? Closes #3314. ## Rationale for this change When `native_datafusion` scan encounters missing files with `ignoreMissingFiles=false`, it

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060822348 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060781168) Details ``` Comparing HEAD and avoid_concat

Re: [PR] chore: deprecate_paste_crate [datafusion]

2026-03-14 Thread via GitHub
coderfender commented on PR #20946: URL: https://github.com/apache/datafusion/pull/20946#issuecomment-4060914370 @comphead , I took the more laborious approach to remove paste crate and replace the macro defs with elaborated arguments than trying to find a new package. Almost all other pas

Re: [PR] chore: deprecate_paste_crate [datafusion]

2026-03-14 Thread via GitHub
coderfender commented on PR #20946: URL: https://github.com/apache/datafusion/pull/20946#issuecomment-4060909997 @martin-g , ready for your review -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

Re: [PR] perf: Coalesce broadcast exchange batches before broadcasting [datafusion-comet]

2026-03-14 Thread via GitHub
mbutrovich commented on PR #3703: URL: https://github.com/apache/datafusion-comet/pull/3703#issuecomment-4060925102 In addition to TPC-H, I will see if we can come up with a microbenchmark for this. -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [PR] feat: support optional threshold parameter for levenshtein function [datafusion]

2026-03-14 Thread via GitHub
n0r0shi commented on PR #20487: URL: https://github.com/apache/datafusion/pull/20487#issuecomment-4060924960 @davidlghellin Thanks for your work on this! I'd like to check your PR and port some of your test cases into mine. If I do, I'll add you as co-author so your contribution is recogniz

Re: [PR] [bench] Add dynamic join switching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20947: URL: https://github.com/apache/datafusion/pull/20947#issuecomment-4060927179 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20947#issuecomment-4060897231) Details ``` Comparing HEAD and adaptive_switch

Re: [PR] fix: enforce schema evolution config at runtime in native_datafusion scan [datafusion-comet]

2026-03-14 Thread via GitHub
andygrove commented on PR #3689: URL: https://github.com/apache/datafusion-comet/pull/3689#issuecomment-4060934747 I am leaning towards just documenting this is a difference -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

Re: [PR] [bench] Add dynamic join switching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20947: URL: https://github.com/apache/datafusion/pull/20947#issuecomment-4060936934 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20947#issuecomment-4060897231) Details ``` Comparing HEAD and adaptive_switch

Re: [PR] fix: enforce schema evolution config at runtime in native_datafusion scan [datafusion-comet]

2026-03-14 Thread via GitHub
andygrove closed pull request #3689: fix: enforce schema evolution config at runtime in native_datafusion scan URL: https://github.com/apache/datafusion-comet/pull/3689 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [bench] Add dynamic join switching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20947: URL: https://github.com/apache/datafusion/pull/20947#issuecomment-4060938032 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20947#issuecomment-4060897231) Details ``` Comparing HEAD and adaptive_switch

Re: [PR] Support `columns_sorted` in row_filters [datafusion]

2026-03-14 Thread via GitHub
sdf-jkl commented on PR #20497: URL: https://github.com/apache/datafusion/pull/20497#issuecomment-4061269624 Sorry, I think I got things mixed up while working on this. We consider a column `sorted` by checking `page_index` ordering (`min/max`) for that column across pages in each row

[PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
Dandandan opened a new pull request, #20948: URL: https://github.com/apache/datafusion/pull/20948 ## Which issue does this PR close? - Closes #. ## Rationale for this change ## What changes are included in this PR? ## Are these changes teste

Re: [PR] [bench] Add dynamic join switching [datafusion]

2026-03-14 Thread via GitHub
Dandandan closed pull request #20947: [bench] Add dynamic join switching URL: https://github.com/apache/datafusion/pull/20947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[PR] feat: enable scheduler rest api by default [datafusion-ballista]

2026-03-14 Thread via GitHub
milenkovicm opened a new pull request, #1506: URL: https://github.com/apache/datafusion-ballista/pull/1506 # Which issue does this PR close? Closes #. # Rationale for this change - user experience improvement # What changes are included in this PR? - rest a

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
Dandandan opened a new pull request, #20949: URL: https://github.com/apache/datafusion/pull/20949 Use batched hash table probes via iter_hash to hide memory latency. For each batch of 8 values: deduplicate by value comparison, hash only unique values, create iter_hash iterators (triggering

Re: [PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20949: URL: https://github.com/apache/datafusion/pull/20949#issuecomment-4061293481 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20949#issuecomment-4061289261) `Linux bench-c4061289261-248-c86hm 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20949: URL: https://github.com/apache/datafusion/pull/20949#issuecomment-4061293653 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20949#issuecomment-4061289261) `Linux bench-c4061289261-249-jcl8q 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20949: URL: https://github.com/apache/datafusion/pull/20949#issuecomment-4061294998 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20949#issuecomment-4061289261) `Linux bench-c4061289261-247-s84tw 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061302835 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) Details ``` Comparing HEAD and try_batch_join

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061280332 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) `Linux bench-c4061274337-246-cj8dn 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061280088 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) `Linux bench-c4061274337-244-l589v 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061280272 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) `Linux bench-c4061274337-245-8wvxt 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20949: URL: https://github.com/apache/datafusion/pull/20949#issuecomment-4061289261 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061313192 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) Details ``` Comparing HEAD and try_batch_join

Re: [PR] [bench] add join batching [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20948: URL: https://github.com/apache/datafusion/pull/20948#issuecomment-4061314018 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20948#issuecomment-4061274337) Details ``` Comparing HEAD and try_batch_join

Re: [PR] [bench] Batch intern lookups by 8 for GroupValuesPrimitive and ArrowBytesViewMap [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20949: URL: https://github.com/apache/datafusion/pull/20949#issuecomment-4061317224 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20949#issuecomment-4061289261) Details ``` Comparing HEAD and try_batch_agg

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061491959 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061451690) Details ``` Comparing HEAD and avoid_concat

Re: [PR] Support `columns_sorted` in row_filters [datafusion]

2026-03-14 Thread via GitHub
sdf-jkl commented on PR #20497: URL: https://github.com/apache/datafusion/pull/20497#issuecomment-4061492128 They are unlikely to be highly selective for row pruning, but we can't reliably assume they are always less selective than other predicates. My implementation here did the oppo

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061457522 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061451690) `Linux bench-c4061451690-251-9tcqh 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061457518 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061451690) `Linux bench-c4061451690-252-bj992 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061457509 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061451690) `Linux bench-c4061451690-250-dcl84 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061490039 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061451690) Details ``` Comparing HEAD and avoid_concat

[PR] [bench] Packed group by [datafusion]

2026-03-14 Thread via GitHub
Dandandan opened a new pull request, #20950: URL: https://github.com/apache/datafusion/pull/20950 ## Which issue does this PR close? - Closes #. ## Rationale for this change ## What changes are included in this PR? ## Are these changes teste

Re: [PR] [bench] Packed group by [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061513182 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) `Linux bench-c4061508067-253-gb4lr 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061513497 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) `Linux bench-c4061508067-255-78pq5 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061513461 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) `Linux bench-c4061508067-254-l4m4g 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061519605 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) `Linux bench-c4061515416-256-vg48g 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061519233 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) `Linux bench-c4061515416-257-mvhdh 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061521061 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) `Linux bench-c4061515416-258-cff8k 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061533903 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) Details ``` Comparing HEAD and packed-group-by

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061534647 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) `Linux bench-c4061533577-259-rlqf6 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061535108 Benchmark for [this request](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) failed. Last 20 lines of output: Click to expand ```

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061536394 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061537499 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) `Linux bench-c4061533577-261-wjh2g 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061537830 Benchmark for [this request](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) failed. Last 20 lines of output: Click to expand ```

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061537302 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) `Linux bench-c4061533577-260-jwwg4 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061538048 Benchmark for [this request](https://github.com/apache/datafusion/pull/20950#issuecomment-4061533577) failed. Last 20 lines of output: Click to expand ```

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061541477 run benchmarks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061543443 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061544033 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) Details ``` Comparing HEAD and packed-group-by

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061544922 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061508067) Details ``` Comparing HEAD and packed-group-by

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061545800 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061541477) `Linux bench-c4061541477-264-bvcfc 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061545591 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061541477) `Linux bench-c4061541477-263-hvbp8 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [bench] GroupValuesPacked [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20950: URL: https://github.com/apache/datafusion/pull/20950#issuecomment-4061545584 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20950#issuecomment-4061541477) `Linux bench-c4061541477-262-chwsl 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4061546099 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4061515416) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060655460 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060652003) `Linux bench-c4060652003-235-ttwqj 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [I] Dynamic switching of non-partitioned to partitioned for join and aggregation [datafusion]

2026-03-14 Thread via GitHub
Dandandan commented on issue #20847: URL: https://github.com/apache/datafusion/issues/20847#issuecomment-4060655814 I saw the overhead of query 99 seems to be mostly solved by avoiding `concat_batches` for all the values: `│ QQuery 99 │ 10721.95 / 10774.34 ±32.19 / 10821.75 ms │29

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060655472 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060652003) `Linux bench-c4060652003-236-hg9xq 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060654627 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060652003) `Linux bench-c4060652003-237-8w995 6.12.55+ #1 SMP Sun Feb 1 08:5

[I] Add version information to conf in CometConf. [datafusion-comet]

2026-03-14 Thread via GitHub
guixiaowen opened a new issue, #3700: URL: https://github.com/apache/datafusion-comet/issues/3700 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

Re: [PR] Add docstring examples for Scalar temporal functions [datafusion-python]

2026-03-14 Thread via GitHub
ntjohnson1 commented on PR #1424: URL: https://github.com/apache/datafusion-python/pull/1424#issuecomment-4060735652 My network connection on the plane is bad so I can't open the PRs for better discussion. Those missing functions are new since I branched to start this work. The groupin

[I] Bug: Images render inconsistently on mobile (some appear too small) [datafusion-site]

2026-03-14 Thread via GitHub
Abhinandankaushik opened a new issue, #157: URL: https://github.com/apache/datafusion-site/issues/157 ### Description While reading the blog post **"Avoid Consecutive Partitions"** on mobile devices, some images are rendered extremely small and become difficult to read. However, other im

Re: [I] Optimize CometBroadcastHashJoin: use CollectLeft partition mode and cache deserialized broadcast batches [datafusion-comet]

2026-03-14 Thread via GitHub
mbutrovich commented on issue #3692: URL: https://github.com/apache/datafusion-comet/issues/3692#issuecomment-4060738528 No worries. I can take a look next week as well. Thanks for chipping away at the native_DataFusion tasks! -- This is an automated message from the Apache Git Service.

[I] Add jdk21 for spark4.0.1 [datafusion-comet]

2026-03-14 Thread via GitHub
guixiaowen opened a new issue, #3701: URL: https://github.com/apache/datafusion-comet/issues/3701 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[PR] Add a version method to the configuration information of CometConf #3700 [datafusion-comet]

2026-03-14 Thread via GitHub
guixiaowen opened a new pull request, #3702: URL: https://github.com/apache/datafusion-comet/pull/3702 ## Which issue does this PR close? Closes #3700 ## Rationale for this change Add a version method to the configuration information of CometConf. E

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060602769 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060599747) `Linux bench-c4060599747-234-kcjvq 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060603476 🤖 Benchmark running (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060599747) `Linux bench-c4060599747-232-pwl4n 6.12.55+ #1 SMP Sun Feb 1 08:5

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060627979 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060599747) Details ``` Comparing HEAD and avoid_concat

Re: [PR] [Bench] Avoid concat_batches [datafusion]

2026-03-14 Thread via GitHub
adriangbot commented on PR #20944: URL: https://github.com/apache/datafusion/pull/20944#issuecomment-4060630710 🤖 Benchmark completed (GKE) | [trigger](https://github.com/apache/datafusion/pull/20944#issuecomment-4060599747) Details ``` Comparing HEAD and avoid_concat

  1   2   3   >