github

Messages by Date

2026/08/15 Re: [I] Potential optimization for CASE WHEN for protecting against divide by zero [datafusion] via GitHub
2026/08/15 Re: [I] [datafusion-spark] Optimize hex function [datafusion] via GitHub
2026/08/15 [PR] Support native scans with unprojected Spark 4 VARIANT columns [datafusion-comet] via GitHub
2026/08/15 [PR] perf(core): zero-copy block receive on the remote fetch path [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] bench: Add benchmarks for ordered `ARRAY_AGG` and `STRING_AGG` [datafusion] via GitHub
2026/08/15 Re: [PR] chore: bump rust-version to 1.97.1 [datafusion-ballista] via GitHub
2026/08/15 [PR] chore: bump rust-version to 1.97.1 [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] minor: validate config `default_null_ordering` when setting it [datafusion] via GitHub
2026/08/15 Re: [PR] minor: validate config `default_null_ordering` when setting it [datafusion] via GitHub
2026/08/15 [PR] minor: validate config `default_null_ordering` when setting it [datafusion] via GitHub
2026/08/15 [PR] minor: validate config `default_null_ordering` when setting it [datafusion] via GitHub
2026/08/15 [PR] fix: canonicalize NaN in flat arrays_overlap float keys [datafusion-comet] via GitHub
2026/08/15 Re: [PR] test: make expression benchmark harness fair and reproducible [datafusion-comet] via GitHub
2026/08/15 Re: [I] The config values aren't checked [datafusion] via GitHub
2026/08/15 Re: [I] The config values aren't checked [datafusion] via GitHub
2026/08/15 [PR] fix(scheduler): drop an executor's cached gRPC client when it is removed [datafusion-ballista] via GitHub
2026/08/15 [PR] test: report expression cost against a scan-and-transfer baseline [datafusion-comet] via GitHub
2026/08/15 [PR] feat: add micro benchmark runner and EC2 guide [datafusion-comet] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 Re: [PR] Misc shuffle code improvements [datafusion-ballista] via GitHub
2026/08/15 [PR] fix: log(0.0::float8) should error, not return -inf [datafusion] via GitHub
2026/08/15 Re: [I] PostgreSQL compatibility: `log(0.0::float8)` should error, not return `-inf` [datafusion] via GitHub
2026/08/15 Re: [PR] build(deps): bump async-trait from 0.1.89 to 0.1.92 [datafusion-python] via GitHub
2026/08/15 [PR] build(deps): bump async-trait from 0.1.89 to 0.1.92 [datafusion-python] via GitHub
2026/08/15 Re: [PR] build(deps): bump async-trait from 0.1.89 to 0.1.92 [datafusion-python] via GitHub
2026/08/15 [PR] Claude/shuffle code improvements [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 [I] Use end to end microbenchmarks to prevent performance regressions between releases [datafusion-comet] via GitHub
2026/08/15 Re: [PR] fix: match Spark whitespace trimming in to_time and try_to_time [datafusion-comet] via GitHub
2026/08/15 [I] Nine expression benchmark rows labelled "Comet" are measuring Spark [datafusion-comet] via GitHub
2026/08/15 [PR] test: make expression benchmark harness fair and reproducible [datafusion-comet] via GitHub
2026/08/15 Re: [I] ShuffleWriterExec renders a hardcoded "partitioning: None" instead of its real partitioning [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] fix(core): report the real partitioning from ShuffleWriterExec [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] perf: remove per-row String allocation from Spark soundex and quote [datafusion] via GitHub
2026/08/15 Re: [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 [PR] fix: report native shuffle write metrics accurately [datafusion-comet] via GitHub
2026/08/15 [PR] fix: preserve Catalyst nullability and field IDs in native Parquet writes [datafusion-comet] via GitHub
2026/08/15 Re: [PR] minor: Add alias of some SQL types (string, binary, uint64) [datafusion] via GitHub
2026/08/15 Re: [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] feat: Add support for Map type in SQL [datafusion] via GitHub
2026/08/15 Re: [PR] docs: add an agent skill for auditing datafusion-spark expressions [datafusion] via GitHub
2026/08/15 Re: [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] perf: Coalesce broadcast exchange batches before broadcasting [datafusion-comet] via GitHub
2026/08/15 Re: [PR] docs: add an agent skill for auditing datafusion-spark expressions [datafusion] via GitHub
2026/08/15 [PR] minor: Add alias of some SQL types (string, binary, uint64) [datafusion] via GitHub
2026/08/15 Re: [PR] Feat: add dictionaries as a supported group column type [datafusion] via GitHub
2026/08/15 Re: [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 [PR] feat: Add support for Map type in SQL [datafusion] via GitHub
2026/08/15 Re: [PR] fix: make UnnestExec respect datafusion.execution.batch_size [datafusion] via GitHub
2026/08/15 [I] Add support for `Map` type in SQL [datafusion] via GitHub
2026/08/15 [PR] docs: explain why Ballista uses a blocking shuffle [datafusion-ballista] via GitHub
2026/08/15 [PR] perf: serialize Python input directly from Comet Arrow vectors [datafusion-comet] via GitHub
2026/08/15 Re: [I] feat: add GroupColumn support for List / Struct / Map / FixedSizeList in multi-column GROUP BY [datafusion] via GitHub
2026/08/15 Re: [PR] fix(scheduler): label every operator in the DOT graph [datafusion-ballista] via GitHub
2026/08/15 Re: [I] DOT graph renders SortMergeJoinExec and SortPreservingMergeExec as "Unknown Operator" [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] fix(scheduler): label every operator in the DOT graph [datafusion-ballista] via GitHub
2026/08/15 Re: [I] feat: add generic FallbackGroupColumn so any Arrow type uses GroupValuesColumn (no fallback to GroupValuesRows) [datafusion] via GitHub
2026/08/15 Re: [PR] fix: match Spark whitespace trimming in to_time and try_to_time [datafusion-comet] via GitHub
2026/08/15 Re: [PR] fix: match Spark whitespace trimming in to_time and try_to_time [datafusion-comet] via GitHub
2026/08/15 Re: [PR] fix: GROUP BY returns two rows for the NULL group with a nullable UNIQUE constraint [datafusion] via GitHub
2026/08/15 Re: [PR] fix: GROUP BY returns two rows for the NULL group with a nullable UNIQUE constraint [datafusion] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 Re: [PR] Add FFI query planner support [datafusion-python] via GitHub
2026/08/15 Re: [PR] fix(scheduler): label every operator in the DOT graph [datafusion-ballista] via GitHub
2026/08/15 [PR] fix(core): report the real partitioning from ShuffleWriterExec [datafusion-ballista] via GitHub
2026/08/15 [I] ShuffleWriterExec renders a hardcoded "partitioning: None" instead of its real partitioning [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] fix(ci): apply cargo fmt to chaos-executor [datafusion-ballista] via GitHub
2026/08/15 Re: [I] Expression simplification of `col ~ '.*'` to `col IS NOT NULL` drops NULL semantics [datafusion] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 [PR] fix(scheduler): label every operator in the DOT graph [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] fix: preserve NULL semantics when simplifying col ~ '.*' [datafusion] via GitHub
2026/08/15 Re: [PR] fix: preserve NULL semantics when simplifying col ~ '.*' [datafusion] via GitHub
2026/08/15 [PR] fix(ci): apply cargo fmt to chaos-executor [datafusion-ballista] via GitHub
2026/08/15 Re: [I] Replace small hand-rolled element loops with arrow kernels and arity helpers [datafusion-comet] via GitHub
2026/08/15 [I] DOT graph renders SortMergeJoinExec and SortPreservingMergeExec as "Unknown Operator" [datafusion-ballista] via GitHub
2026/08/15 [I] to_time / try_to_time: native parser rejects 'T12' and '12:30:45.' which Spark accepts [datafusion-comet] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 [PR] refactor: replace remaining hand-rolled loops with Arrow kernels [datafusion-comet] via GitHub
2026/08/15 Re: [PR] fix: match Spark whitespace trimming in to_time and try_to_time [datafusion-comet] via GitHub
2026/08/15 Re: [I] Harden the k8s chaos backend before the #2029 kill scenarios [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 Re: [PR] refactor: hook native Parquet writes into Spark's WriteFilesExec seam [datafusion-comet] via GitHub
2026/08/15 Re: [PR] refactor: hook native Parquet writes into Spark's WriteFilesExec seam [datafusion-comet] via GitHub
2026/08/15 Re: [PR] refactor: hook native Parquet writes into Spark's WriteFilesExec seam [datafusion-comet] via GitHub
2026/08/15 Re: [PR] test(chaos): add a Kubernetes (kind) backend for the chaos harness [datafusion-ballista] via GitHub
2026/08/15 [I] Harden the k8s chaos backend before the #2029 kill scenarios [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/15 Re: [PR] test: centralize physical plan snapshot assertions [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] chore(deps): bump the DataFusion pin to the 55.0.0-rc3 tag [datafusion-ballista] via GitHub
2026/08/15 Re: [I] use `insta::assert_snapshot!` for all plan assertions [datafusion-ballista] via GitHub
2026/08/15 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/08/15 Re: [I] `PiecewiseMergeJoin` changes state before draining its output coalescer: the Left/Full unmatched pass repeats forever, queued Right/Full rows can be dropped [datafusion] via GitHub
2026/08/15 Re: [PR] fix: drain PiecewiseMergeJoin output before state transitions [datafusion] via GitHub
2026/08/15 Re: [PR] bench: pwmj left semi/anti join [datafusion] via GitHub
2026/08/15 Re: [PR] fix: drain PiecewiseMergeJoin output before state transitions [datafusion] via GitHub
2026/08/15 Re: [PR] bench: pwmj left semi/anti join [datafusion] via GitHub
2026/08/15 Re: [PR] bench: pwmj left semi/anti join [datafusion] via GitHub
2026/08/15 Re: [PR] perf: Reduce record batch memory accounting overhead [datafusion] via GitHub
2026/08/15 Re: [PR] perf: Reduce record batch memory accounting overhead [datafusion] via GitHub
2026/08/15 Re: [I] Significant overhead in datafusion_common::utils::memory::get_record_batch_memory_size [datafusion] via GitHub
2026/08/15 Re: [PR] perf: Reduce record batch memory accounting overhead [datafusion] via GitHub
2026/08/15 [PR] WIP: NOT READY FOR REVIEW: Add parquet `progressive_io` option to keep one-shot row group I/O with pushdown filters [datafusion] via GitHub
2026/08/15 [PR] fix: adapt input batches with stricter nested nullability to planned schema in aggregation [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Enable more clippy lints [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/08/15 Re: [PR] fix: ScalarSubqueryToJoin fails when CTE inside correlated scalar subquery [datafusion] via GitHub
2026/08/15 Re: [I] Parquet Pushdown Filters: Way to keep the I/O pattern the same when pushdown filters are enabled [datafusion] via GitHub
2026/08/15 [I] Parquet Pushdown Filters: Way to keep the I/O pattern the same when pushdown filters are enabled [datafusion] via GitHub
2026/08/15 Re: [I] Parquet Pushdown Filters: Way to keep the I/O pattern the same when pushdown filters are enabled [datafusion] via GitHub
2026/08/15 Re: [PR] Prefetch Parquet row groups with a bounded I/O budget [datafusion] via GitHub
2026/08/15 [PR] Close the remaining gaps in the parser recursion counter [datafusion-sqlparser-rs] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] fix: make UnnestExec respect datafusion.execution.batch_size [datafusion] via GitHub
2026/08/15 Re: [I] DataFusion 54.1.0 has a breaking API change [datafusion] via GitHub
2026/08/15 Re: [PR] docs(upgrading): document RecursiveQuery schema field in upgrade guide [datafusion] via GitHub
2026/08/15 Re: [I] Document decimal AVG wrapping arithmetic behind explicit helpers [datafusion] via GitHub
2026/08/15 Re: [PR] Document decimal AVG wrapping arithmetic [datafusion] via GitHub
2026/08/15 Re: [I] Avoid per-row String allocation when hex-encoding digest output (md5, sha1, sha2) [datafusion] via GitHub
2026/08/15 Re: [PR] Perf: remove extra allocations for hex operations [datafusion] via GitHub
2026/08/15 Re: [I] Arrow IPC stream format is silently lost when a scan is serialized to protobuf [datafusion] via GitHub
2026/08/15 Re: [PR] docs: Document `WindowFn` and add comments [datafusion] via GitHub
2026/08/15 Re: [PR] fix(proto): preserve Arrow IPC stream format [datafusion] via GitHub
2026/08/15 Re: [PR] Document decimal AVG wrapping arithmetic [datafusion] via GitHub
2026/08/15 Re: [PR] docs(upgrading): document RecursiveQuery schema field in upgrade guide [datafusion] via GitHub
2026/08/15 Re: [PR] fix(proto): preserve Arrow IPC stream format [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Improve planning speed: Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/15 Re: [PR] Prune parquet row groups using fully dictionary-encoded columns [datafusion] via GitHub
2026/08/15 Re: [PR] Prefetch Parquet row groups with a bounded I/O budget [datafusion] via GitHub
2026/08/15 Re: [PR] fix: translate SQL wildcards in SIMILAR TO patterns (#22263) [datafusion] via GitHub
2026/08/15 Re: [PR] perf(parquet): skip RowFilter on statically fully-matched row groups [datafusion] via GitHub
2026/08/15 Re: [PR] perf(parquet): skip RowFilter on statically fully-matched row groups [datafusion] via GitHub
2026/08/15 Re: [I] Unify the `ExecBuilder` pattern across physical operators [datafusion] via GitHub
2026/08/15 Re: [PR] fix(spark): correct mod ANSI zero divisor and negative zero handling [datafusion] via GitHub
2026/08/15 Re: [I] Unify the `ExecBuilder` pattern across physical operators [datafusion] via GitHub
2026/08/15 Re: [I] Unify the `ExecBuilder` pattern across physical operators [datafusion] via GitHub
2026/08/15 Re: [PR] perf(parquet): skip RowFilter on statically fully-matched row groups [datafusion] via GitHub
2026/08/15 Re: [PR] perf(parquet): skip RowFilter on statically fully-matched row groups [datafusion] via GitHub
2026/08/15 Re: [PR] perf(parquet): skip RowFilter on statically fully-matched row groups [datafusion] via GitHub
2026/08/15 Re: [PR] Enable more clippy lints [datafusion] via GitHub
2026/08/15 Re: [PR] feat: union nested Parquet leaves across projection accesses [datafusion] via GitHub
2026/08/15 Re: [I] Delegate int/float/boolean to decimal cast arms to arrow safe cast [datafusion-comet] via GitHub
2026/08/14 Re: [PR] introduce optional rle reads from parquet [datafusion] via GitHub
2026/08/14 Re: [PR] fix: guard against silent fail_on_error loss in scalar wiring (#5074) [datafusion-comet] via GitHub
2026/08/14 Re: [PR] fix: make CometExplodeExec respect batch size [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat(physical-plan): Make `HashTableLookupExpr` serializable [datafusion] via GitHub
2026/08/14 Re: [I] Add named notation for user defined function arguments [datafusion] via GitHub
2026/08/14 Re: [PR] perf: use columnar state for ordered `ARRAY_AGG` and `STRING_AGG` [datafusion] via GitHub
2026/08/14 [PR] fix: match Spark whitespace trimming in to_time and try_to_time [datafusion-comet] via GitHub
2026/08/14 Re: [PR] bench: Add benchmarks for ordered `ARRAY_AGG` and `STRING_AGG` [datafusion] via GitHub
2026/08/14 [PR] perf: use columnar state for ordered `ARRAY_AGG` and `STRING_AGG` [datafusion] via GitHub
2026/08/14 Re: [PR] fix: preserve NULL semantics in bitwise xor simplification [datafusion] via GitHub
2026/08/14 [PR] bench: Add benchmarks for ordered `ARRAY_AGG` and `STRING_AGG` [datafusion] via GitHub
2026/08/14 [PR] chore(deps): bump the DataFusion pin to the 55.0.0-rc3 tag [datafusion-ballista] via GitHub
2026/08/14 Re: [I] [EPIC] Reimplement Scala expression microbenchmarks so they measure expression cost, not scan and result transfer [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat(physical-plan): Make `HashTableLookupExpr` serializable [datafusion] via GitHub
2026/08/14 [I] [EPIC] Reimplement Scala expression microbenchmarks so they measure expression cost, not scan and result transfer [datafusion-comet] via GitHub
2026/08/14 [I] Support config matrix for slt tests [datafusion] via GitHub
2026/08/14 Re: [PR] fix: Align struct cast behavior with Lists and Maps [datafusion] via GitHub
2026/08/14 Re: [PR] Revise example usage section headings [datafusion] via GitHub
2026/08/14 Re: [PR] Support spilling for WindowAggExec [datafusion] via GitHub
2026/08/14 Re: [PR] fix: guard against silent fail_on_error loss in scalar wiring (#5074) [datafusion-comet] via GitHub
2026/08/14 Re: [I] Run replace natively by default when the search string is a non-empty literal [datafusion-comet] via GitHub
2026/08/14 Re: [I] Release DataFusion `55.0.0` (Jul / Aug 2026) [datafusion] via GitHub
2026/08/14 Re: [PR] chore: drop Spark 3.4 support [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/14 Re: [PR] chore: Bump release candidate version to 55.0.0rc3 [datafusion-python] via GitHub
2026/08/14 Re: [PR] Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/14 [PR] Fast path for `union_schema` when all children share a schema [datafusion] via GitHub
2026/08/14 Re: [I] `WITH ORDINALITY` is silently dropped on table functions [datafusion] via GitHub
2026/08/14 Re: [I] `WITH ORDINALITY` is silently dropped on table functions [datafusion] via GitHub
2026/08/14 [I] `WITH ORDINALITY` is silently dropped on table functions [datafusion] via GitHub
2026/08/14 [PR] fix: reject duplicate field names during CSV and Parquet schema inference [datafusion] via GitHub
2026/08/14 Re: [PR] feat(physical-plan): Make `HashTableLookupExpr` serializable [datafusion] via GitHub
2026/08/14 [PR] chore: Bump release candidate version to 55.0.0rc3 [datafusion-python] via GitHub
2026/08/14 Re: [PR] feat: Sort-aware Iceberg reads in Comet via a per-partition streaming merge [datafusion-comet] via GitHub
2026/08/14 [I] Unify the `ExecBuilder` pattern across physical operators [datafusion] via GitHub
2026/08/14 Re: [PR] update changelog [datafusion] via GitHub
2026/08/14 Re: [PR] update changelog [datafusion] via GitHub
2026/08/14 Re: [I] [DISCUSSION] Restore Flight SQL support as a pluggable query frontend [datafusion-ballista] via GitHub
2026/08/14 Re: [PR] perf: Update `TableProvider` to take scan projection as `Option<&[usize]>` [datafusion] via GitHub
2026/08/14 Re: [PR] Prefetch Parquet row groups with a bounded I/O budget [datafusion] via GitHub
2026/08/14 Re: [PR] fix: make UnnestExec respect datafusion.execution.batch_size [datafusion] via GitHub
2026/08/14 Re: [PR] update changelog [datafusion] via GitHub
2026/08/14 Re: [PR] chore: drop Spark 3.4 support [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat: remove extra Rows from ReusableRows [datafusion] via GitHub
2026/08/14 [PR] fix: make CometExplodeExec respect batch size [datafusion-comet] via GitHub
2026/08/14 Re: [PR] feat: embedded flight proxy explicit config entry [datafusion-ballista] via GitHub
2026/08/14 Re: [PR] feat: implement native Iceberg V2 writer via iceberg-rust [datafusion-comet] via GitHub
2026/08/14 Re: [PR] perf: Update `TableProvider` to take scan projection as `Option<&[usize]>` [datafusion] via GitHub