github

Messages by Date

2026/10/02 Re: [PR] fix: skip the null-aware join when a NOT IN correlation duplicates the IN equality [datafusion] via GitHub
2026/10/02 Re: [PR] fix: hash every NaN like the canonical NaN in Spark xxhash64 [datafusion] via GitHub
2026/10/02 Re: [PR] fix: keep decimal fractions in modulo by one [datafusion] via GitHub
2026/10/02 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/02 Re: [PR] fix: array_concat panics or fails on non-default nested lists [datafusion] via GitHub
2026/10/02 Re: [PR] perf: stop redoing per-chunk setup on the hash join probe path [datafusion] via GitHub
2026/10/02 Re: [PR] refactor: deprecate statistics providers that duplicate operator estimates [datafusion] via GitHub
2026/10/02 Re: [PR] fix: canonicalize NaN in xxhash64 to match Spark behavior (fixes #25913) [datafusion] via GitHub
2026/10/02 Re: [PR] fix: canonicalize NaN in xxhash64 to match Spark behavior (fixes #25913) [datafusion] via GitHub
2026/10/02 Re: [PR] ci: key TPC dataset caches on pinned generators [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix(functions): prevent invalid sort omission in log monotonicity when base <= 1 [datafusion] via GitHub
2026/10/02 Re: [PR] ci: drop non-existent suites from the Linux and macOS test matrices [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/02 Re: [I] Avoid single-task execution for null-aware anti joins (NOT IN subqueries) [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] perf: PartitionedTopKRank on the shared store with decide-then-gather [datafusion] via GitHub
2026/10/02 Re: [I] Implement hash partitioned aggregation in Ballista [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] refactor: deprecate statistics providers that duplicate operator estimates [datafusion] via GitHub
2026/10/02 Re: [I] Enable benchmark data validation for distributed execution [datafusion-ballista] via GitHub
2026/10/02 Re: [I] The type of Float64 >= Int64 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: avoid query failures from inferred numeric cast bounds [datafusion] via GitHub
2026/10/02 Re: [PR] feat: error when the client and scheduler have different major versions [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: preserve sorts for wrapping integer negation [datafusion] via GitHub
2026/10/02 Re: [I] Support rolling upgrades without an outage window [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: Column statistics support v1 [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] fall back for incompatible regression aggregates (#6451) [datafusion-comet] via GitHub
2026/10/02 [I] Support rolling upgrades without an outage window [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Q10 SF1000 regression after #2315: SortPreservingMergeExec exhausts fair memory pool under AQE default-on [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: hash NaN the way Spark does in hash, xxhash64 and native shuffle [datafusion-comet] via GitHub
2026/10/02 Re: [PR] test: strengthen scalar UDF type recovery regression coverage [datafusion] via GitHub
2026/10/02 Re: [I] Consolidate built-in statistics estimation in one place [datafusion] via GitHub
2026/10/02 [PR] feat: record why Spark scans a relation cached in Comet's format when Comet is off [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: match Spark's float ordering in min, max, greatest and least [datafusion-comet] via GitHub
2026/10/02 Re: [PR] feat: error when the client and scheduler have different major versions [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Preserve primitive Iceberg pruning beside unsupported complex null conjuncts [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] match pre-epoch Iceberg temporal rounding (#6456) [datafusion-comet] via GitHub
2026/10/02 Re: [I] Ballista: Fix hacks around concurrency=2 to force hash-partitioned joins [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Q10 SF1000 regression after #2315: SortPreservingMergeExec exhausts fair memory pool under AQE default-on [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Stop showing very verbose streaming errors [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Avoid single-task execution for null-aware anti joins (NOT IN subqueries) [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Integration test script should test the Python bindings [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Native blocks without a JVM input publish SQL metrics on every batch, ignoring spark.comet.metrics.updateInterval [datafusion-comet] via GitHub
2026/10/02 Re: [I] Implement fast path for QueryStageExec when writing 1 shuffle partition [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Implement hash partitioned aggregation in Ballista [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] coerce native IF branches to a common type (#6458) [datafusion-comet] via GitHub
2026/10/02 Re: [I] The type of Timestamp(Nanosecond, None) >= Date32 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [I] The type of Float64 >= Int64 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Integration test script should test the Python bindings [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add python crate to workspace [datafusion-ballista] via GitHub
2026/10/02 [PR] fix: plan and run repeated SUM(x + literal) on decimals and intervals [datafusion] via GitHub
2026/10/02 Re: [I] Move ballista-proto to separate module/crate [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Move ballista-proto to separate module/crate [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Scheduler infinite loop after failed/canceled job [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Scheduler infinite loop after failed/canceled job [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add python crate to workspace [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Stop showing very verbose streaming errors [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Broadcast join promotion drops a sort order required by a parent SortMergeJoinExec, silently producing wrong results [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Implement memory management in shuffle writer [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/02 Re: [I] Implement memory management in shuffle writer [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista: Executor must return statistics in CompletedTask / CompletedJob [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Configuration guide should be generated from code [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Configuration guide should be generated from code [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista: Executor must return statistics in CompletedTask / CompletedJob [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Broadcast join promotion drops a sort order required by a parent SortMergeJoinExec, silently producing wrong results [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Enable benchmark data validation for distributed execution [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Provide integration with Grafana / Prometheus [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Optimize shuffle before coalesce [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Provide integration with Grafana / Prometheus [datafusion-ballista] via GitHub
2026/10/02 Re: [I] [Python] Allow configuration options to be set when creating BallistaContext [datafusion-ballista] via GitHub
2026/10/02 Re: [I] [Python] Allow configuration options to be set when creating BallistaContext [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add "Getting Started" docs to repo [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista should serialize Parquet statistics [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: enable Comet's in-memory cache by default [datafusion-comet] via GitHub
2026/10/02 Re: [I] Ballista: Fix hacks around concurrency=2 to force hash-partitioned joins [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista should serialize Parquet statistics [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Remove `datafusion.proto` and use the `datafusion-proto` api for logical plan serde [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Improve new top-level README for this project [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Distributed execution returns incorrect results for several TPC-DS queries (static planner) [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: publish metrics on the update interval for native blocks without a JVM input [datafusion-comet] via GitHub
2026/10/02 Re: [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 [I] S3 credential SPI: follow-ups from #6478 (hostless Iceberg metadata locations, docs, tests) [datafusion-comet] via GitHub
2026/10/02 Re: [I] Account for partitions in local TopK statistics [datafusion] via GitHub
2026/10/02 Re: [I] date_trunc rejects scalar timestamps that array evaluation accepts [datafusion] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 [PR] refactor: move shuffle planning into dedicated module [datafusion-comet] via GitHub
2026/10/02 [PR] test: strengthen scalar UDF type recovery regression coverage [datafusion] via GitHub
2026/10/02 Re: [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 Re: [I] Distributed execution returns incorrect results for several TPC-DS queries (static planner) [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Job hangs indefinitely instead of failing when all executors are lost [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: match Spark statistical aggregate updates and merges [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 [PR] Align statistics cache sharing test comments with reset-free contract [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/02 Re: [I] Implement FFI versions of runtime environment and execution properties [datafusion] via GitHub
2026/10/02 [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 Re: [I] percentile_approx returns different percentiles from Spark when its input holds a NaN with the sign bit set [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: account for row duplication and padding in join null counts [datafusion] via GitHub
2026/10/02 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/02 Re: [PR] feat: add opt-in probe selection for partitioned inner hash joins [datafusion] via GitHub
2026/10/02 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/02 Re: [PR] Generic: Parse IN lists that start with a parenthesized subquery [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] test: [branch-1.1] cover sliced boolean arrays in explode (#6473) [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: use session statistics registry in dfbench reports [datafusion] via GitHub
2026/10/02 Re: [PR] feat: add opt-in probe selection for partitioned inner hash joins [datafusion] via GitHub
2026/10/02 [PR] refactor: Implement optimizer hook for combining partial/final aggregate in `AggregateExec` [datafusion] via GitHub
2026/10/02 Re: [PR] Add ComposedNamedPhysicalExtensionCodec [datafusion] via GitHub
2026/10/02 Re: [PR] Add ComposedNamedPhysicalExtensionCodec [datafusion] via GitHub
2026/10/02 Re: [PR] chore(release): release the Python client separately from the Rust crates [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Discussion: release the Python client separately from the Rust crates [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] fix: infer LIMIT and OFFSET parameter types [datafusion] via GitHub
2026/10/02 Re: [PR] chore(ci): bump taiki-e/install-action from 2.87.21 to 2.87.22 [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] Feat(parquet) : Introduce support for optionally writing Distinct Values to statistics [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] perf: adapt generic hash join allocation to key cardinality [datafusion] via GitHub
2026/10/02 Re: [PR] chore: guard RangeExpr protobuf fields exhaustively [datafusion] via GitHub
2026/10/02 Re: [PR] chore: guard RangeExpr protobuf fields exhaustively [datafusion] via GitHub
2026/10/02 Re: [PR] Make StatisticsContext cache entries node-lifetime safe [datafusion] via GitHub
2026/10/02 Re: [PR] MSSQL: Preserve nonreserved keyword column expressions [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] Make StatisticsContext cache entries node-lifetime safe [datafusion] via GitHub
2026/10/02 Re: [PR] perf(date_trunc): significantly optimize date_trunc for fixed-offset timezones and coarse granularities binning [datafusion] via GitHub
2026/10/02 Re: [PR] SQLite: support == as assignment operator in UPDATE SET [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] feat: serialize LazyMemoryExec through generator hooks [datafusion] via GitHub
2026/10/02 Re: [PR] SQLite: support == as assignment operator in UPDATE SET [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] feat: serialize LazyMemoryExec through generator hooks [datafusion] via GitHub
2026/10/02 Re: [PR] Make StatisticsContext cache entries node-lifetime safe [datafusion] via GitHub
2026/10/02 Re: [I] Clarify how to run native Comet -> Celeborn shuffle end-to-end [datafusion-comet] via GitHub
2026/10/02 Re: [PR] MSSQL: Add typed TRY_PARSE expressions [datafusion-sqlparser-rs] via GitHub
2026/10/02 [I] Lambda examples in the SQL function docs fail with the default dialect [datafusion] via GitHub
2026/10/02 Re: [PR] MSSQL: Support deferred ON clauses in right-nested joins [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] fix: support zero-field struct group keys in aggregate emit [datafusion] via GitHub
2026/10/02 Re: [PR] fix: deduplicate StringView/BinaryView buffer refs in CollectLeft Has... [datafusion] via GitHub
2026/10/02 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/02 Re: [I] Wrong results: `NOT IN (subquery)` ignores NULLs from a nullable outer expression over `NOT NULL` columns [datafusion] via GitHub
2026/10/02 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/02 Re: [PR] fix: Decide NOT IN null-aware joins from expression nullability, not just column nullability [datafusion] via GitHub
2026/10/02 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/01 Re: [PR] fix: Decide NOT IN null-aware joins from expression nullability, not just column nullability [datafusion] via GitHub
2026/10/01 Re: [I] Wrong results: nullable constant `NOT IN (subquery)` returns every row when the subquery column is `NOT NULL` [datafusion] via GitHub
2026/10/01 Re: [PR] feat: run physical requirement enforcement first, as a PhysicalAnalyzer phase [datafusion] via GitHub
2026/10/01 [PR] refactor: move the remaining JNI-free entry point logic into core functions [datafusion-comet] via GitHub
2026/10/01 Re: [PR] Make StatisticsContext cache entries node-lifetime safe [datafusion] via GitHub
2026/10/01 Re: [PR] feat: run physical requirement enforcement first, as a PhysicalAnalyzer phase [datafusion] via GitHub
2026/10/01 Re: [I] PiecewiseMergeJoin returns wrong results for List keys with NULL elements and fails on Struct keys [datafusion] via GitHub
2026/10/01 Re: [PR] feat: Experimental local execution mode that runs a whole query as one DataFusion graph [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: clear_shrink(0) on rows should reset to original size + single group by fixes in clear_shrink [datafusion] via GitHub
2026/10/01 Re: [I] NestedLoopJoinExec memory-limited fallback returns an empty result (wrong count = 0) instead of spilling or erroring [datafusion] via GitHub
2026/10/01 Re: [PR] fix: reject scalar subqueries inside a codegen-dispatch kernel [datafusion-comet] via GitHub
2026/10/01 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/01 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/01 Re: [PR] fix: defer Parquet conversion errors until a row group is decoded, as Spark does [datafusion-comet] via GitHub
2026/10/01 Re: [I] Native Parquet scan fails on an empty file whose nested field type differs from the read schema [datafusion-comet] via GitHub
2026/10/01 Re: [I] Native regr_* aggregates return wrong results for a constant variable merged from several partitions [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: fall back to Spark for regr_* aggregates until their merge matches Spark [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: bin coarse date_bin timestamps in i128 and restore ordering [datafusion] via GitHub
2026/10/01 Re: [PR] feat: run physical requirement enforcement first, as a PhysicalAnalyzer phase [datafusion] via GitHub
2026/10/01 Re: [PR] fix: clear_shrink(0) on rows should reset to original size + single group by fixes in clear_shrink [datafusion] via GitHub
2026/10/01 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: clear_shrink(0) on rows should reset to original size + single group by fixes in clear_shrink [datafusion] via GitHub
2026/10/01 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/01 Re: [I] chore: Fix Scala code warnings [datafusion-comet] via GitHub
2026/10/01 [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/01 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/01 Re: [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/01 Re: [PR] feat: support first_value/last_value aggregates over sliding window frames [datafusion] via GitHub
2026/10/01 [PR] perf: route final aggregate buckets by column [datafusion] via GitHub
2026/10/01 Re: [PR] fix: validate recursive CTE column coercion [datafusion] via GitHub
2026/10/01 Re: [PR] feat: support first_value/last_value aggregates over sliding window frames [datafusion] via GitHub
2026/10/01 Re: [PR] Make StatisticsContext cache entries node-lifetime safe [datafusion] via GitHub
2026/10/01 [PR] feat: support first_value/last_value aggregates over sliding window frames [datafusion] via GitHub
2026/10/01 Re: [PR] fix: clear_shrink(0) on rows should reset to original size + single group by fixes in clear_shrink [datafusion] via GitHub
2026/10/01 [I] PiecewiseMergeJoin returns wrong results for List keys with NULL elements and fails on Struct keys [datafusion] via GitHub
2026/10/01 Re: [I] Use Exact Hash-Table Allocation Accounting in `GroupValuesRows` [datafusion] via GitHub
2026/10/01 Re: [PR] fix(physical-plan): replace approximate `map_size` accounting with exact `HashTable::allocation_size()` in `GroupValuesRows` [datafusion] via GitHub
2026/10/01 Re: [PR] fix(physical-plan): replace approximate `map_size` accounting with exact `HashTable::allocation_size()` in `GroupValuesRows` [datafusion] via GitHub
2026/10/01 [PR] chore(ci): bump taiki-e/install-action from 2.87.21 to 2.87.22 [datafusion-ballista] via GitHub
2026/10/01 Re: [I] `arrays_except` type mismatch [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: preserve compound expression equivalences through projection [datafusion] via GitHub
2026/10/01 Re: [I] LEFT JOIN with struct-field ORDER BY fails ordering validation [datafusion] via GitHub
2026/10/01 Re: [PR] test: [branch-1.1] fix flaky mixed field id directory test on Spark 3.4 and 3.5 (#6312) [datafusion-comet] via GitHub
2026/10/01 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/10/01 Re: [I] [EPIC] Native Variant Support [datafusion-comet] via GitHub
2026/10/01 Re: [PR] Allow the `HLLAccumulator` used by `approx_distinct()` to consume state produced by `HllGroupsAccumulator` [datafusion] via GitHub
2026/10/01 Re: [PR] Allow the `HLLAccumulator` used by `approx_distinct()` to consume state produced by `HllGroupsAccumulator` [datafusion] via GitHub
2026/10/01 Re: [PR] fix: validate recursive CTE column coercion [datafusion] via GitHub
2026/10/01 Re: [PR] feat: account JVM UDF Arrow allocations in Spark task memory [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: rescale decimal results from dispatched functions to the declared type [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: defer Parquet conversion errors until a row group is decoded, as Spark does [datafusion-comet] via GitHub
2026/10/01 Re: [I] Recursive CTE silently casts recursive term to the static term's type, producing wrong results or a non-terminating query [datafusion] via GitHub
2026/10/01 [PR] fix: validate recursive CTE column coercion [datafusion] via GitHub
2026/10/01 Re: [PR] Allow the `HLLAccumulator` used by `approx_distinct()` to consume state produced by `HllGroupsAccumulator` [datafusion] via GitHub
2026/10/01 Re: [PR] test: sweep Spark's -0.0 and NaN semantics across operators and float expressions [datafusion-comet] via GitHub
2026/10/01 Re: [PR] feat: wire native existence join support [datafusion-comet] via GitHub
2026/10/01 Re: [I] Add ExistenceJoin support to Comet native execution [datafusion-comet] via GitHub
2026/10/01 Re: [PR] fix: cast native IF branches to a common type like CASE WHEN [datafusion-comet] via GitHub
2026/10/01 Re: [I] Native IF fails with "column types must match schema types" when its branches differ in nested nullability [datafusion-comet] via GitHub