github  

Messages by Thread

• [PR] feat: run submitted physical plans through the adaptive planner [datafusion-ballista] via GitHub
• [PR] fix: Improve slow fuzz test `leaf_pushdown_fuzz` [datafusion] via GitHub
• [PR] MySQL: Gate DELETE LIMIT behind supports_delete_limit() [datafusion-sqlparser-rs] via GitHub
• [I] Run submitted physical plans through the adaptive planner [datafusion-ballista] via GitHub
• [I] Static planner drops a RepartitionExec with range partitioning instead of planning a range shuffle [datafusion-ballista] via GitHub
• [PR] Keep the parentheses of an empty CREATE PROCEDURE parameter list [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Keep the parentheses of an empty CREATE PROCEDURE parameter list [datafusion-sqlparser-rs] via GitHub
• [PR] PostgreSQL: Support PARTITION OF in CREATE FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
• Re: [I] chore: Explore combining `SessionConfig` and `RuntimeConfig` into same framework [datafusion] via GitHub
• [PR] PostgreSQL: Support column OPTIONS in CREATE FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support column OPTIONS in CREATE FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
• [PR] Set version on main to `56.0.0-dev`, document release versioning scheme [datafusion] via GitHub
• [PR] PostgreSQL: Support ALTER FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
• [PR] test: split integration_datafusion_test.rs into scoped files [datafusion-iceberg] via GitHub
• Re: [PR] perf: resolve aliased field once during metadata inference [datafusion] via GitHub
  • Re: [PR] perf: resolve aliased field once during metadata inference [datafusion] via GitHub
• Re: [PR] DataFrame API serialize columns to a JSON string column (#26185) [datafusion] via GitHub
• [PR] Bench 26156 [datafusion] via GitHub
  • Re: [PR] Bench 26156 [datafusion] via GitHub
  • Re: [PR] DRAFT Bench 26156 [datafusion] via GitHub
  • Re: [PR] DRAFT Bench 26156 [datafusion] via GitHub
• [PR] feat: prototype Comet Native Executors built on DataFusion Ballista [datafusion-comet] via GitHub
• Re: [I] [EPIC] Leaf expression pushdown and filter pushdown: bugs, decisions and tests [datafusion] via GitHub
• [I] [EPIC] Comet Native Executors: run Spark queries on native executors built on DataFusion Ballista [datafusion-comet] via GitHub
• Re: [I] Add optional fully-native deployment mode (Ballista-backed) [datafusion-comet] via GitHub
  • Re: [I] Add optional fully-native deployment mode (Ballista-backed) [datafusion-comet] via GitHub
• [PR] docs: [branch-1.2] document known differences new in 1.2.0 in the upgrade guide [datafusion-comet] via GitHub
• Re: [PR] [DO NOT MERGE] Test DataFusion against arrow/parquet 60.1.0 release candidate (apache/arrow-rs#11750) [datafusion] via GitHub
• [PR] PostgreSQL: Support CREATE USER MAPPING [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support CREATE USER MAPPING [datafusion-sqlparser-rs] via GitHub
• [PR] Snowflake: Add DROP EXTERNAL VOLUME [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Snowflake: Add DROP EXTERNAL VOLUME [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Snowflake: Add DROP EXTERNAL VOLUME [datafusion-sqlparser-rs] via GitHub
• [PR] PostgreSQL: Support ALTER SERVER [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support ALTER SERVER [datafusion-sqlparser-rs] via GitHub
• [PR] PostgreSQL: Support ALTER TABLE ATTACH PARTITION [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support ALTER TABLE ATTACH PARTITION [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support ALTER TABLE ATTACH PARTITION [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support ALTER TABLE ATTACH PARTITION [datafusion-sqlparser-rs] via GitHub
• [PR] PostgreSQL: Support DROP and COMMENT ON FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support DROP and COMMENT ON FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support DROP and COMMENT ON FOREIGN TABLE [datafusion-sqlparser-rs] via GitHub
• Re: [I] TopK aggregation duplicates NaN groups and can panic during eviction [datafusion] via GitHub
• [PR] bench: add stacked wide projection cases to sql_planner [datafusion] via GitHub
  • Re: [PR] bench: add stacked wide projection cases to sql_planner [datafusion] via GitHub
  • Re: [PR] bench: add stacked wide projection cases to sql_planner [datafusion] via GitHub
• Re: [PR] fix: evaluate a volatile `BETWEEN` value one time [datafusion] via GitHub
• Re: [PR] Fix volatile projection filter pushdown [datafusion] via GitHub
  • Re: [PR] Fix volatile projection filter pushdown [datafusion] via GitHub
  • Re: [PR] Fix volatile projection filter pushdown [datafusion] via GitHub
• [PR] ci: bound sort-axis smoke benchmark inputs [datafusion] via GitHub
  • Re: [PR] ci: bound sort-axis smoke benchmark inputs [datafusion] via GitHub
• [PR] test: reduce spill-presence fixture sizes [datafusion] via GitHub
• [PR] test: parallelize clustered grouping test coverage [datafusion] via GitHub
  • Re: [PR] test: parallelize clustered grouping test coverage [datafusion] via GitHub
• [PR] test: reuse null-aware join fuzz reference results [datafusion] via GitHub
  • Re: [PR] test: reuse null-aware join fuzz reference results [datafusion] via GitHub
• Re: [I] Iceberg native scan fails queries on tables whose column names are case-distinct to Java but not to Rust [datafusion-comet] via GitHub
• [PR] fix: treat an uncorrelated scalar subquery as a constant in ordering checks [datafusion] via GitHub
• Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
  • Re: [PR] perf: reuse projection schema in `OptimizeProjections` instead of recomputing it [datafusion] via GitHub
• Re: [I] Incorrect result when use volatile function alias in having clause [datafusion] via GitHub
  • Re: [I] Incorrect result when use volatile function alias in having clause [datafusion] via GitHub
• [PR] fix: [branch-1.2] spill a native PartialMerge whose input is sorted on some of its keys (#7222) [datafusion-comet] via GitHub
  • Re: [PR] fix: [branch-1.2] spill a native PartialMerge whose input is sorted on some of its keys (#7222) [datafusion-comet] via GitHub
• Re: [I] Native PartialMerge over input sorted on a prefix of its keys fails to spill on DataFusion 55.2 [datafusion-comet] via GitHub
• Re: [I] CommonSubexprEliminate + leaf-expression pushdown duplicate a UDF call wrapped in get_field [datafusion] via GitHub
• Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
  • Re: [PR] fix: correct NaN grouping and eviction in TopK aggregation [datafusion] via GitHub
• [PR] fix: [branch-1.2] fall back to Spark when the driver cannot use the ABFS authentication (#7221) [datafusion-comet] via GitHub
  • Re: [PR] fix: [branch-1.2] fall back to Spark when the driver cannot use the ABFS authentication (#7221) [datafusion-comet] via GitHub
• [I] make_date under a codegen-dispatched parent falls back to Spark since #7261 [datafusion-comet] via GitHub
  • Re: [I] make_date under a codegen-dispatched parent falls back to Spark since #7261 [datafusion-comet] via GitHub
  • Re: [I] make_date under a codegen-dispatched parent falls back to Spark since #7261 [datafusion-comet] via GitHub
• Re: [I] Decode a deletion vector once across the splits of a DV-backed file in the native Delta scan [datafusion-comet] via GitHub
  • Re: [I] Decode a deletion vector once across the splits of a DV-backed file in the native Delta scan [datafusion-comet] via GitHub
• Re: [I] Native Iceberg scan applies equality deletes to the wrong column when column names differ only in case [datafusion-comet] via GitHub
• [I] [Offset overflow] Filter merge buffers are not tracked by the memory pool [datafusion-comet] via GitHub
• Re: [I] [DISCUSS] Add open table format support. [datafusion-ballista] via GitHub
  • Re: [I] [DISCUSS] Add open table format support. [datafusion-ballista] via GitHub
  • Re: [I] [DISCUSS] Add open table format support. [datafusion-ballista] via GitHub
  • Re: [I] [DISCUSS] Add open table format support. [datafusion-ballista] via GitHub
  • Re: [I] [DISCUSS] Add open table format support. [datafusion-ballista] via GitHub
• Re: [PR] perf: specialize CASE WHEN for divide-by-zero protection [datafusion] via GitHub
• Re: [PR] fix: charge RepartitionExec coalescer buffers to the memory pool [datafusion] via GitHub
• Re: [PR] fix: Enter provider runtime when polling `FFI_TableProvider` methods [datafusion] via GitHub
• Re: [PR] feat: blocked agg with dynamic flat and blocked [datafusion] via GitHub
• [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
  • Re: [PR] fix: preserve make_date evaluation across lazy operators [datafusion-comet] via GitHub
• Re: [I] Regression: `ORDER BY col, (scalar subquery) LIMIT` over a `RIGHT JOIN` fails in `SanityCheckPlan` [datafusion] via GitHub
  • Re: [I] Regression: `ORDER BY col, (scalar subquery) LIMIT` over a `RIGHT JOIN` fails in `SanityCheckPlan` [datafusion] via GitHub
• [PR] Iceberg bin pack compaction test [datafusion-comet] via GitHub
• [PR] feat: [branch-1.2] support the S3A magic committer in native Parquet writes (#6940) [datafusion-comet] via GitHub
  • Re: [PR] feat: [branch-1.2] support the S3A magic committer in native Parquet writes (#6940) [datafusion-comet] via GitHub
• Re: [PR] feat: report the ordering and partitioning of materialized CTE scans [datafusion] via GitHub
  • Re: [PR] feat: report the ordering and partitioning of materialized CTE scans [datafusion] via GitHub
• Re: [PR] fix: bound parallel batch sorting in SortExec [datafusion] via GitHub
• Re: [I] concat_ws on array arguments silently stringifies the arrays [datafusion] via GitHub
• [PR] fix: pass the session batch size to the native FilterExec [datafusion-comet] via GitHub
• Re: [I] Support the S3A magic committer in native Parquet writes to S3 [datafusion-comet] via GitHub
• [PR] perf: use native distinct accumulator for COUNT(DISTINCT) on Decimal32/Decimal64 [datafusion] via GitHub
  • Re: [PR] perf: use native distinct accumulator for COUNT(DISTINCT) on Decimal32/Decimal64 [datafusion] via GitHub
  • Re: [PR] perf: use native distinct accumulator for COUNT(DISTINCT) on Decimal32/Decimal64 [datafusion] via GitHub
  • Re: [PR] perf: use native distinct accumulator for COUNT(DISTINCT) on Decimal32/Decimal64 [datafusion] via GitHub
  • Re: [PR] perf: use native distinct accumulator for COUNT(DISTINCT) on Decimal32/Decimal64 [datafusion] via GitHub
• [I] [Offset overflow] TopK emit interleaves all K rows into one batch (upstream) [datafusion-comet] via GitHub
• [I] Bound the executor client pool's shared connection slots [datafusion-ballista] via GitHub
• Re: [PR] fix: preserve field metadata for simple CASE branches [datafusion] via GitHub
  • Re: [PR] fix: preserve field metadata for simple CASE branches [datafusion] via GitHub
  • Re: [PR] fix: preserve field metadata for simple CASE branches [datafusion] via GitHub
  • Re: [PR] fix: preserve field metadata for simple CASE branches [datafusion] via GitHub
• [PR] fix: keep `SIMILAR TO` when unparsing expressions [datafusion] via GitHub
• [PR] feat: reuse range partitioning for audited date_bin aggregation [datafusion] via GitHub
  • Re: [PR] feat: reuse range partitioning for audited date_bin aggregation [datafusion] via GitHub
• Re: [I] Merge duplicated wildcard arms in LogicalPlanBuilder project_with_validation [datafusion] via GitHub
• Re: [PR] fix: count shared view buffers once in ExternalSorter reservations [datafusion] via GitHub
  • Re: [PR] fix: count shared view buffers once in ExternalSorter reservations [datafusion] via GitHub
  • Re: [PR] fix: count shared view buffers once in ExternalSorter reservations [datafusion] via GitHub
• Re: [PR] feat(iceberg): scan Iceberg tables in Ballista [datafusion-ballista] via GitHub
• [PR] fix(scheduler): discard a rolled-back stage's partial outputs before it re-runs [datafusion-ballista] via GitHub
  • Re: [PR] fix(scheduler): discard a rolled-back stage's partial outputs before it re-runs [datafusion-ballista] via GitHub
  • Re: [PR] fix(scheduler): discard a rolled-back stage's partial outputs before it re-runs [datafusion-ballista] via GitHub
  • Re: [PR] fix(scheduler): discard a rolled-back stage's partial outputs before it re-runs [datafusion-ballista] via GitHub
• Re: [I] Estimate equality to a scalar subquery without a blanket 20% fallback [datafusion] via GitHub
• Re: [I] Negative-scale decimal cast to timestamp panics [datafusion-comet] via GitHub
• [PR] PostgreSQL: Parse namespaced storage parameters [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Parse namespaced storage parameters [datafusion-sqlparser-rs] via GitHub
• Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
  • Re: [PR] Rename `LogicalPlan::DescribeTable` to `LogicalPlan::Show` move statement implementations out of `sql` module [datafusion] via GitHub
• [PR] PostgreSQL: Support `ALTER TABLE ... RESET` and storage parameters without a value [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Support `ALTER TABLE ... RESET` and storage parameters without a value [datafusion-sqlparser-rs] via GitHub
• [PR] chore(deps): bump qs from 6.15.3 to 6.17.0 in /datafusion/wasmtest/datafusion-wasm-app [datafusion] via GitHub
• [I] Pipelined writer: lock-free coalescing and non-blocking fan-out sends [datafusion-ballista] via GitHub
• Re: [I] Materialized CTE scans report unknown statistics, ordering and partitioning [datafusion] via GitHub
• [PR] PostgreSQL: Accept CREATE EXTENSION options without WITH and in any order [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] PostgreSQL: Accept CREATE EXTENSION options without WITH and in any order [datafusion-sqlparser-rs] via GitHub
• [I] [Offset overflow] Byte limit in arrow BatchCoalescer and DataFusion LimitedBatchCoalescer (upstream) [datafusion-comet] via GitHub
• [PR] docs: add blocking and pipelined results to the benchmarking page [datafusion-ballista] via GitHub
• [PR] Ordering tests on dictionary types [datafusion] via GitHub
  • Re: [PR] Ordering tests on dictionary types [datafusion] via GitHub
  • Re: [PR] Ordering tests on dictionary types [datafusion] via GitHub
• Re: [I] Quoted AST values and tokens can serialize to non-equivalent SQL [datafusion-sqlparser-rs] via GitHub
• [I] Shuffle reader locations carry a full ExecutorMetadata per partition [datafusion-ballista] via GitHub
• [I] Account for pipelined exchange buffers in the DataFusion memory pool [datafusion-ballista] via GitHub
• [PR] docs: publish versioned docs from versions.json with a workflow and build script [datafusion] via GitHub
  • Re: [PR] docs: publish versioned docs from versions.json with a workflow and build script [datafusion] via GitHub
  • Re: [PR] docs: publish older version docs from versions.json with a workflow and build script [datafusion] via GitHub
  • Re: [PR] docs: publish older version docs from versions.json with a workflow and build script [datafusion] via GitHub
  • Re: [PR] docs: publish older version docs from versions.json with a workflow and build script [datafusion] via GitHub
• [I] [Offset overflow] Hash join and nested loop join build side concatenated into one batch (upstream) [datafusion-comet] via GitHub
• [PR] docs: add 55.2.0 and 54.1.0 to the version picker [datafusion] via GitHub
• Re: [I] DataFrame::fill_null and fill_nan fail on column names with uppercase letters or dots [datafusion] via GitHub
• [I] [Offset overflow] In-memory table cache ignores spark.comet.batchSize [datafusion-comet] via GitHub
• [I] [Offset overflow] Broadcast exchange merges every batch into one [datafusion-comet] via GitHub
• [I] [Offset overflow] Native shuffle writer: retry with fewer rows on offset overflow [datafusion-comet] via GitHub
• [I] [Offset overflow] MergeRows and aggregate emit build batches larger than the batch size [datafusion-comet] via GitHub
• [I] [Offset overflow] BoundedWindowAggExec concatenates the unfinished partition buffer [datafusion-comet] via GitHub
• [I] [Offset overflow] Read large string/binary columns as view types [datafusion-comet] via GitHub
• [I] [Offset overflow] WindowAggExec concatenates the whole task input into one batch [datafusion-comet] via GitHub
• [I] [Offset overflow][EPIC] Native operators overflow Arrow's 2 GiB offset limit on large string/binary columns [datafusion-comet] via GitHub
• [I] [Offset overflow] Pass the session batch size to native FilterExec [datafusion-comet] via GitHub
• [PR] fix(proto): preserve `case_insensitive` of `SimilarTo` across a round trip [datafusion] via GitHub
• Re: [I] Incorrect Schema Adaption for CSV [datafusion] via GitHub
• [PR] fix: [branch-1.1] match SPARK-58821 and SPARK-60118 in sequence and string to decimal cast (#7171) [datafusion-comet] via GitHub
  • Re: [PR] fix: [branch-1.1] match SPARK-58821 and SPARK-60118 in sequence and string to decimal cast (#7171) [datafusion-comet] via GitHub
• [PR] fix: [branch-1.1] treat -0.0 and 0.0 as one value in arrays_overlap on Spark 4.0.5, 4.1.4 and 4.2.1 [datafusion-comet] via GitHub
  • Re: [PR] fix: [branch-1.1] treat -0.0 and 0.0 as one value in arrays_overlap on Spark 4.0.5, 4.1.4 and 4.2.1 [datafusion-comet] via GitHub
• [PR] fix(smj): compare all key types across batch boundaries in semi/anti/mark joins [datafusion] via GitHub
  • Re: [PR] fix(smj): compare all key types across batch boundaries in semi/anti/mark joins [datafusion] via GitHub

• Earlier messages
• Later messages