Messages by Thread
-
[PR] bench: plan unmarked, MATERIALIZED and NOT MATERIALIZED CTEs [datafusion]
adriangb (via GitHub) via github
-
Re: [PR] Prune parquet row groups using fully dictionary-encoded columns [datafusion]
adriangb (via GitHub) via github
-
[I] proto-common: decoding a malformed scalar, union type or CSV options panics instead of erroring [datafusion]
geoHeil (via GitHub) via github
-
[PR] chore(deps): bump tonic-prost-build from 0.14.7 to 0.14.9 [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[PR] chore(deps): bump tonic-prost from 0.14.6 to 0.14.9 in /python [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[PR] chore(ci): bump taiki-e/install-action from 2.87.32 to 2.88.1 [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[PR] chore(deps): bump tonic from 0.14.7 to 0.14.9 in /python [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[PR] chore(deps): bump tonic-prost-build from 0.14.7 to 0.14.9 in /python [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[I] SortPreservingMergeExec reads inputs one at a time when their key ranges are disjoint [datafusion]
zhuqi-lucas (via GitHub) via github
-
[PR] chore(ci): bump astral-sh/setup-uv from 10.3.2 to 10.3.3 [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
[PR] chore(deps): bump tonic-prost from 0.14.7 to 0.14.9 [datafusion-ballista]
dependabot[bot] (via GitHub) via github
-
Re: [PR] fix: bound WindowAgg and grouped TopK output batches [datafusion]
koriyoshi2041 (via GitHub) via github
-
[PR] fix: preserve the multiplication result type when simplifying A * 0 [datafusion]
ayushan003 (via GitHub) via github
-
Re: [PR] refactor(hash-aggr): Simplify partial hash aggregate with generator pattern [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat(parquet): prune explicitly ordered INT96 timestamps [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [I] physical-plan: decoding an Unnest or Explain node with an unset field panics [datafusion]
geoHeil (via GitHub) via github
-
Re: [PR] fix: Preimage rewrites are not allowed for volatile arguments [datafusion]
adriangb (via GitHub) via github
-
[PR] fix: return no rows from SortExec with fetch=0 instead of panicking i… [datafusion]
shahwazreza (via GitHub) via github
-
[I] Comet Native Executors: use Ballista's adaptive planning for joins inside Comet fragments [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] chore: regenerate ballista.rs after tonic-prost-build 0.14.7 bump [datafusion-ballista]
andygrove (via GitHub) via github
-
[I] `information_schema.views.defintion` contains DDL statement [datafusion]
pepijnve (via GitHub) via github
-
Re: [PR] build(deps): bump taiki-e/install-action from 2.87.22 to 2.87.30 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
[PR] build(deps): bump astral-sh/setup-uv from 10.2.0 to 10.3.3 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
[PR] build(deps): bump taiki-e/install-action from 2.87.22 to 2.88.0 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
Re: [PR] build(deps): bump astral-sh/setup-uv from 10.2.0 to 10.3.2 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
Re: [I] Dynamic filter pushdown into IcebergTableScan [datafusion-iceberg]
Perseus (via GitHub) via github
-
Re: [I] Nested struct field access on lambda parameters is unsupported (SQL and Substrait) [datafusion]
LiaCastaneda (via GitHub) via github
-
[PR] feat: add an SDK-free Iceberg integration build gate [datafusion-ballista]
wirybeaver (via GitHub) via github
-
[PR] ci: separate docs build from site publishing [datafusion-comet]
dajiaohuang (via GitHub) via github
-
[I] Native Iceberg scan fails with ExpiredToken once REST-vended credentials expire [datafusion-comet]
laxmanmamididd (via GitHub) via github
-
[I] S3 credential providers are retained until JVM shutdown when a catalog re-vends credentials [datafusion-comet]
laxmanmamididd (via GitHub) via github
-
[I] No refreshing Iceberg credential provider on Spark 3.x builds [datafusion-comet]
laxmanmamididd (via GitHub) via github
-
[I] The documented IcebergRESTVendedS3Provider never refreshes against a REST catalog [datafusion-comet]
laxmanmamididd (via GitHub) via github
-
[PR] fix: keep the hash join build map reserved while the dynamic filter holds it [datafusion]
fwojciec (via GitHub) via github
-
[PR] fix(common): preserve min/max when merging all-null statistics [datafusion]
Subodh-17 (via GitHub) via github
-
[I] Native parse_url returns NULL for relative URLs (no scheme), Spark parses them [datafusion-comet]
valentinsoe (via GitHub) via github
-
[I] Support delegation of schema and table creation to remote catalogs and schemas [datafusion]
pepijnve (via GitHub) via github
-
[PR] feat(scheduler): rebuild and resume a query that loses DataFrame::cache() data [datafusion-ballista]
akshaychitneni (via GitHub) via github
-
Re: [PR] perf: Optimize string split functions and avoid intermediate heap allocations [datafusion-comet]
kazantsev-maksim (via GitHub) via github
-
[I] Audit license and copyright texts for all native dependencies bundled in libcomet [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] fix: size aggregate spill batches by bytes as well as rows [datafusion]
jayzhan211 (via GitHub) via github
-
[PR] fix: write sorted spill runs in byte-bounded batches and drop the halving re-spill [datafusion]
jayzhan211 (via GitHub) via github
-
[PR] ci: Label PRs from potentially automated accounts with AgentScan [datafusion]
2010YOUY01 (via GitHub) via github
-
[I] Fuzz failure [datafusion]
alamb (via GitHub) via github
-
Re: [PR] MsSql: Preserve ALTER ROLE ... WITH NAME = on display [datafusion-sqlparser-rs]
alamb (via GitHub) via github
-
Re: [PR] MySQL: Support compound time units in EXTRACT and INTERVAL [datafusion-sqlparser-rs]
alamb (via GitHub) via github
-
Re: [PR] Core: fix quoted literal display for delimiters after even backslash runs [datafusion-sqlparser-rs]
alamb (via GitHub) via github
-
Re: [PR] Generic, SQLite: parse WITH ... AS [NOT] MATERIALIZED [datafusion-sqlparser-rs]
alamb (via GitHub) via github
-
Re: [PR] Core: fix field access display for digit-prefixed identifiers [datafusion-sqlparser-rs]
alamb (via GitHub) via github
-
Re: [I] chore: Improve cast MapType to String [datafusion-comet]
Samearth17 (via GitHub) via github
-
Re: [I] Push Iceberg residual predicates on decimal columns into the native scan [datafusion-comet]
sam-1112 (via GitHub) via github
-
[PR] feat: unwrap support for `CAST(date_col AS TIMESTAMP) <op> timestamp_literal` [datafusion]
akoshchiy (via GitHub) via github
-
[PR] CI: Make the coverage check advisory [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
Re: [I] Extract a variable-length slot writer from TypedElements::write_elements_slow in columnar_to_row.rs [datafusion-comet]
himanchalkaushale (via GitHub) via github
-
Re: [I] `ORDER BY ... LIMIT` over an `OFFSET` subquery returns too few rows when the table is sorted and has several files [datafusion]
galaxytemple (via GitHub) via github
-
[PR] fix: reject floats nested in containers in approx_distinct [datafusion]
pujitha24 (via GitHub) via github
-
Re: [I] Bloom aggregate merge panics on batched states and ignores sliced offsets [datafusion-comet]
sunchao (via GitHub) via github
-
Re: [PR] fix: merge all Bloom filter states and respect sliced offsets [datafusion-comet]
sunchao (via GitHub) via github
-
Re: [I] [EPIC] Simplify memory-limited (spilling) execution [datafusion]
jayzhan211 (via GitHub) via github
-
Re: [PR] perf: specialize scattered Boolean shuffle gathers [datafusion-comet]
sunchao (via GitHub) via github
-
[PR] fix: include licenses for bundled lz4_flex and Zstandard [datafusion-comet]
manuzhang (via GitHub) via github
-
[I] Avoid dictionary promotion for Parquet plain fallback pages [datafusion]
Rich-T-kid (via GitHub) via github
-
Re: [PR] fix: retain only valid orderings after order-preserving repartition [datafusion]
jayzhan211 (via GitHub) via github
-
[PR] fix: reserve memory for the input buffered by window operators [datafusion]
jayzhan211 (via GitHub) via github
-
[I] `approx_distinct` rejects floats, but accepts lists of them [datafusion]
mkleen (via GitHub) via github
-
[PR] fix: bound spilled sort and aggregate runs by bytes, with one merge admission rule [datafusion]
jayzhan211 (via GitHub) via github
-
[PR] feat: physical optimizer rules declare whether they run before or after enforcement [datafusion]
jayzhan211 (via GitHub) via github
-
[PR] Avoid dictionary promotion for plain Parquet pages [datafusion]
Rich-T-kid (via GitHub) via github
-
Re: [PR] Parallel bounded RANGE-frame window functions without PARTITION BY (draft) [datafusion]
github-actions[bot] (via GitHub) via github
-
[I] [EPIC] Track arrow-java bugs and limitations that Comet works around [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] perf: avoid re-flattening join chains in EliminateCrossJoin [datafusion]
xudong963 (via GitHub) via github
-
[PR] Generic: Fix quotes when displaying SHOW ... ILIKE patterns [datafusion-sqlparser-rs]
slopgobblercobbler (via GitHub) via github
-
[PR] fix: plan a range RepartitionExec as a shuffle stage instead of dropping it [datafusion-ballista]
andygrove (via GitHub) via github
-
[PR] PostgreSQL, SQLite: Keep untyped string window frame offsets untyped [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
[PR] docs: add versioning policy for minor releases from release branches [datafusion-ballista]
andygrove (via GitHub) via github
-
[PR] fix(scheduler): restore the ExecutionPlan import in execution_graph tests [datafusion-ballista]
andygrove (via GitHub) via github
-
[PR] feat: ship an S3 credential provider that refreshes Iceberg REST-vended credentials [datafusion-comet]
laxmanmamididd (via GitHub) via github
-
[I] Comet Native Executors: run a small broadcast side once rather than in every task that reads it [datafusion-comet]
andygrove (via GitHub) via github
-
[I] Comet Native Executors: run LIMIT and top-K queries with a per-partition limit before the exchange [datafusion-comet]
andygrove (via GitHub) via github
-
[I] Comet Native Executors: support dynamic partition pruning [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] PostgreSQL: Escape quotes in COMMENT ON values [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
Re: [PR] fix(executor): cached session runtime ignores SET s3.* changes [datafusion-ballista]
goingforstudying-ctrl (via GitHub) via github
-
[PR] PostgreSQL: Parse a cast on a qualified wildcard [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
[I] Comet Native Executors: partition hash exchanges with Spark's Murmur3 hash [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] Snowflake: Fix CREATE DATABASE and COPY INTO consuming semicolon delimiter [datafusion-sqlparser-rs]
slopgobblercobbler (via GitHub) via github
-
Re: [I] IN evaluates later candidates over the whole batch, so an ANSI error can fire for a row that already matched [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] fix: prune statistics only through casts that keep order [datafusion]
jayzhan211 (via GitHub) via github
-
Re: [I] Decide how the Delta Lake contrib jar is built, versioned, and published in releases [datafusion-comet]
dwsmith1983 (via GitHub) via github
-
[PR] feat: let hash shuffles place rows by a client-computed partition id [datafusion-ballista]
andygrove (via GitHub) via github
-
[I] Parquet pruning drops rows for CAST(int AS BOOLEAN) and CAST(int AS BYTEA) predicates [datafusion]
jayzhan211 (via GitHub) via github
-
Re: [PR] perf: stop holding the fair pool lock across blocking memory calls [datafusion-comet]
dwsmith1983 (via GitHub) via github
-
[PR] build(deps): bump arrow from 59.3.0 to 60.1.0 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
Re: [PR] PoC: Explicit Invariant Regions in the Physical Optimizer [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat: support non-foldable sha2 natively [datafusion-comet]
sunchao (via GitHub) via github
-
[I] Chaos test harness can give two executors the same port [datafusion-ballista]
andygrove (via GitHub) via github
-
[PR] build(deps): bump arrow-array from 59.3.0 to 60.1.0 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
[PR] fix: split `BoundedWindowAggExec` output into `batch_size` batches [datafusion]
comphead (via GitHub) via github
-
Re: [PR] build(deps): bump tokio from 1.53.2 to 1.53.3 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
[PR] build(deps): bump arrow-select from 59.3.0 to 60.1.0 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
Re: [PR] docs: publish the newest release at user-guide/latest and main at user-guide/dev [datafusion-comet]
sunchao (via GitHub) via github
-
[PR] build(deps): bump tokio from 1.53.2 to 1.54.1 [datafusion-python]
dependabot[bot] (via GitHub) via github
-
Re: [I] Incorrect Parquet pruning for timestamp-to-time casts across midnight [datafusion]
jayzhan211 (via GitHub) via github
-
Re: [I] Parquet bloom filter pruning drops rows holding the other signed zero: `WHERE c = 0.0` misses `-0.0` rows (and vice versa) [datafusion]
akshat-lakhera (via GitHub) via github
-
Re: [PR] SQLite: Tokenize parameters the way SQLite does [datafusion-sqlparser-rs]
s5dsn-eqee (via GitHub) via github
-
[I] Comet Native Executors: pass scalar subquery results to the cluster without rewriting the plan [datafusion-comet]
andygrove (via GitHub) via github
-
[I] Comet Native Executors: report a query's metrics in the Spark UI [datafusion-comet]
andygrove (via GitHub) via github
-
[I] Comet Native Executors: range-partition sorts on float, nested and expression keys [datafusion-comet]
andygrove (via GitHub) via github
-
[I] Iceberg: re-plan views from their SQL so they read the latest table version [datafusion-ballista]
NoahKusaba (via GitHub) via github
-
[PR] fix: Fix flaky sort fuzzer test [datafusion]
2010YOUY01 (via GitHub) via github
-
Re: [PR] feat: account JVM UDF Arrow allocations in Spark task memory [datafusion-comet]
sunchao (via GitHub) via github
-
[I] Partitioned hash join keeps its hash maps allocated but unreserved after it finishes (dynamic filter pushdown) [datafusion]
jayzhan211 (via GitHub) via github
-
Re: [I] Plug into DataFusion Python natively through a custom FFI query planner [datafusion-ballista]
milenkovicm (via GitHub) via github
-
[I] GetStructField fails on a scalar struct beside a column [datafusion-comet]
grorge123 (via GitHub) via github
-
[PR] fix: return a scalar field from a scalar struct in GetStructField [datafusion-comet]
grorge123 (via GitHub) via github
-
Re: [PR] chore(deps): bump postgres-protocol from 0.6.10 to 0.6.12 [datafusion-sandbox]
dependabot[bot] (via GitHub) via github
-
Re: [PR] Derive total_byte_size for join statistics [datafusion]
github-actions[bot] (via GitHub) via github
-
[I] Nested try_add and try_multiply can return wrapped integers instead of NULL [datafusion-comet]
sunchao (via GitHub) via github
-
Re: [PR] fix(scheduler): keep AQE stage in the graph when a stage transition fails [datafusion-ballista]
andygrove (via GitHub) via github