issues

[jira] [Updated] (SPARK-56473) Rename `create_spark_jira.py` to `create_jira_and_branch.py`

Tue, 14 Apr 2026 16:20:09 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56473) Rename `create_spark_jira.py` to `create_jira_and_branch.py`

Tue, 14 Apr 2026 16:19:07 GMT

2026/04/14 -- Dongjoon Hyun (Jira)

[jira] [Updated] (SPARK-56472) Fix MERGE schema evolution with WHEN MATCHED THEN DELETE

Tue, 14 Apr 2026 15:29:07 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56472) Fix MERGE schema evolution with WHEN MATCHED THEN DELETE

Tue, 14 Apr 2026 15:25:07 GMT

2026/04/14 -- Johan Lasperas (Jira)

[jira] [Created] (SPARK-56472) Fix MERGE schema evolution with WHEN MATCHED THEN DELETE

Tue, 14 Apr 2026 15:24:07 GMT

2026/04/14 -- Johan Lasperas (Jira)

[jira] [Updated] (SPARK-56468) Audit the udf grpc protocol for Spark 4.2

Tue, 14 Apr 2026 14:29:11 GMT

2026/04/14 -- Jira

[jira] [Updated] (SPARK-56468) Audit the udf grpc protocol for Spark 4.2

Tue, 14 Apr 2026 14:28:34 GMT

2026/04/14 -- Jira

[jira] [Updated] (SPARK-52818) Arrow UDF for aggregation

Tue, 14 Apr 2026 12:54:10 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Assigned] (SPARK-55979) Required input attributes are missing from PartialMerge / Final BaseAggregateExec.references

Tue, 14 Apr 2026 11:58:30 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Resolved] (SPARK-55979) Required input attributes are missing from PartialMerge / Final BaseAggregateExec.references

Tue, 14 Apr 2026 11:57:09 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Resolved] (SPARK-56449) Skip git preflight for simple questions in AGENTS.md

Tue, 14 Apr 2026 10:48:17 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Assigned] (SPARK-56449) Skip git preflight for simple questions in AGENTS.md

Tue, 14 Apr 2026 10:48:14 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Updated] (SPARK-56470) Support schema evolution in streaming write to DSv2 sink

Tue, 14 Apr 2026 10:05:04 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56471) Remove release-time binary deletion workaround and CI JAR/class checks

Tue, 14 Apr 2026 09:58:06 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56471) Remove release-time binary deletion workaround and CI JAR/class checks

Tue, 14 Apr 2026 09:54:08 GMT

2026/04/14 -- Kousuke Saruta (Jira)

[jira] [Created] (SPARK-56470) Support schema evolution in streaming write to DSv2 sink

Tue, 14 Apr 2026 09:50:10 GMT

2026/04/14 -- Johan Lasperas (Jira)

[jira] [Updated] (SPARK-56469) BufferedRowsReader lifecycle hardening

Tue, 14 Apr 2026 09:50:05 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56469) BufferedRowsReader lifecycle hardening

Tue, 14 Apr 2026 09:47:51 GMT

2026/04/14 -- Peter Toth (Jira)

[jira] [Commented] (SPARK-53842) Enable Filter Push-Down for Pandas UDFs with an Immutable Column Hint

Tue, 14 Apr 2026 09:34:04 GMT

2026/04/14 -- Julian Klein (Jira)

[jira] [Updated] (SPARK-56468) Audit the udf grpc protocol for Spark 4.2

Tue, 14 Apr 2026 08:57:37 GMT

2026/04/14 -- Haiyang Sun (Jira)

[jira] [Created] (SPARK-56468) audit the udf grpc protocol for Spark 4.2

Tue, 14 Apr 2026 08:55:12 GMT

2026/04/14 -- Haiyang Sun (Jira)

[jira] [Updated] (SPARK-56467) Route scalar subquery partition filters into DSv2 runtime filtering

Tue, 14 Apr 2026 08:43:38 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56467) Route scalar subquery partition filters into DSv2 runtime filtering

Tue, 14 Apr 2026 08:42:50 GMT

2026/04/14 -- Anton Lykov (Jira)

[jira] [Updated] (SPARK-56238) Spark app id of executor kubernetes pods differ from Spark driver

Tue, 14 Apr 2026 07:29:08 GMT

2026/04/14 -- Enrico Minack (Jira)

[jira] [Updated] (SPARK-56466) Make SparkSession.close() idempotent

Tue, 14 Apr 2026 05:55:11 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56466) Make SparkSession.close() idempotent

Tue, 14 Apr 2026 05:54:07 GMT

2026/04/14 -- Ruifeng Zheng (Jira)

[jira] [Updated] (SPARK-56254) Make spark.read.xml accept DataFrame input

Tue, 14 Apr 2026 04:14:06 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56465) k8s executor failed to start on java 25 due to kerberos gss init error

Tue, 14 Apr 2026 03:43:09 GMT

2026/04/14 -- songlinwu (Jira)

[jira] [Resolved] (SPARK-56415) Simplify create_spark_jira.py for LLM-driven JIRA ticket creation

Tue, 14 Apr 2026 03:23:35 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Updated] (SPARK-56464) Fix the metrics on state operator for "no trigger" progress

Tue, 14 Apr 2026 03:22:57 GMT

2026/04/14 -- ASF GitHub Bot (Jira)

[jira] [Assigned] (SPARK-56415) Simplify create_spark_jira.py for LLM-driven JIRA ticket creation

Tue, 14 Apr 2026 03:05:33 GMT

2026/04/14 -- Wenchen Fan (Jira)

[jira] [Created] (SPARK-56464) Fix the metrics on state operator for "no trigger" progress

Tue, 14 Apr 2026 02:30:42 GMT

2026/04/14 -- Jungtaek Lim (Jira)

[jira] [Commented] (SPARK-56464) Fix the metrics on state operator for "no trigger" progress

Tue, 14 Apr 2026 02:30:33 GMT

2026/04/14 -- Jungtaek Lim (Jira)

[jira] [Reopened] (SPARK-56357) Upgrade SBT to 1.12.8

Tue, 14 Apr 2026 00:35:11 GMT

2026/04/14 -- Hyukjin Kwon (Jira)

[jira] [Updated] (SPARK-56357) Upgrade SBT to 1.12.8

Tue, 14 Apr 2026 00:35:07 GMT

2026/04/14 -- Hyukjin Kwon (Jira)

[jira] [Resolved] (SPARK-56255) Make spark.read.csv accept DataFrame input

Mon, 13 Apr 2026 23:53:04 GMT

2026/04/13 -- Hyukjin Kwon (Jira)

[jira] [Updated] (SPARK-56463) Disallow unpickling UDT

Mon, 13 Apr 2026 23:37:13 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56463) Disallow unpickling UDT

Mon, 13 Apr 2026 23:35:07 GMT

2026/04/13 -- Tian Gao (Jira)

[jira] [Updated] (SPARK-56462) MERGE INTO schema evolution fails with UPDATE * / INSERT * when source has column names containing dots

Mon, 13 Apr 2026 22:55:07 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Resolved] (SPARK-56452) pip install fails for prerelease versions due to strict version regex in install.py

Mon, 13 Apr 2026 22:50:10 GMT

2026/04/13 -- Hyukjin Kwon (Jira)

[jira] [Assigned] (SPARK-56452) pip install fails for prerelease versions due to strict version regex in install.py

Mon, 13 Apr 2026 22:50:06 GMT

2026/04/13 -- Hyukjin Kwon (Jira)

[jira] [Updated] (SPARK-56462) MERGE INTO schema evolution fails with UPDATE * / INSERT * when source has column names containing dots

Mon, 13 Apr 2026 22:39:10 GMT

2026/04/13 -- Eric Yang (Jira)

[jira] [Created] (SPARK-56462) MERGE INTO schema evolution fails with UPDATE * / INSERT * when source has column names containing dots

Mon, 13 Apr 2026 22:37:44 GMT

2026/04/13 -- Eric Yang (Jira)

[jira] [Created] (SPARK-56461) Disable File Checksum for Checkpoint Format Version 1

Mon, 13 Apr 2026 21:19:06 GMT

2026/04/13 -- Zifei Feng (Jira)

[jira] [Updated] (SPARK-56159) Support Nano Second Timestamp Data Types

Mon, 13 Apr 2026 20:08:05 GMT

2026/04/13 -- Xiaoxuan Li (Jira)

[jira] [Assigned] (SPARK-56456) Improve errorContext asserts to produce better output

Mon, 13 Apr 2026 18:18:26 GMT

2026/04/13 -- Allison Wang (Jira)

[jira] [Resolved] (SPARK-56456) Improve errorContext asserts to produce better output

Mon, 13 Apr 2026 18:18:15 GMT

2026/04/13 -- Allison Wang (Jira)

[jira] [Updated] (SPARK-55444) Types Framework - Phase 3 - Storage Formats

Mon, 13 Apr 2026 17:37:24 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-34914) Local scheduler backend support update token

Mon, 13 Apr 2026 16:05:07 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Assigned] (SPARK-52709) Fix parsing of STRUCT<>

Mon, 13 Apr 2026 15:49:04 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Resolved] (SPARK-56457) Fix Avro V2 formatName to match V1 FileFormat.toString

Mon, 13 Apr 2026 15:23:10 GMT

2026/04/13 -- Dongjoon Hyun (Jira)

[jira] [Assigned] (SPARK-56457) Fix Avro V2 formatName to match V1 FileFormat.toString

Mon, 13 Apr 2026 15:23:10 GMT

2026/04/13 -- Dongjoon Hyun (Jira)

[jira] [Resolved] (SPARK-56444) BatchScanExec equals/hashCode contract violations

Mon, 13 Apr 2026 15:05:20 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Assigned] (SPARK-56444) BatchScanExec equals/hashCode contract violations

Mon, 13 Apr 2026 15:05:07 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Created] (SPARK-56460) define configs in text files

Mon, 13 Apr 2026 14:42:45 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Updated] (SPARK-56459) Fix MatchError in FileDataSourceV2.attachFilePath for fatal errors

Mon, 13 Apr 2026 12:44:31 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56459) Fix MatchError in FileDataSourceV2.attachFilePath for fatal errors

Mon, 13 Apr 2026 12:44:31 GMT

2026/04/13 -- Kent Yao (Jira)

[jira] [Created] (SPARK-56458) SupportsPushDownV2Filters.pushPredicates should return non empty result; otherwise, the runtime bloom filter will not be applied.

Mon, 13 Apr 2026 08:39:18 GMT

2026/04/13 -- zhoubin (Jira)

[jira] [Updated] (SPARK-56337) Propagate analyzed sizeInBytes to V2 FileScan estimates

Mon, 13 Apr 2026 07:18:12 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56371) Support _metadata.row_index generated metadata column for V2 Parquet streaming and batch reads

Mon, 13 Apr 2026 07:13:18 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56335) Implement SupportsMetadataColumns in FileTable

Mon, 13 Apr 2026 07:12:58 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56457) Fix Avro V2 formatName to match V1 FileFormat.toString

Mon, 13 Apr 2026 06:40:11 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Commented] (SPARK-55879) Add copy SQL to clipboard button on SQL tab

Mon, 13 Apr 2026 04:08:10 GMT

2026/04/13 -- Shekhar Prasad Rajak (Jira)

[jira] [Created] (SPARK-56457) Fix Avro V2 formatName to match V1 FileFormat.toString

Mon, 13 Apr 2026 03:50:07 GMT

2026/04/13 -- Yang Jie (Jira)

[jira] [Updated] (SPARK-56456) Improve errorContext asserts to produce better output

Mon, 13 Apr 2026 03:38:07 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56424) Benchmark SQL_SCALAR_PANDAS_UDF

Mon, 13 Apr 2026 03:10:07 GMT

2026/04/13 -- ASF GitHub Bot (Jira)

[jira] [Resolved] (SPARK-56383) Tests for extracting PartitionPredicate from mixed data and partition filters

Mon, 13 Apr 2026 03:05:15 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Assigned] (SPARK-56383) Tests for extracting PartitionPredicate from mixed data and partition filters

Mon, 13 Apr 2026 03:05:11 GMT

2026/04/13 -- Wenchen Fan (Jira)

[jira] [Created] (SPARK-56456) Improve errorContext asserts to produce better output

Mon, 13 Apr 2026 00:18:08 GMT

2026/04/13 -- Serge Rielau (Jira)

[jira] [Updated] (SPARK-55787) Add built-in function to detect all-null structs

Sun, 12 Apr 2026 20:20:05 GMT

2026/04/12 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56455) Add test coverage for maxBroadcastTableSize config enforcement

Sun, 12 Apr 2026 19:40:07 GMT

2026/04/12 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56455) Add test coverage for maxBroadcastTableSize config enforcement

Sun, 12 Apr 2026 19:32:15 GMT

2026/04/12 -- Pratham Manja (Jira)

[jira] [Resolved] (SPARK-56453) Open Add ResolveEventTimeWatermark to HiveSessionStateBuilder

Sun, 12 Apr 2026 18:48:09 GMT

2026/04/12 -- Anish Shrigondekar (Jira)

[jira] [Assigned] (SPARK-56453) Open Add ResolveEventTimeWatermark to HiveSessionStateBuilder

Sun, 12 Apr 2026 18:48:09 GMT

2026/04/12 -- Anish Shrigondekar (Jira)

[jira] [Updated] (SPARK-56453) Open Add ResolveEventTimeWatermark to HiveSessionStateBuilder

Sun, 12 Apr 2026 18:47:43 GMT

2026/04/12 -- ASF GitHub Bot (Jira)

[jira] [Assigned] (SPARK-56411) Register Decimal in KryoSerializer.loadableSparkClasses

Sun, 12 Apr 2026 16:37:59 GMT

2026/04/12 -- Yang Jie (Jira)

[jira] [Resolved] (SPARK-56411) Register Decimal in KryoSerializer.loadableSparkClasses

Sun, 12 Apr 2026 16:37:54 GMT

2026/04/12 -- Yang Jie (Jira)

[jira] [Resolved] (SPARK-56431) CSE in FilterExec must preserve null guards on notNull cols

Sun, 12 Apr 2026 13:50:06 GMT

2026/04/12 -- Yang Jie (Jira)

[jira] [Assigned] (SPARK-56431) CSE in FilterExec must preserve null guards on notNull cols

Sun, 12 Apr 2026 13:50:05 GMT

2026/04/12 -- Yang Jie (Jira)

[jira] [Commented] (SPARK-55951) The schema of ChangeLog must contain _change_type/_commit_version/_commit_timestamp

Sun, 12 Apr 2026 12:20:13 GMT

2026/04/12 -- Shekhar Prasad Rajak (Jira)

[jira] [Updated] (SPARK-782) Multiple versions of ASM being put on classpath

Sun, 12 Apr 2026 07:03:13 GMT

2026/04/12 -- ASF GitHub Bot (Jira)

[jira] [Updated] (SPARK-56454) Add missing documentation for Supported SRIDs in geospatial types

Sun, 12 Apr 2026 05:15:44 GMT

2026/04/12 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56454) Add missing documentation for Supported SRIDs in geospatial types

Sun, 12 Apr 2026 05:08:18 GMT

2026/04/12 -- Pratham Manja (Jira)

[jira] [Created] (SPARK-56453) Open Add ResolveEventTimeWatermark to HiveSessionStateBuilder

Sat, 11 Apr 2026 22:20:12 GMT

2026/04/11 -- Eric Marnadi (Jira)

[jira] [Updated] (SPARK-49386) Add memory based thresholds for shuffle spill

Sat, 11 Apr 2026 17:23:11 GMT

2026/04/11 -- ASF GitHub Bot (Jira)

[jira] [Created] (SPARK-56452) pip install fails for prerelease versions due to strict version regex in install.py

Sat, 11 Apr 2026 12:50:17 GMT

2026/04/11 -- Kiyeon Jeon (Jira)

[jira] [Updated] (SPARK-56452) pip install fails for prerelease versions due to strict version regex in install.py

Sat, 11 Apr 2026 12:37:28 GMT

2026/04/11 -- ASF GitHub Bot (Jira)

[jira] [Assigned] (SPARK-56441) Upgrade `lz4-java` to 1.11.0

Sat, 11 Apr 2026 11:17:57 GMT

2026/04/11 -- Cheng Pan (Jira)

[jira] [Resolved] (SPARK-56441) Upgrade `lz4-java` to 1.11.0

Sat, 11 Apr 2026 10:38:17 GMT

2026/04/11 -- Cheng Pan (Jira)

[jira] [Assigned] (SPARK-56439) Upgrade joda-time to 2.14.1

Sat, 11 Apr 2026 10:38:14 GMT

2026/04/11 -- Cheng Pan (Jira)

[jira] [Resolved] (SPARK-56439) Upgrade joda-time to 2.14.1

Sat, 11 Apr 2026 10:38:07 GMT

2026/04/11 -- Cheng Pan (Jira)

[jira] [Commented] (SPARK-52669) PySpark run with python directly could not find correct python exec

Sat, 11 Apr 2026 08:18:16 GMT

2026/04/11 -- gongwendong (Jira)

[jira] [Updated] (SPARK-52669) PySpark run with python directly could not find correct python exec

Sat, 11 Apr 2026 08:17:47 GMT

2026/04/11 -- gongwendong (Jira)

[jira] [Updated] (SPARK-52669) PySpark run with python directly could not find correct python exec

Sat, 11 Apr 2026 08:17:34 GMT

2026/04/11 -- gongwendong (Jira)

[jira] [Commented] (SPARK-56354) Lazy-load vis-timeline resources only on pages that use timeline views

Sat, 11 Apr 2026 07:00:21 GMT

2026/04/11 -- Shekhar Prasad Rajak (Jira)

[jira] [Commented] (SPARK-34664) Provide silhouette score for each sample when using ClusteringEvaluator

Sat, 11 Apr 2026 06:32:43 GMT

2026/04/11 -- Jira

[jira] [Commented] (SPARK-30046) linalg parity between scala and py sides

Sat, 11 Apr 2026 06:28:08 GMT

2026/04/11 -- Jira

[jira] [Resolved] (SPARK-56354) Lazy-load vis-timeline resources only on pages that use timeline views

Sat, 11 Apr 2026 06:23:08 GMT

2026/04/11 -- Kousuke Saruta (Jira)

[jira] [Commented] (SPARK-56354) Lazy-load vis-timeline resources only on pages that use timeline views

Sat, 11 Apr 2026 06:22:59 GMT

2026/04/11 -- Kousuke Saruta (Jira)

[jira] [Resolved] (SPARK-56437) Upgrade Jetty to 12.1.8

Sat, 11 Apr 2026 05:03:47 GMT

2026/04/11 -- Dongjoon Hyun (Jira)