[
https://issues.apache.org/jira/browse/SPARK-56174?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated SPARK-56174:
-----------------------------------
Labels: pull-request-available (was: )
> Complete V2 file write path for DataFrame API (ErrorIfExists/Ignore,
> partitioned writes)
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-56174
> URL: https://issues.apache.org/jira/browse/SPARK-56174
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Affects Versions: 4.2.0
> Reporter: Yang Jie
> Priority: Major
> Labels: pull-request-available
>
> Complete `SaveMode` coverage for V2 file write.
> # `DataFrameWriter`: route `ErrorIfExists` and `Ignore` modes to V2 path
> with path existence check matching V1 semantics.
> # `ResolveSQLOnFile`: V2 resolution for `FileDataSourceV2` providers,
> enabling `INSERT INTO parquet.\`path\`` syntax.
> # `FileDataSourceV2.getTable`: use `collect` to handle transforms properly.
> # `FileTable`: `userSpecifiedPartitioning` plumbing so DataFrame API
> `partitionBy` columns reach `FileWrite.partitionSchema` for V2 partitioned
> writes.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
