emecii opened a new pull request, #1716:
URL: https://github.com/apache/datafusion-python/pull/1716
# Which issue does this PR close?
Closes #970.
# Rationale for this change
`CREATE EXTERNAL TABLE ... OPTIONS ('aws.…' ...)` fails because `aws` is not
a
SQL configuration namespace. The Python API already supports this workflow by
configuring an `AmazonS3` object and registering it on the `SessionContext`,
but
the object-store guide only showed `register_parquet`.
# What changes are included in this PR?
- Make the existing S3 example self-contained by adding its imports and
`SessionContext` construction.
- Document the supported S3-plus-SQL-DDL path after the object store is
registered.
- State that S3 credentials belong on `AmazonS3`, rather than in SQL
`OPTIONS`.
# Are there any user-facing changes?
Yes. The user guide now explains how to use an already registered S3 object
store with `CREATE EXTERNAL TABLE`.
Validation: checked the documentation diff, parsed all eight Python snippets
in
the page with `ast.parse`, and verified the SQL DDL reaches the configured S3
object store with the published DataFusion wheel. The example is deliberately
documented as requiring valid S3 credentials.
I understand and reviewed this AI-assisted documentation change end-to-end.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]