yukkit commented on issue #586:
URL: https://github.com/apache/iceberg-rust/issues/586#issuecomment-2322940734
Here are a few questions that need clarification:
1. Is there a need to support specifying a version? @matthewmturner
2. Where should the parameters for object storage, such as `access-key-id`
and `secret-access-key` for S3, be obtained from? @liurenjie1024
- `StaticTable` relies on `FileIO`.
- For those using DataFusion, they can pre-construct an `AmazonS3
ObjectStore` and register it in `RuntimeEnv`. In the implementation of
`TableProviderFactory`, the `ObjectStore` can be obtained from the location of
the external table via the provided `Session`. However, `FileIO` cannot use
`ObjectStore`.
**Proposed Solution**
**For the first question:**
1. By default, use the latest version.
2. [Optional] Support specifying a version, for example: `CREATE EXTERNAL
TABLE my_table STORED AS ICEBERGTABLE LOCATION '/path/to/table' OPTIONS
('version' '1');`
**For the second question:**
1. Specify the relevant parameters in the `OPTIONS` block of the DDL
statement.
2. Refactor `FileIO` so that it also can rely on `ObjectStore` as its
storage backend.
3. Register the FileIO used to read the location via a global variable.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
