gruuya opened a new issue, #840:
URL: https://github.com/apache/iceberg-rust/issues/840

   Currently when using the `TableProviderFactory` mechanism from DataFusion 
one needs to specify the full exact path to the metadata _file_ as the 
location, e.g. 
   ```sql
   create external table inventory 
   stored as iceberg 
   location 
's3://iceberg/public/inventory/metadata/00001-97ea515a-2d2f-465d-8c74-8daec5ab0023.metadata.json
   ```
   
   I think it would be nice if `IcebergTableProviderFactory` also supported 
being pointed to a metadata _directory_ as well
   ```sql
   create external table inventory 
   stored as iceberg 
   location 's3://iceberg/public/inventory/metadata
   ```
   
   This would then imply listing and parsing the **latest** metadata file in 
that directory (e.g. from `V` in filenames like 
`<V>-<random-uuid>.metadata.json` and maybe the legacy `v<V>.metadata.json`), 
as that is likely the overwhelming use case, and using that to build the table. 
That would improve the flexibility and ergonomics of the integration (e.g. by 
making quick prototyping much simpler). 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org

Reply via email to