flyrain commented on issue #10089: URL: https://github.com/apache/iceberg/issues/10089#issuecomment-2040599592
That's right. In our case, the rest server cannot access all table files due to following reasons: 1. The rest catalog or any other catalog isn't allowed to access users' data due to the security policy, metadata access is fine. 2. Some Iceberg tables are in HDFS with kerberos, which makes them pretty hard to access from a centralized server. We still write metadata.json files, but they are located in a server-side storage instead of users' table storage. I understand this use case is a bit different from where the REST catalog was introduced, but I believe it is a valid use case, and we extend the scope of rest catalog a bit more to support it. cc @RussellSpitzer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
