muddyfish commented on PR #10292: URL: https://github.com/apache/iceberg/pull/10292#issuecomment-2104754756
I did not try with HadoopFileIO or with Iceberg maintenance operations. According to this PR https://github.com/apache/iceberg/pull/7914, it doesn't seem that `delete_orphan_files` supports S3FileIO. If/when it does, it still might not work with S3 Express due to it requiring a `/` at the end of a ListObjects request, whereas S3 Standard does not. We could change `s3FileIO.listPrefix` to add the `/` if it's not already present, but that could potentially break usages where a list request is required without a trailing delimiter. (E.g when the list request is for a partial prefix) With regards to HadoopFileIO, does that refer to this? https://iceberg.apache.org/docs/1.5.0/aws/#hadoop-s3a-filesystem Is this still recommended for use? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
