danielcweeks commented on PR #11906: URL: https://github.com/apache/iceberg/pull/11906#issuecomment-2593735172
@ismailsimsek [my issue](https://github.com/apache/iceberg/pull/7914#issuecomment-2557715049) with this PR is the same as the previous pr. This isn't a scaleable solution. The file system approach was able to parallelize the work through directory traversal, but this does not. I think we need a way to break up the prefixes appropriately so that we can distribute the listing. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
