danielcweeks commented on issue #11541: URL: https://github.com/apache/iceberg/issues/11541#issuecomment-2476866028
@amogh-jahagirdar I don't think #7914 is a good approach to addressing this as it's not scalable. This trades off distributed listing for single iteration. To support prefix listing, we need to break up the key space in a way that we can parallelize the work. I'll comment on the PR, there's a better approach that we're looking into. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org For additional commands, e-mail: issues-h...@iceberg.apache.org
