rdblue commented on issue #16493: URL: https://github.com/apache/iceberg/issues/16493#issuecomment-4557915102
@nnguyen168, I don't understand your question. The method `filteredCompareToFileList` returns a `Dataset` that was provided by the caller after adding a filter to exclude recently modified files. Because this was provided by the caller, Iceberg is not using a credential to get the paths and it is not going to fail as described. The method `listedFileDS` uses either `FileSystemWalker.listDirRecursivelyWithFileIO` or `FileSystemWalker.listDirRecursivelyWithHadoop` to get a list of files in storage. This is what needs to be updated to avoid listing paths without `/`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
