szehon-ho commented on issue #7431: URL: https://github.com/apache/iceberg/issues/7431#issuecomment-1545209242
I think the COW join stages does not have the detail you have of MOR stages, if you can send the detail of those stages, that'll be nice. But I'm thinknig one hypothesis I'll check tomorrow with @RussellSpitzer and @aokolnychyi , is perhaps there is skew in both COW and MOR. But in COW we skew only in the first join when calculating the file set, and its smaller as we select much less data in this calculation. The second join benefits from knowing the exact file set, so only read what is necessary. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
