singhpk234 commented on issue #18240: URL: https://github.com/apache/iceberg/issues/18240#issuecomment-6136664854
> but only where this is feasible, meaning all keys except for data file keys (since it's too expensive to re-encrypt the big parquet files) But manifests can be large too if a PB size table if thats the reason on just stopping at metadata layer, please ref this paper [When Metadata is BigData](https://www.vldb.org/pvldb/vol14/p3083-edara.pdf) ? do we want to then give it an option to till what layer of metadata we wanna re-wrap ? i guess then the next question would come up as how do we define the level of metadata ? depth ... -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
