Fokko commented on issue #8598: URL: https://github.com/apache/iceberg/issues/8598#issuecomment-1727460176
Since we get the metrics from het Parquet/ORC footers, I wanted to check how the different formats behave. And it looks like this isn't consistent between ORC and Parquet (top one is ORC with exactly the same data):  ORC seems to be closer to what I would expect: ```sql CREATE TABLE s.l1 SELECT array(1,2,3) AS some_list -- Expect: {1: 0, 2: 0}, got {1: 0} UNION ALL SELECT array(1,null,3) AS some_list -- Expect: {1: 0, 2: 1}, got {1: 0} UNION ALL SELECT null AS some_list -- Expect: {1: 1, 2: 0}, got {1: 1} ``` So it seems that Parquet and ORC have discrepancies between them. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
