Fokko opened a new pull request, #8611:
URL: https://github.com/apache/iceberg/pull/8611
As mentioned in the community sync, there is some odd behavior on the
null-count:
```sql
CREATE TABLE ...
TBLPROPERTIES (
"write.format.default"="orc"
)
SELECT named_struct('a', 1, 'b', 2) AS some_struct --
null_value_counts={1: 0, 2: 0, 3: 0}
UNION ALL SELECT named_struct('a', 1, 'b', null) AS some_struct --
null_value_counts={1: 0, 2: 0, 3: 0}
UNION ALL SELECT null AS some_struct -- null_value_counts={1: 1, 2: 0, 3: 0}
CREATE TABLE ...
TBLPROPERTIES (
"write.format.default"="parquet"
)
SELECT named_struct('a', 1, 'b', 2) AS some_struct --
null_value_counts={2: 0, 3: 0}
UNION ALL SELECT named_struct('a', 1, 'b', null) AS some_struct --
null_value_counts={2: 0, 3: 1}
UNION ALL SELECT null AS some_struct -- null_value_counts={2: 1, 3: 1}
```
The goal of this PR is to agree on how to count the nulls for nested objects.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@iceberg.apache.org
For additional commands, e-mail: issues-h...@iceberg.apache.org
