ConeyLiu opened a new pull request, #8142:
URL: https://github.com/apache/iceberg/pull/8142
The `ExpressionUtil.selectsPartitions` is aimed to determine whether the
expression can be fully applied to the whole partitions. And it is not
necessary for an unpartitioned table. Especially for metadata tables which are
always unpartitioned. For example, we get unexpected warnings for the following
scan:
```
scala> spark.sql("select file_path, partition, record_count from
iceberg.db.table.files where partition.partition_time = 2023012410").show()
23/07/24 14:20:47 WARN SparkScanBuilder: Failed to check if
IsNotNull(partition.partition_time) can be pushed down: Cannot find field
'partition.partition_time' in struct: struct<>
23/07/24 14:20:47 WARN SparkScanBuilder: Failed to check if
EqualTo(partition.partition_time,2023012410) can be pushed down: Cannot find
field 'partition.partition_time' in struct: struct<>
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
