Re: [I] Support full table scanning of partitioned table is prohibited [iceberg]

2025-03-11 Thread via GitHub
RussellSpitzer commented on issue #12474: URL: https://github.com/apache/iceberg/issues/12474#issuecomment-279346 This probably couldn't be done at the table format level since engines are the ones that decide what files they need to plan a query. This means you could do this but it wou

Re: [I] Support full table scanning of partitioned table is prohibited [iceberg]

2025-03-10 Thread via GitHub
ebyhr commented on issue #12474: URL: https://github.com/apache/iceberg/issues/12474#issuecomment-2712627254 Trino already supports `iceberg.query-partition-filter-required` config property and `query_partition_filter_required` session property. -- This is an automated message from the A

Re: [I] Support full table scanning of partitioned table is prohibited [iceberg]

2025-03-10 Thread via GitHub
melin commented on issue #12474: URL: https://github.com/apache/iceberg/issues/12474#issuecomment-2712196359 spark extensions: https://github.com/apache/kyuubi/blob/master/extensions/spark/kyuubi-extension-spark-3-5/src/main/scala/org/apache/kyuubi/sql/watchdog/MaxScanStrategy.scala -- Th

[I] Support full table scanning of partitioned table is prohibited [iceberg]

2025-03-06 Thread via GitHub
melin opened a new issue, #12474: URL: https://github.com/apache/iceberg/issues/12474 ### Feature Request / Improvement Many cloud customers expect spark sql to disable full table scanning by default, prompting users to add partition conditions. If forget to bring the table partiti