This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 16e0898dfa8 [refactor](cloud) Add versioned read checking (#54278)
add 33f96c49dd4 [enhance](multi-catalog) Runtime Filter Partition Pruning
for Data Lake Tables (#53399)
No new revisions were added by this update.
Summary of changes:
be/src/vec/exec/scan/file_scanner.cpp | 85 +++++--
be/src/vec/exec/scan/file_scanner.h | 5 +-
.../create_preinstalled_scripts/iceberg/run18.sql | 250 +++++++++++++++++++++
.../create_preinstalled_scripts/paimon/run06.sql | 231 +++++++++++++++++++
.../apache/doris/datasource/hudi/HudiUtils.java | 13 ++
.../doris/datasource/hudi/source/HudiScanNode.java | 19 +-
.../doris/datasource/hudi/source/HudiSplit.java | 2 +
.../doris/datasource/iceberg/IcebergUtils.java | 84 +++++++
.../datasource/iceberg/source/IcebergScanNode.java | 46 +++-
.../datasource/iceberg/source/IcebergSplit.java | 2 +
.../apache/doris/datasource/paimon/PaimonUtil.java | 86 +++++++
.../datasource/paimon/source/PaimonScanNode.java | 45 +++-
.../datasource/paimon/source/PaimonSplit.java | 10 +
gensrc/thrift/PlanNodes.thrift | 4 +-
...st_iceberg_runtime_filter_partition_pruning.out | Bin 0 -> 3589 bytes
...est_paimon_runtime_filter_partition_pruning.out | Bin 0 -> 3329 bytes
.../test_hudi_runtime_filter_partition_pruning.out | Bin 0 -> 2077 bytes
...iceberg_runtime_filter_partition_pruning.groovy | 242 ++++++++++++++++++++
..._paimon_runtime_filter_partition_pruning.groovy | 242 ++++++++++++++++++++
...st_hudi_runtime_filter_partition_pruning.groovy | 198 ++++++++++++++++
20 files changed, 1522 insertions(+), 42 deletions(-)
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run18.sql
create mode 100644
docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/paimon/run06.sql
create mode 100644
regression-test/data/external_table_p0/iceberg/test_iceberg_runtime_filter_partition_pruning.out
create mode 100644
regression-test/data/external_table_p0/paimon/test_paimon_runtime_filter_partition_pruning.out
create mode 100644
regression-test/data/external_table_p2/hudi/test_hudi_runtime_filter_partition_pruning.out
create mode 100644
regression-test/suites/external_table_p0/iceberg/test_iceberg_runtime_filter_partition_pruning.groovy
create mode 100644
regression-test/suites/external_table_p0/paimon/test_paimon_runtime_filter_partition_pruning.groovy
create mode 100644
regression-test/suites/external_table_p2/hudi/test_hudi_runtime_filter_partition_pruning.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
