This is an automated email from the ASF dual-hosted git repository.
huajianlan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 7d83f416a1a [fix](cloud)Fix `create dynamic table` race with `insert
overwrite` (#59489)
add bf2e1c2dda9 [opt](distribution) support bucket shuffle for set
operation (#59006)
No new revisions were added by this update.
Summary of changes:
be/src/pipeline/exec/set_probe_sink_operator.h | 7 +-
be/src/pipeline/exec/set_sink_operator.h | 7 +-
be/src/pipeline/pipeline_fragment_context.cpp | 2 +
.../glue/translator/PhysicalPlanTranslator.java | 10 +-
.../glue/translator/RuntimeFilterTranslator.java | 2 +-
.../apache/doris/nereids/pattern/PlanPatterns.java | 70 +++++++++-
.../properties/ChildOutputPropertyDeriver.java | 52 +++++++
.../properties/ChildrenPropertiesRegulator.java | 91 ++++++++++--
.../nereids/properties/RequestPropertyDeriver.java | 5 +-
.../trees/plans/algebra/{Sink.java => Except.java} | 6 +-
.../plans/algebra/{Sink.java => Intersect.java} | 6 +-
.../doris/nereids/trees/plans/algebra/Join.java | 11 --
.../plans/algebra/{Sink.java => ShuffleType.java} | 12 +-
.../worker/LoadBalanceScanWorkerSelector.java | 4 +-
.../worker/job/UnassignedJobBuilder.java | 2 +-
.../job/UnassignedScanBucketOlapTableJob.java | 43 ++++--
.../nereids/trees/plans/logical/LogicalExcept.java | 3 +-
.../trees/plans/logical/LogicalIntersect.java | 3 +-
.../trees/plans/physical/AbstractPhysicalJoin.java | 3 +-
.../trees/plans/physical/PhysicalExcept.java | 3 +-
.../trees/plans/physical/PhysicalIntersect.java | 3 +-
.../trees/plans/physical/PhysicalSetOperation.java | 30 ++++
.../trees/plans/physical/PhysicalUnion.java | 11 ++
.../org/apache/doris/nereids/util/JoinUtils.java | 3 +-
.../org/apache/doris/planner/DistributionMode.java | 57 ++++++++
.../org/apache/doris/planner/HashJoinNode.java | 34 -----
.../org/apache/doris/planner/PlanFragment.java | 17 ++-
.../org/apache/doris/planner/SetOperationNode.java | 14 ++
.../apache/doris/nereids/DistributeHintTest.java | 2 +-
.../infer_set_operator_distinct.out | 154 ++++++++++-----------
.../bucket_shuffle_set_operation.out | 119 ++++++++++++++++
.../runtime_filter/test_pushdown_setop.out | 32 ++---
.../suites/empty_relation/eliminate_empty.groovy | 4 +
.../infer_set_operator_distinct.groovy | 3 +
.../suites/query_p0/runtimefilterV2/rfv2.groovy | 3 +
.../bucket_shuffle_set_operation.groovy | 130 +++++++++++++++++
36 files changed, 758 insertions(+), 200 deletions(-)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/algebra/{Sink.java
=> Except.java} (93%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/algebra/{Sink.java
=> Intersect.java} (92%)
copy
fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/algebra/{Sink.java
=> ShuffleType.java} (86%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/planner/DistributionMode.java
create mode 100644
regression-test/data/query_p0/set_operations/bucket_shuffle_set_operation.out
create mode 100644
regression-test/suites/query_p0/set_operations/bucket_shuffle_set_operation.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
