This is an automated email from the ASF dual-hosted git repository. lijibing pushed a change to branch high-priority-column in repository https://gitbox.apache.org/repos/asf/doris.git
discard c82acf03157 support window (#32094) omit 87494cbb462 Check column health value earlier, show job priority. (#32064) omit 5155651c79a Support show auto analyze pending jobs. (#31926) omit f5c037514b2 Support follower sync query columns to master. (#31859) omit efe9517d960 Support column level health value. (#31794) omit 624b27f8258 High priority queue and map. (#31509) omit ec3657244f0 Collect high priority columns. (#31235) add 1303c9b9b1a [feature](pipelineX) add mem control in local exchange sink (#31982) add 917e4259d99 [improvement](binlog)Support inverted index in CCR (#31743) add ad472eb4843 [test](fix) Fix one missing line of output in out file (#32036) add b7b38434413 [fix](compile) fix BE compile failure on Mac (#32044) add b14880664bc [fix](cloud) ignore set replica version in cloud mode (#32040) add afa783fe032 [chore](config) support select experimental session variable (#31837) add 01f23dd3997 [feature](Cloud) Support restore HDFS meta data in Meta Service && Add storage vault property (#31415) add 635463ab1f2 [test](cloud)add plugin for test run cloud mode cluster cases (#31960) add d4be56bb76f [Feature](TrinoConnector-Catalog) Be supports trino-connector catalog (#31879) add 9c579f30f18 [fix](pipelineX) _local_channel_dependency is null in non pipelineX (#32054) add 7edbffb7f1c [docs](docs) Update 2.1.0 release note (#32053) add a79e5208d70 [feature](docker)Doris On Docker All In One (#31735) add 3bb5f665b4d [Improve](InPredict) enhance in predict with array type (#31828) add 4a18b3bd368 [thirdparty](lib) Add Patch for base64 lib (#32059) add 023313d00b8 [fix](memory) Fix Allocator cancel pipelinex query #32048 add cd59192b07f [fix](hive) fix spelling mistakes for "separatorChar" #32061 add d68535fc70d [fix](case) fix export data consistency table key type (#32045) add 6817141d14f [Fix](Outfiel) fix be core when the open method of vfile_result_writer failed #32042 add f04e1a47175 [improvement](docker)Optimize Dockerfile content for FE and BE (#32027) add 3c600a056a3 [fix](docker)Fix the registration logic of Doris On Docker (#32026) add f8a9b025479 [fix](spill) fix storage engine type cast error (#32071) add 5d4a949840b [Improvement](executor)Routine load support workload group #31671 add b54143fdd7d [fix](merge-cloud) Fix s3 load replay after restart fe (#32073) add 34d49c147c9 [refactor](nereids) rename PlanNode.distributeExprLists to childrenDistributeExprLists #32069 add 5754b6757eb [doc](sql-dialect) update sql convertor tool to 1.0.1 (#32077) add b64a8a0652f [DOC](Variant) add bloom filter description and correct some benchmark results (#31998) add 15dfa831067 [fix](doc) fix wrong download link (#32082) add cf53b2ea22c [enhance](Cooldown) Skip cooldown if the tablet is dropped (#32079) add db2f2608a1d [pipelineX](scanner) Use the actual instances num when ignore data distribution (#32081) add 7f665f381ac [docs](docs) Update release note 2.0.6 and readme of Master branch (#32087) new a816e7c646c Collect high priority columns. (#31235) new 404d160e81e High priority queue and map. (#31509) new 9a3470cbb4d Support column level health value. (#31794) new 27f92e518c5 Support follower sync query columns to master. (#31859) new f21a600b7ee Support show auto analyze pending jobs. (#31926) new 8d62e3d55bb Check column health value earlier, show job priority. (#32064) new 5944b418dfa support window (#32094) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (c82acf03157) \ N -- N -- N refs/heads/high-priority-column (5944b418dfa) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 7 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: README.md | 9 +- be/src/common/config.cpp | 2 + be/src/common/config.h | 3 + be/src/http/action/download_binlog_action.cpp | 39 + be/src/olap/rowset/beta_rowset.cpp | 44 +- be/src/olap/snapshot_manager.cpp | 53 +- be/src/olap/tablet.cpp | 30 +- be/src/olap/tablet.h | 5 + be/src/olap/tablet_manager.cpp | 17 +- be/src/olap/task/engine_clone_task.cpp | 14 +- be/src/pipeline/pipeline_x/pipeline_x_task.cpp | 4 +- be/src/runtime/memory/thread_mem_tracker_mgr.cpp | 13 +- be/src/runtime/memory/thread_mem_tracker_mgr.h | 10 +- be/src/runtime/thread_context.cpp | 7 +- be/src/runtime/thread_context.h | 13 +- be/src/service/backend_service.cpp | 132 ++- be/src/util/jni-util.cpp | 1 + be/src/vec/common/allocator.cpp | 4 +- .../format/table/trino_connector_jni_reader.cpp | 133 +++ .../exec/format/table/trino_connector_jni_reader.h | 71 ++ be/src/vec/exec/jni_connector.cpp | 5 + be/src/vec/exec/scan/scanner_context.cpp | 3 +- be/src/vec/exec/scan/vfile_scanner.cpp | 7 + be/src/vec/exprs/vin_predicate.cpp | 5 +- ...on_struct_in.cpp => function_collection_in.cpp} | 8 +- ...nction_struct_in.h => function_collection_in.h} | 65 +- be/src/vec/functions/simple_function_factory.h | 4 +- be/src/vec/runtime/vdata_stream_recvr.cpp | 31 +- be/src/vec/runtime/vdata_stream_recvr.h | 6 +- be/src/vec/sink/writer/vfile_result_writer.cpp | 24 +- be/src/vec/sink/writer/vfile_result_writer.h | 2 +- be/src/vec/spill/spill_stream.cpp | 5 +- be/src/vec/spill/spill_stream.h | 11 +- be/src/vec/spill/spill_stream_manager.cpp | 46 +- be/src/vec/spill/spill_stream_manager.h | 43 +- be/src/vec/spill/spill_writer.cpp | 1 - be/src/vec/spill/spill_writer.h | 6 +- build.sh | 8 +- cloud/src/meta-service/keys.cpp | 11 + cloud/src/meta-service/keys.h | 6 + cloud/src/meta-service/meta_service_resource.cpp | 311 +++++-- cloud/src/recycler/recycler.cpp | 5 + cloud/test/meta_service_test.cpp | 162 +++- conf/be.conf | 2 +- docker/runtime/{be => all-in-one}/Dockerfile | 8 +- docker/runtime/all-in-one/resource/entry_point.sh | 248 ++++++ docker/runtime/be/Dockerfile | 7 +- docker/runtime/be/resource/entry_point.sh | 16 +- docker/runtime/be/resource/init_be.sh | 96 +-- docker/runtime/fe/Dockerfile | 11 +- .../hive/scripts/create_preinstalled_table.hql | 2 +- docs/en/docs/lakehouse/sql-dialect.md | 2 +- docs/en/docs/releasenotes/release-1.2.8.md | 47 ++ docs/en/docs/releasenotes/release-2.0.6.md | 59 ++ docs/en/docs/releasenotes/release-2.1.0.md | 159 ++++ .../sql-manual/sql-reference/Data-Types/VARIANT.md | 22 +- docs/images/2.1-Doris-TPC-DS-best-performance.png | Bin 0 -> 82015 bytes docs/images/2.1-comparied-to-Json-2.png | Bin 0 -> 149145 bytes docs/images/2.1-comparied-to-Json.png | Bin 0 -> 40676 bytes docs/images/2.1-doris-INSERT-INTO-SELECT.png | Bin 0 -> 29842 bytes docs/images/2.1-doris-TPC-DS.png | Bin 0 -> 18176 bytes docs/images/2.1-doris-arrow-flight-sql.png | Bin 0 -> 64781 bytes docs/images/2.1-doris-arrow-flight.png | Bin 0 -> 102524 bytes docs/images/2.1-doris-clickbench-tpch.png | Bin 0 -> 53975 bytes docs/images/2.1-doris-group-commit-2.png | Bin 0 -> 167142 bytes docs/images/2.1-doris-group-commit.png | Bin 0 -> 164155 bytes docs/images/2.1-doris-local-shuffle.png | Bin 0 -> 290278 bytes docs/images/2.1-doris-parallel-adaptive-scan.png | Bin 0 -> 72181 bytes docs/images/2.1-insert-into-table.png | Bin 0 -> 84689 bytes docs/sidebars.json | 3 + docs/zh-CN/docs/lakehouse/sql-dialect.md | 2 +- docs/zh-CN/docs/releasenotes/release-1.2.8.md | 48 ++ docs/zh-CN/docs/releasenotes/release-2.0.6.md | 54 ++ docs/zh-CN/docs/releasenotes/release-2.1.0.md | 892 +++++++++++++++++++++ .../sql-manual/sql-reference/Data-Types/VARIANT.md | 22 +- fe/be-java-extensions/pom.xml | 1 + fe/be-java-extensions/preload-extensions/pom.xml | 4 + .../trino-connector-scanner/pom.xml | 80 ++ .../doris/trinoconnector/TrinoConnectorCache.java | 268 +++++++ .../trinoconnector/TrinoConnectorColumnValue.java | 237 ++++++ .../trinoconnector/TrinoConnectorJniScanner.java | 373 +++++++++ .../trinoconnector/TrinoConnectorPluginLoader.java | 75 ++ .../trinoconnector/TrinoConnectorScannerUtils.java | 47 ++ .../TrinoTypeToHiveTypeTranslator.java | 115 +++ .../src/main/resources/package.xml | 39 + .../doris/analysis/AlterRoutineLoadStmt.java | 8 + .../doris/analysis/CreateRoutineLoadStmt.java | 14 + .../main/java/org/apache/doris/catalog/Env.java | 54 +- .../doris/cloud/load/CloudBrokerLoadJob.java | 9 + .../doris/datasource/hive/source/HiveScanNode.java | 6 +- .../constants/TrinoConnectorProperties.java | 22 - .../TrinoConnectorExternalCatalog.java | 36 +- .../TrinoConnectorExternalCatalogFactory.java | 1 - .../TrinoConnectorExternalDatabase.java | 1 - .../TrinoConnectorExternalTable.java | 1 - .../trinoconnector/TrinoConnectorPluginLoader.java | 81 ++ .../source/TrinoConnectorScanNode.java | 10 +- .../java/org/apache/doris/load/loadv2/LoadJob.java | 2 +- .../doris/load/routineload/KafkaTaskInfo.java | 27 + .../doris/load/routineload/RoutineLoadJob.java | 14 + .../glue/translator/PhysicalPlanTranslator.java | 24 +- .../nereids/trees/expressions/InPredicate.java | 12 + .../doris/nereids/util/TypeCoercionUtils.java | 10 +- .../java/org/apache/doris/planner/PlanNode.java | 14 +- .../apache/doris/planner/SingleNodePlanner.java | 4 + .../main/java/org/apache/doris/qe/VariableMgr.java | 26 +- .../resource/workloadgroup/WorkloadGroupMgr.java | 39 +- .../jdbc/test_mysql_jdbc_driver5_catalog.out | 1 + .../nereids_syntax_p0/inpredicate_with_list.out | 19 + .../data/query_p0/sql_functions/test_in_expr.out | 3 + regression-test/pipeline/p0/conf/fe.conf | 1 + .../plugins/cloud_abnormal_plugin.groovy | 371 +++++++++ .../plugins/cloud_cluster_op_plugin.groovy | 86 ++ .../plugins/cloud_compaction_plugin.groovy | 112 +++ .../plugins/cloud_recycler_plugin.groovy | 195 +++++ .../plugins/cloud_resource_plugin.groovy | 76 ++ .../plugins/cloud_smoke_plugin.groovy | 35 +- .../plugins/cloud_smooth_upgrade.groovy | 65 ++ .../plugins/cloud_stage_ram_plugin.groovy | 424 ++++++++++ .../suites/control_p0/set_replica_status.groovy | 3 + .../export_p0/test_export_data_consistency.groovy | 2 + .../load_p0/routine_load/test_routine_load.groovy | 8 +- .../nereids_syntax_p0/inpredicate_with_list.groovy | 60 ++ .../suites/nereids_syntax_p0/system_var.groovy | 5 + .../query_p0/sql_functions/test_in_expr.groovy | 5 +- .../version_p0/test_set_replica_version.groovy | 3 + .../workload_manager_p0/test_curd_wlg.groovy | 12 +- thirdparty/download-thirdparty.sh | 11 + thirdparty/patches/base64-0.5.2.patch | 57 ++ 129 files changed, 5805 insertions(+), 482 deletions(-) create mode 100644 be/src/vec/exec/format/table/trino_connector_jni_reader.cpp create mode 100644 be/src/vec/exec/format/table/trino_connector_jni_reader.h rename be/src/vec/functions/{function_struct_in.cpp => function_collection_in.cpp} (79%) rename be/src/vec/functions/{function_struct_in.h => function_collection_in.h} (75%) copy docker/runtime/{be => all-in-one}/Dockerfile (89%) create mode 100644 docker/runtime/all-in-one/resource/entry_point.sh create mode 100644 docs/en/docs/releasenotes/release-1.2.8.md create mode 100644 docs/en/docs/releasenotes/release-2.0.6.md create mode 100644 docs/en/docs/releasenotes/release-2.1.0.md create mode 100644 docs/images/2.1-Doris-TPC-DS-best-performance.png create mode 100644 docs/images/2.1-comparied-to-Json-2.png create mode 100644 docs/images/2.1-comparied-to-Json.png create mode 100644 docs/images/2.1-doris-INSERT-INTO-SELECT.png create mode 100644 docs/images/2.1-doris-TPC-DS.png create mode 100644 docs/images/2.1-doris-arrow-flight-sql.png create mode 100644 docs/images/2.1-doris-arrow-flight.png create mode 100644 docs/images/2.1-doris-clickbench-tpch.png create mode 100644 docs/images/2.1-doris-group-commit-2.png create mode 100644 docs/images/2.1-doris-group-commit.png create mode 100644 docs/images/2.1-doris-local-shuffle.png create mode 100644 docs/images/2.1-doris-parallel-adaptive-scan.png create mode 100644 docs/images/2.1-insert-into-table.png create mode 100644 docs/zh-CN/docs/releasenotes/release-1.2.8.md create mode 100644 docs/zh-CN/docs/releasenotes/release-2.0.6.md create mode 100644 docs/zh-CN/docs/releasenotes/release-2.1.0.md create mode 100644 fe/be-java-extensions/trino-connector-scanner/pom.xml create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorCache.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorColumnValue.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorJniScanner.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorPluginLoader.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoConnectorScannerUtils.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/java/org/apache/doris/trinoconnector/TrinoTypeToHiveTypeTranslator.java create mode 100644 fe/be-java-extensions/trino-connector-scanner/src/main/resources/package.xml create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/trinoconnector/TrinoConnectorPluginLoader.java create mode 100644 regression-test/data/nereids_syntax_p0/inpredicate_with_list.out create mode 100644 regression-test/plugins/cloud_abnormal_plugin.groovy create mode 100644 regression-test/plugins/cloud_cluster_op_plugin.groovy create mode 100644 regression-test/plugins/cloud_compaction_plugin.groovy create mode 100644 regression-test/plugins/cloud_recycler_plugin.groovy create mode 100644 regression-test/plugins/cloud_resource_plugin.groovy copy fe/fe-core/src/main/java/org/apache/doris/datasource/trinoconnector/TrinoConnectorExternalCatalogFactory.java => regression-test/plugins/cloud_smoke_plugin.groovy (53%) create mode 100644 regression-test/plugins/cloud_smooth_upgrade.groovy create mode 100644 regression-test/plugins/cloud_stage_ram_plugin.groovy create mode 100644 regression-test/suites/nereids_syntax_p0/inpredicate_with_list.groovy create mode 100644 thirdparty/patches/base64-0.5.2.patch --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org