This is an automated email from the ASF dual-hosted git repository. w41ter pushed a change to branch auto-pick-43012-branch-3.0 in repository https://gitbox.apache.org/repos/asf/doris.git
omit 3f95b250d2e [fix](editlog) add column rename binlog during the replay (#43012) add 0d991758467 branch-3.0: [fix](build index)Fix build index failed on renamed column (#43044) add 68f8369ee49 [cloud](storage vault) Rewrite vaults regression test and fix two error (#42411) (#43207) add 7368eb1045f [fix](block-reader) Make rowsets union iterating work (#40877) (#43178) add e98d08c3599 [fix](delete) Fix potential delete job stuck util timeout if exception happend in FE DeleteJob execution (#41672) (#43208) add 132d88543f7 [fix](conn-pool) Avoid some invalid connections returned to pool (#41597) (#43206) add 9096671b827 [enhancement](rowset-meta) Remove rowset meta from olap meta directly… (#43184) add e9290340c89 [fix](export) remove export task executor in TransientTaskExecutor and fix concurrency issue (#42880)(#43051)(#43109)(#43250) (#43305) add 1497fee065d [fix](regression) test_primary_key_partial_update fail due to the U.S. change from DST to standard time (#43288) (#43299) add bd327c4c4a7 branch-3.0: [chore](restore) Save restore stmt to the resp if RestoreSnapshot failed (#42956) add fdaf6d8ce82 [fix](auth)fix show load priv bug (#41723) (#42107) add fde6c1f693e [refactor](hudi, iceberg) optimize some code #42636 (#43304) add 4be107a3a74 [Fix](PaimonCatalog) fix the problem that paimon catalog can not access to OSS-HDFS #42585 (#43309) add 1d0ff953561 [bugfix](hive)fix after insert overwrite hive table, data error #43049 (#43311) add e6ded6d7034 [fix](external) Fix case-insensitive table name mapping retrieval rules #38227 (#43312) add 92e01a5bedf [improvement](jdbc catalog) Disallow non-constant type conversion pushdown and implicit conversion pushdown #42102 (#43313) add b2b7670a1ed [fix](jdbc catalog) Optimize JDBC Connection Closing to Ensure ProperResource Release #43059 (#43314) add 587219747c8 [fix](test) fix clickhouse jdbc catalog func push down case #43196 (#43315) add 7ade9d71f83 [fix](hive)fix hive catalog miss partition that have special characters. #42906 (#43318) add 1e93d711d63 [fix](auditlog) add missing audit log fields and duplicate audit log error #42262 (#43303) add 3ecd65100e3 branch-3.0: [feature](binlog) Allow BarrierLog to wrap another binlog (#43026) add a3566c3fc5d [enhancement](jni)append exception check for jni code. #42507 (#43316) add fbc9a907547 [fix](test) fix some unstable external p0 test cases #42685 (#43317) add 5b44e2840ff [fix] (build index) fix build index coredump (#43246) (#43298) add 2e3ad171ead branch-3.0: [fix](persist) Fix the generated dropping tmp partition sql (#43124) add 1cc16bffe37 [improvement](external)add some improvements for external scan #38946 (#43310) add e49d73614fb [improve](backup) Reduce backup/restore job log size by compress (#42954) add 1bd5567a4e4 [fix](editlog) add column rename binlog during the replay (#43012) This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3f95b250d2e) \ N -- N -- N refs/heads/auto-pick-43012-branch-3.0 (1bd5567a4e4) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. No new revisions were added by this update. Summary of changes: be/src/olap/cold_data_compaction.cpp | 3 +- be/src/olap/compaction.cpp | 4 +- be/src/olap/merger.cpp | 27 +- be/src/olap/rowset/beta_rowset_reader.cpp | 6 + be/src/olap/rowset/rowset.h | 8 +- be/src/olap/rowset/rowset_reader_context.h | 3 + be/src/olap/schema_change.cpp | 2 +- be/src/olap/tablet.cpp | 21 +- be/src/olap/tablet.h | 2 +- be/src/olap/tablet_meta.cpp | 1 + be/src/olap/tablet_reader.cpp | 1 + be/src/olap/tablet_reader.h | 2 + be/src/olap/tablet_schema.cpp | 10 +- be/src/olap/task/index_builder.cpp | 14 +- be/src/util/jni-util.cpp | 19 +- be/src/util/jni-util.h | 26 +- be/src/util/jvm_metrics.cpp | 487 +++++++++++------- be/src/util/jvm_metrics.h | 6 +- .../aggregate_function_java_udaf.h | 1 + be/src/vec/exec/jni_connector.cpp | 5 +- be/src/vec/exec/vjdbc_connector.cpp | 40 +- .../exprs/table_function/udf_table_function.cpp | 34 +- be/src/vec/functions/function_java_udf.cpp | 3 - be/src/vec/olap/block_reader.cpp | 43 +- be/src/vec/olap/block_reader.h | 3 +- be/src/vec/olap/vcollect_iterator.cpp | 1 + be/test/olap/rowid_conversion_test.cpp | 7 +- cloud/src/meta-service/meta_service_resource.cpp | 2 + .../clickhouse/init/03-create-table.sql | 2 +- .../docker-compose/mysql/init/03-create-table.sql | 7 + .../docker-compose/mysql/init/04-insert.sql | 2 + .../org/apache/doris/jdbc/BaseJdbcExecutor.java | 14 +- .../org/apache/doris/paimon/PaimonJniScanner.java | 2 +- .../main/java/org/apache/doris/common/Config.java | 17 + .../apache/doris/alter/SchemaChangeHandler.java | 3 + .../apache/doris/analysis/BuildIndexClause.java | 2 +- .../apache/doris/analysis/CreateIndexClause.java | 2 +- .../org/apache/doris/analysis/CreateTableStmt.java | 3 +- .../java/org/apache/doris/analysis/ExportStmt.java | 2 +- .../java/org/apache/doris/analysis/IndexDef.java | 5 + .../java/org/apache/doris/backup/AbstractJob.java | 27 +- .../java/org/apache/doris/backup/BackupJob.java | 32 +- .../java/org/apache/doris/backup/RestoreJob.java | 34 +- .../java/org/apache/doris/catalog/Database.java | 2 +- .../main/java/org/apache/doris/catalog/Env.java | 8 - .../main/java/org/apache/doris/catalog/Index.java | 20 +- .../org/apache/doris/catalog/InternalSchema.java | 17 + .../doris/catalog/MaterializedIndexMeta.java | 7 + .../org/apache/doris/catalog/StorageVault.java | 2 +- .../doris/cloud/catalog/CloudTabletRebalancer.java | 18 +- .../org/apache/doris/common/util/LocationPath.java | 16 +- .../apache/doris/common/util/ProfileManager.java | 11 +- .../org/apache/doris/datasource/CatalogMgr.java | 11 +- .../apache/doris/datasource/ExternalDatabase.java | 37 +- .../apache/doris/datasource/ExternalScanNode.java | 3 +- .../doris/datasource/FederationBackendPolicy.java | 2 +- .../org/apache/doris/datasource/FileSplit.java | 19 + .../doris/datasource/TablePartitionValues.java | 30 -- .../doris/datasource/hive/HMSTransaction.java | 30 +- .../doris/datasource/hive/HiveMetaStoreCache.java | 13 +- .../org/apache/doris/datasource/hive/HiveUtil.java | 29 +- .../datasource/hive/event/AlterDatabaseEvent.java | 4 +- .../datasource/hive/event/CreateDatabaseEvent.java | 2 +- .../datasource/hive/event/DropDatabaseEvent.java | 2 +- .../apache/doris/datasource/hudi/HudiUtils.java | 242 +++++---- .../doris/datasource/hudi/source/HudiScanNode.java | 2 +- .../iceberg/dlf/client/DLFCachedClientPool.java | 27 +- .../iceberg/source/IcebergDeleteFileFilter.java | 20 +- .../datasource/iceberg/source/IcebergScanNode.java | 7 +- .../datasource/iceberg/source/IcebergSplit.java | 6 + .../doris/datasource/jdbc/client/JdbcClient.java | 54 +- .../datasource/jdbc/client/JdbcDB2Client.java | 3 +- .../datasource/jdbc/client/JdbcGbaseClient.java | 6 +- .../datasource/jdbc/client/JdbcMySQLClient.java | 21 +- .../datasource/jdbc/client/JdbcOracleClient.java | 3 +- .../doris/datasource/jdbc/source/JdbcScanNode.java | 18 +- .../paimon/PaimonFileExternalCatalog.java | 19 +- .../datasource/paimon/source/PaimonScanNode.java | 25 +- .../datasource/paimon/source/PaimonSplit.java | 22 + .../doris/fs/remote/RemoteFSPhantomManager.java | 9 + .../org/apache/doris/fs/remote/S3FileSystem.java | 15 +- .../apache/doris/fs/remote/dfs/DFSFileSystem.java | 6 +- .../main/java/org/apache/doris/load/ExportJob.java | 20 +- .../main/java/org/apache/doris/load/ExportMgr.java | 30 +- .../java/org/apache/doris/master/MasterImpl.java | 3 + .../glue/translator/PhysicalPlanTranslator.java | 3 +- .../nereids/trees/plans/commands/CallCommand.java | 13 + .../trees/plans/commands/ExportCommand.java | 2 +- .../plans/commands/call/CallFlushAuditLogFunc.java | 57 +++ .../trees/plans/commands/call/CallFunc.java | 2 + .../trees/plans/commands/info/IndexDefinition.java | 2 +- .../java/org/apache/doris/persist/BarrierLog.java | 28 + .../apache/doris/persist/DropPartitionInfo.java | 4 +- .../org/apache/doris/persist/gson/GsonUtils.java | 30 ++ .../org/apache/doris/planner/HiveTableSink.java | 2 +- .../apache/doris/planner/SingleNodePlanner.java | 3 +- .../java/org/apache/doris/plugin/AuditEvent.java | 14 +- .../java/org/apache/doris/plugin/PluginMgr.java | 13 +- .../org/apache/doris/plugin/audit/AuditLoader.java | 29 +- .../apache/doris/plugin/audit/AuditLogBuilder.java | 2 +- .../java/org/apache/doris/qe/AuditLogHelper.java | 2 + .../java/org/apache/doris/qe/SessionVariable.java | 50 +- .../java/org/apache/doris/qe/ShowExecutor.java | 8 +- .../doris/scheduler/disruptor/TaskHandler.java | 2 + .../scheduler/manager/TransientTaskManager.java | 15 +- .../scheduler/registry/ExportTaskRegister.java | 40 -- .../apache/doris/service/FrontendServiceImpl.java | 10 +- .../src/main/java/org/apache/doris/spi/Split.java | 5 + .../apache/doris/statistics/HMSAnalysisTask.java | 9 +- .../doris/analysis/CancelExportStmtTest.java | 1 - .../org/apache/doris/catalog/OlapTableTest.java | 2 +- .../doris/common/proc/IndexesProcNodeTest.java | 8 +- .../apache/doris/common/util/LocationPathTest.java | 4 +- .../ExternalTableNameComparedLowercaseTest.java | 119 +++++ .../ExternalTableNameStoredLowercaseTest.java | 127 +++++ .../persist/TableAddOrDropColumnsInfoTest.java | 2 +- .../doris/planner/FederationBackendPolicyTest.java | 95 ++++ gensrc/thrift/Descriptors.thrift | 1 + .../data/audit/test_audit_log_behavior.out | 32 ++ .../external_table_p0/hive/ddl/test_hive_ddl.out | 1 + .../hive/test_hive_special_char_partition.out | 396 ++++++++++++++ .../jdbc/test_jdbc_catalog_push_cast.out | 4 + .../jdbc/test_mysql_jdbc_catalog.out | 445 +++++++++++++++- .../jdbc/test_mysql_jdbc_driver5_catalog.out | 420 --------------- .../jdbc/test_pg_jdbc_catalog.out | 3 - .../partial_update/test_partial_update.out | 4 +- .../partial_update/test_partial_update.out | 4 +- .../org/apache/doris/regression/suite/Suite.groovy | 22 +- .../suites/audit/test_audit_log_behavior.groovy | 9 +- .../hive/ddl/test_hive_ddl.groovy | 7 +- .../hive/test_hive_special_char_partition.groovy | 199 +++++++- .../jdbc/test_jdbc_catalog_push_cast.groovy | 105 ++++ .../jdbc/test_mysql_jdbc_catalog.groovy | 53 +- .../jdbc/test_mysql_jdbc_driver5_catalog.groovy | 566 --------------------- .../test_index_change_on_renamed_column.groovy | 13 +- .../partial_update/test_partial_update.groovy | 2 +- .../partial_update/test_partial_update.groovy | 2 +- .../vault_p0/alter/test_alter_hdfs_vault.groovy | 98 ++++ .../vault_p0/alter/test_alter_s3_vault.groovy | 106 ++++ .../create/test_create_vault.groovy} | 179 +++---- .../vault_p0/default/test_default_vault.groovy | 136 +++++ .../forbid/test_forbid_vault.groovy} | 10 +- .../vault_p0/privilege/test_vault_privilege.groovy | 190 +++++++ .../privilege/test_vault_privilege_restart.groovy | 187 +++++++ .../suites/vaults/alter/alter_hdfs.groovy | 119 ----- .../suites/vaults/alter/alter_s3.groovy | 124 ----- .../suites/vaults/default/default.groovy | 139 ----- regression-test/suites/vaults/privilege.groovy | 183 ------- .../suites/vaults/privilege_restart.groovy | 178 ------- 149 files changed, 3812 insertions(+), 2604 deletions(-) create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/call/CallFlushAuditLogFunc.java delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/scheduler/registry/ExportTaskRegister.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/lowercase/ExternalTableNameComparedLowercaseTest.java create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/lowercase/ExternalTableNameStoredLowercaseTest.java create mode 100644 regression-test/data/audit/test_audit_log_behavior.out create mode 100644 regression-test/data/external_table_p0/jdbc/test_jdbc_catalog_push_cast.out delete mode 100644 regression-test/data/external_table_p0/jdbc/test_mysql_jdbc_driver5_catalog.out create mode 100644 regression-test/suites/external_table_p0/jdbc/test_jdbc_catalog_push_cast.groovy delete mode 100644 regression-test/suites/external_table_p0/jdbc/test_mysql_jdbc_driver5_catalog.groovy create mode 100644 regression-test/suites/vault_p0/alter/test_alter_hdfs_vault.groovy create mode 100644 regression-test/suites/vault_p0/alter/test_alter_s3_vault.groovy rename regression-test/suites/{vaults/create/create.groovy => vault_p0/create/test_create_vault.groovy} (54%) create mode 100644 regression-test/suites/vault_p0/default/test_default_vault.groovy rename regression-test/suites/{vaults/forbid/forbid.groovy => vault_p0/forbid/test_forbid_vault.groovy} (89%) create mode 100644 regression-test/suites/vault_p0/privilege/test_vault_privilege.groovy create mode 100644 regression-test/suites/vault_p0/privilege/test_vault_privilege_restart.groovy delete mode 100644 regression-test/suites/vaults/alter/alter_hdfs.groovy delete mode 100644 regression-test/suites/vaults/alter/alter_s3.groovy delete mode 100644 regression-test/suites/vaults/default/default.groovy delete mode 100644 regression-test/suites/vaults/privilege.groovy delete mode 100644 regression-test/suites/vaults/privilege_restart.groovy --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org