This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch branch-2.1
in repository https://gitbox.apache.org/repos/asf/doris.git
from d66559f693c [bugfix](sessionVariable) Fix sessionVariable has
sessionOriginValue property, and execute cloneSessionVariable method will throw
java.io.NotSerializableException: java.lang.reflect.Field (#31029)
new 3da168afc98 Fix hive sample case ndv value. (#31043)
new 6e4f76de543 [improvement](jdbc catalog) Delete unnecessary schema and
optimize insert logic (#30880)
new a7037df9a1b [fix](iceberg) iceberg hms support hive1 (#30985)
new 3f126fdd630 [fix](repository) fix NullPointerException when execute
create repository statement without properties (#30972)
new 6504f6de745 [pipelineX](bug) Fix ConcurrentModificationException for
profile reporting (#31040)
new bb91c3a1cfd [enhancement](neredis)add PushDownFilterThroughGenerate
rule (#31057)
new ae809cd900b Fix hive p2 case. (#31072)
new e29d1ff59de [Fix](Docs) add thrift brew command #31077
new 2f960c49f5c [Fix](executor)Fix query runtime statistics report failed
#31064
new bda2042c782 [enhancement](paimon)add obs filesystem for paimon (#31061)
new 8db2824c44c [bugfix](es catalog) add constant_keyword wildcard data
type (#30947)
new b3ac2128dd6 [Refactor](catalog) Refactor Jdbc Catalog external name
case mapping rules (#28414)
new ed30b658bb1 fix pick_pr.sh push_id (#31041)
new bb4575a3924 [Improvement](join) optimization for
build_side_output_column (#30826)
new 5ac4b6a1373 [opt](Nereids) refine group by elimination column prune
(#30953)
new 2f9bd3e3bb0 (enhance)(S3) Change s3 metric from bvar adder to latency
recorder (#28861)
new 277de979c3a [fix](mysql-channel) initialize mysql serializer by
default (#31083)
new 8a3e6644d4f [fix](udf) fix java-udf coredump as get env return nullptr
(#30986)
The 18 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/io/fs/err_utils.cpp | 15 +-
be/src/io/fs/s3_file_reader.cpp | 3 +-
be/src/io/fs/s3_file_system.cpp | 32 ++-
be/src/io/fs/s3_file_writer.cpp | 32 +--
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 20 +-
be/src/runtime/fold_constant_executor.cpp | 3 +-
be/src/runtime/fragment_mgr.cpp | 3 +-
be/src/runtime/query_context.cpp | 3 +-
be/src/runtime/query_context.h | 2 +-
be/src/util/s3_util.cpp | 18 +-
be/src/util/s3_util.h | 19 +-
be/src/vec/columns/column.h | 7 -
be/src/vec/columns/column_array.cpp | 31 ---
be/src/vec/columns/column_array.h | 2 +-
be/src/vec/columns/column_complex.h | 14 -
be/src/vec/columns/column_const.cpp | 6 -
be/src/vec/columns/column_const.h | 2 +-
be/src/vec/columns/column_decimal.cpp | 12 -
be/src/vec/columns/column_decimal.h | 2 -
be/src/vec/columns/column_dictionary.h | 4 -
be/src/vec/columns/column_dummy.h | 4 -
be/src/vec/columns/column_fixed_length_object.h | 4 -
be/src/vec/columns/column_map.cpp | 20 --
be/src/vec/columns/column_map.h | 1 -
be/src/vec/columns/column_nullable.cpp | 15 +-
be/src/vec/columns/column_nullable.h | 3 +-
be/src/vec/columns/column_object.cpp | 12 -
be/src/vec/columns/column_object.h | 2 -
be/src/vec/columns/column_string.cpp | 28 --
be/src/vec/columns/column_string.h | 2 -
be/src/vec/columns/column_struct.cpp | 9 -
be/src/vec/columns/column_struct.h | 1 -
be/src/vec/columns/column_vector.cpp | 18 +-
be/src/vec/columns/column_vector.h | 2 -
be/src/vec/columns/predicate_column.h | 4 -
be/src/vec/exec/join/process_hash_table_probe.h | 3 +
.../vec/exec/join/process_hash_table_probe_impl.h | 70 +++--
.../array/function_array_with_constant.cpp | 4 +-
be/src/vec/functions/function_java_udf.cpp | 2 +-
be/src/vec/functions/function_java_udf.h | 18 +-
be/test/vec/core/column_array_test.cpp | 48 ----
.../elasticsearch/scripts/data/data1.json | 4 +-
.../elasticsearch/scripts/index/es7_test1.json | 7 +
.../docker-compose/mysql/init/02-create-db.sql | 3 +
.../docker-compose/mysql/init/03-create-table.sql | 12 +
.../docker-compose/mysql/init/04-insert.sql | 4 +
.../docker-compose/oracle/init/03-create-table.sql | 7 +
.../docker-compose/oracle/init/04-insert.sql | 2 +
docs/en/community/developer-guide/fe-idea-dev.md | 7 +-
.../developer-guide/mac-dev/dev-prepare.md | 7 +-
docs/en/docs/lakehouse/multi-catalog/es.md | 66 ++---
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 114 +++++++-
docs/en/docs/lakehouse/multi-catalog/paimon.md | 20 ++
.../zh-CN/community/developer-guide/fe-idea-dev.md | 7 +-
.../developer-guide/mac-dev/dev-prepare.md | 7 +-
docs/zh-CN/docs/lakehouse/multi-catalog/es.md | 66 ++---
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 116 +++++++-
docs/zh-CN/docs/lakehouse/multi-catalog/paimon.md | 20 ++
fe/fe-core/src/main/cup/sql_parser.cup | 4 +-
.../apache/doris/analysis/NativeInsertStmt.java | 33 ++-
.../apache/doris/analysis/RefreshCatalogStmt.java | 3 +-
.../java/org/apache/doris/analysis/SlotRef.java | 2 +-
.../org/apache/doris/catalog/JdbcResource.java | 10 +-
.../java/org/apache/doris/catalog/JdbcTable.java | 68 ++---
.../java/org/apache/doris/catalog/Resource.java | 2 +
.../doris/catalog/external/JdbcExternalTable.java | 9 +-
.../apache/doris/datasource/CatalogFactory.java | 2 +-
.../org/apache/doris/datasource/es/EsUtil.java | 2 +
.../doris/datasource/jdbc/JdbcExternalCatalog.java | 44 ++-
.../datasource/jdbc/JdbcIdentifierMapping.java} | 31 +--
.../doris/datasource/jdbc/client/JdbcClient.java | 264 +++++++-----------
.../datasource/jdbc/client/JdbcClientConfig.java | 23 +-
.../datasource/jdbc/client/JdbcMySQLClient.java | 85 +-----
.../datasource/jdbc/client/JdbcOracleClient.java | 66 ++---
.../datasource/mapping/IdentifierMapping.java | 299 +++++++++++++++++++++
.../paimon/PaimonFileExternalCatalog.java | 10 +
.../org/apache/doris/mysql/DummyMysqlChannel.java | 3 -
.../java/org/apache/doris/mysql/MysqlChannel.java | 4 +-
.../org/apache/doris/nereids/rules/RuleSet.java | 2 +
.../org/apache/doris/nereids/rules/RuleType.java | 1 +
.../expression/rules/FoldConstantRuleOnBE.java | 2 +
.../doris/nereids/rules/rewrite/ColumnPruning.java | 54 +++-
.../nereids/rules/rewrite/EliminateGroupByKey.java | 5 +-
.../rewrite/PushDownFilterThroughGenerate.java | 66 +++++
.../doris/planner/external/jdbc/JdbcScanNode.java | 6 +-
.../doris/planner/external/jdbc/JdbcTableSink.java | 2 +-
.../main/java/org/apache/doris/qe/Coordinator.java | 6 +-
.../hadoop/hive/metastore/HiveMetaStoreClient.java | 19 +-
.../datasource/jdbc/JdbcExternalCatalogTest.java | 25 +-
.../data/external_table_p0/es/test_es_query.out | 60 +++--
.../es/test_es_query_no_http_url.out | 4 +-
.../jdbc/test_mysql_jdbc_catalog.out | 37 ++-
.../jdbc/test_oracle_jdbc_catalog.out | 17 ++
.../external_table_p0/es/test_es_query.groovy | 4 +
.../jdbc/test_mysql_jdbc_catalog.groovy | 85 +++++-
.../jdbc/test_oracle_jdbc_catalog.groovy | 31 ++-
.../hive/test_hive_partition_column_analyze.groovy | 212 +++++++--------
.../hive/test_hive_statistic_sample.groovy | 2 +-
.../suites/nereids_syntax_p0/lateral_view.groovy | 6 +-
tools/pick_pr.sh | 5 +-
100 files changed, 1590 insertions(+), 994 deletions(-)
copy fe/{fe-common/src/main/java/org/apache/doris/catalog/AnyType.java =>
fe-core/src/main/java/org/apache/doris/datasource/jdbc/JdbcIdentifierMapping.java}
(52%)
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/datasource/mapping/IdentifierMapping.java
create mode 100644
fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/PushDownFilterThroughGenerate.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
