This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
from a2bb08cce1d [improvement](processlist) Add more information for show
processlist #24000 (#25123)
new 41103b0efc8 [bugfix](multi-catalog) Esexternalcatalog is missing
LastUpdateTime. (#24559)
new a1d8c4eaf37 [Fix](replayer) Fix `FE` crash when replaying analysis
logs. (#25024)
new 0498493d3c2 [improvement](start script) start script can not set http
proxy (#25086)
new 46a8f7cfeca [log](load) PUBLISH_TIMEOUT should not print stacktrace
(#25080)
new 78049faf4b7 [fix](es-catalog)fix error when querying the index
,elasticsearch version 8.9.1 (#24839)
new 7d769491850 [enhancement](tablet_meta_lock) add more trace for write
lock of tablet's _meta_lock (#25095)
new abeb2621946 [Enhance](catalog)add table cache in paimon jni (#25014)
new 0425a847b03 [fix](auth)fix use regex verify mysql password may cause
backtracking (#24900)
new f41066e6932 [Fix](point query) Not allow subquery for point query
optimization (#25085)
new 646f53b29b5 [feature](es-catalog) add `include_hidden_index`in order
to get the hidden index. (#24826)
new 3076efcaff4 [fix](scanner) fix load cannot end when set exec_mem_limit
(#25090)
new 2516d9b3ab3 [fix](ES catalog)Doris cannot parse ES date field without
time zone (#24864)
new cdb2e410978 [fix](fs) fix remove error log failed (#25108)
new 7acd8137b65 fix fe compile error for
abeb262194690647d78472678beafd7b9647611f
The 14 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
be/src/common/status.h | 1 +
be/src/exec/es/es_scroll_parser.cpp | 73 ++++++---
be/src/exec/es/es_scroll_parser.h | 4 +-
be/src/olap/compaction.cpp | 1 +
be/src/olap/full_compaction.cpp | 1 +
be/src/olap/tablet.cpp | 5 +
be/src/olap/task/index_builder.cpp | 2 +
be/src/runtime/load_path_mgr.cpp | 2 +-
be/src/vec/exec/format/table/paimon_reader.cpp | 5 +
be/src/vec/exec/scan/new_es_scanner.cpp | 2 +-
be/src/vec/exec/scan/scanner_context.cpp | 3 +-
bin/start_be.sh | 7 +
bin/start_fe.sh | 7 +
.../elasticsearch/scripts/data/data1.json | 1 +
.../elasticsearch/scripts/data/data1_es6.json | 1 +
.../elasticsearch/scripts/data/data2.json | 1 +
.../elasticsearch/scripts/data/data2_es6.json | 1 +
.../elasticsearch/scripts/data/data3.json | 1 +
.../elasticsearch/scripts/data/data3_es6.json | 1 +
.../elasticsearch/scripts/data/data4.json | 1 +
.../elasticsearch/scripts/data/data5.json | 4 +
.../elasticsearch/scripts/es_init.sh | 14 ++
.../index/{es6_test1.json => es6_hide.json} | 3 -
.../elasticsearch/scripts/index/es6_test1.json | 3 +
.../elasticsearch/scripts/index/es6_test2.json | 3 +
.../index/{es7_test1.json => es7_hide.json} | 0
.../elasticsearch/scripts/index/es7_test1.json | 3 +
.../elasticsearch/scripts/index/es7_test2.json | 3 +
.../elasticsearch/scripts/index/es7_test3.json | 22 +++
docs/en/docs/lakehouse/multi-catalog/es.md | 23 +--
docs/zh-CN/docs/lakehouse/multi-catalog/es.md | 23 +--
.../org/apache/doris/paimon/PaimonJniScanner.java | 40 ++---
.../org/apache/doris/paimon/PaimonTableCache.java | 182 +++++++++++++++++++++
.../java/org/apache/doris/analysis/SelectStmt.java | 4 +
.../java/org/apache/doris/catalog/EsResource.java | 6 +
.../java/org/apache/doris/catalog/EsTable.java | 14 +-
.../doris/catalog/external/EsExternalTable.java | 1 +
.../catalog/external/PaimonExternalTable.java | 8 +-
.../org/apache/doris/datasource/CatalogMgr.java | 2 +-
.../apache/doris/datasource/EsExternalCatalog.java | 35 ++--
.../apache/doris/datasource/ExternalCatalog.java | 3 +-
.../doris/external/elasticsearch/EsRestClient.java | 13 +-
.../doris/external/elasticsearch/EsUtil.java | 14 +-
.../java/org/apache/doris/mysql/MysqlPassword.java | 22 +--
.../planner/external/paimon/PaimonScanNode.java | 4 +
gensrc/thrift/PlanNodes.thrift | 4 +
.../data/external_table_p0/es/test_es_query.out | 171 +++++++++++++------
.../es/test_es_query_no_http_url.out | 6 +-
.../external_table_p0/es/test_es_query.groovy | 147 +++++++++++++----
.../stream_load/test_stream_load_properties.groovy | 2 +-
.../test_update.groovy} | 46 ++----
tools/tpcds-tools/bin/create-tpcds-tables.sh | 19 ++-
...pcds-tables.sql => create-tpcds-tables-sf1.sql} | 0
tools/tpch-tools/bin/create-tpch-tables.sh | 5 +-
tools/tpch-tools/conf/doris-cluster.conf | 2 +-
...-tpch-tables.sql => create-tpch-tables-sf1.sql} | 0
56 files changed, 732 insertions(+), 239 deletions(-)
create mode 100755
docker/thirdparties/docker-compose/elasticsearch/scripts/data/data5.json
copy
docker/thirdparties/docker-compose/elasticsearch/scripts/index/{es6_test1.json
=> es6_hide.json} (95%)
mode change 100755 => 100644
copy
docker/thirdparties/docker-compose/elasticsearch/scripts/index/{es7_test1.json
=> es7_hide.json} (100%)
mode change 100755 => 100644
create mode 100644
docker/thirdparties/docker-compose/elasticsearch/scripts/index/es7_test3.json
create mode 100644
fe/be-java-extensions/paimon-scanner/src/main/java/org/apache/doris/paimon/PaimonTableCache.java
copy regression-test/suites/{datatype_p0/decimalv3/test_show_decimalv3.groovy
=> point_query_p0/test_update.groovy} (52%)
rename tools/tpcds-tools/ddl/{create-tpcds-tables.sql =>
create-tpcds-tables-sf1.sql} (100%)
rename tools/tpch-tools/ddl/{create-tpch-tables.sql =>
create-tpch-tables-sf1.sql} (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]