This is an automated email from the ASF dual-hosted git repository. kassiez pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new d848135d1eb [downlaod] update 2.1.8 release (#1935) d848135d1eb is described below commit d848135d1eb4d0883050b608a28610293d94aacb Author: KassieZ <139741991+kass...@users.noreply.github.com> AuthorDate: Fri Jan 24 13:07:09 2025 +0800 [downlaod] update 2.1.8 release (#1935) ## Versions - [ ] dev - [ ] 3.0 - [x] 2.1 - [ ] 2.0 ## Languages - [ ] Chinese - [ ] English ## Docs Checklist - [ ] Checked by AI - [ ] Test Cases Built --- ...-scaling-bitcoin-data-to-billions-of-records.md | 2 +- ...doris-for-maximum-performance-and-resilience.md | 2 +- blog/release-note-2.1.8.md | 192 ++++++++++++++++++++ blog/release-note-3.0.0.md | 2 - docs/releasenotes/all-release.md | 4 +- docs/releasenotes/v2.1/release-2.1.8.md | 186 +++++++++++++++++++ .../current/releasenotes/all-release.md | 4 +- .../current/releasenotes/v2.1/release-2.1.8.md | 198 +++++++++++++++++++++ .../version-2.1/releasenotes/all-release.md | 6 +- .../version-2.1/releasenotes/v2.1/release-2.1.8.md | 198 +++++++++++++++++++++ .../version-3.0/releasenotes/all-release.md | 4 +- .../version-3.0/releasenotes/v2.1/release-2.1.8.md | 198 +++++++++++++++++++++ sidebars.json | 1 + src/components/recent-blogs/recent-blogs.data.ts | 4 +- src/constant/download.data.ts | 72 ++++++-- src/constant/newsletter.data.ts | 7 +- src/pages/ecosystem/cluster-management/index.tsx | 8 +- static/images/2.1.8.jpg | Bin 0 -> 423306 bytes .../version-2.1/releasenotes/all-release.md | 4 +- .../version-2.1/releasenotes/v2.1/release-2.1.8.md | 186 +++++++++++++++++++ .../version-3.0/releasenotes/all-release.md | 4 +- .../version-3.0/releasenotes/v2.1/release-2.1.8.md | 186 +++++++++++++++++++ versioned_sidebars/version-2.1-sidebars.json | 1 + versioned_sidebars/version-3.0-sidebars.json | 1 + 24 files changed, 1430 insertions(+), 40 deletions(-) diff --git a/blog/ortege-studio-1-scaling-bitcoin-data-to-billions-of-records.md b/blog/ortege-studio-1-scaling-bitcoin-data-to-billions-of-records.md index 2930123e698..edca940379b 100644 --- a/blog/ortege-studio-1-scaling-bitcoin-data-to-billions-of-records.md +++ b/blog/ortege-studio-1-scaling-bitcoin-data-to-billions-of-records.md @@ -7,7 +7,7 @@ 'author': 'Justin Trollip', 'tags': ['Best Practice'], 'picked': "true", - 'order': "1", + 'order': "2", "image": '/images/ortege-1.jpg' } diff --git a/blog/ortege-studio-2-fine-tuning-apache-doris-for-maximum-performance-and-resilience.md b/blog/ortege-studio-2-fine-tuning-apache-doris-for-maximum-performance-and-resilience.md index 84140e487c0..7882d7f33a7 100644 --- a/blog/ortege-studio-2-fine-tuning-apache-doris-for-maximum-performance-and-resilience.md +++ b/blog/ortege-studio-2-fine-tuning-apache-doris-for-maximum-performance-and-resilience.md @@ -7,7 +7,7 @@ 'author': 'Justin Trollip', 'tags': ['Best Practice'], 'picked': "true", - 'order': "2", + 'order': "3", "image": '/images/ortege-2.jpg' } diff --git a/blog/release-note-2.1.8.md b/blog/release-note-2.1.8.md new file mode 100644 index 00000000000..21ac75dafd3 --- /dev/null +++ b/blog/release-note-2.1.8.md @@ -0,0 +1,192 @@ +--- +{ + 'title': 'Apache Doris 2.1.8 just released', + 'summary': 'This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more.', + 'description': 'This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more.', + 'date': '2025-01-24', + 'author': 'Apache Doris', + 'tags': ['Release Notes'], + 'picked': "true", + 'order': "1", + "image": '/images/2.1.8.jpg' +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + http://www.apache.org/licenses/LICENSE-2.0 +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + + +Dear Community, **Apache Doris version 2.1.8 was officially released on January 24, 2025.** This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more. + +- [Quick Download](https://doris.apache.org/download) + +- [GitHub Release](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + +## Behavior Changes + +- Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) +- Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. +- In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. Downgrading is not possible after enabling these configurations. + +## New Features + +- The Arrow flight protocol supports accessing BE through a load - balancing device. [#43281](https://github.com/apache/doris/pull/43281) +- Now lambda expressions support capturing external columns (#45186).[#45186](https://github.com/apache/doris/pull/45186) + +## Improvements + +### Lakehouse + +- Update the Hudi version to 0.15. And optimize the query planning performance of Hudi tables. +- Optimize the read performance of MaxCompute partitioned tables. [#45148](https://github.com/apache/doris/pull/45148) +- Support the session variable `enable_text_validate_utf8`, which can ignore the UTF8 encoding detection in CSV format. [#45537](https://github.com/apache/doris/pull/45537) +- Optimize the performance of Parquet file lazy materialization under high - filtering - rate conditions. [#46183](https://github.com/apache/doris/pull/46183) + +### Asynchronous Materialized Views + +- Now it supports manually refreshing partitions that do not exist in an asynchronous materialized view [#45290](https://github.com/apache/doris/pull/45290). +- Optimize the performance of transparent rewrite planning [#44786](https://github.com/apache/doris/pull/44786). + +### Query Optimizer + +- Improve the adaptive ability of runtime filters [#42640](https://github.com/apache/doris/pull/42640). +- Add the ability to generate original column filter conditions from filter conditions on `max/min` aggregate function columns [#39252](https://github.com/apache/doris/pull/39252) +- Add the ability to extract single - side filter conditions from join predicates [#38479](https://github.com/apache/doris/pull/38479). +- Optimize the ability of predicate derivation on set operators to better generate filter predicates [#39450](https://github.com/apache/doris/pull/39450). +- Optimize the exception handling ability of statistic information collection and usage to avoid generating unexpected execution plans when collection exceptions occur. [#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### Query Execution Engine + +- Optimize the execution of queries with `limit` to end faster and avoid unnecessary data scanning [#44255](https://github.com/apache/doris/pull/44255). + +### Storage Management + +- CCR supports more comprehensive operations, such as `rename table`, `rename column`, `modify comment`, `drop view`, `drop rollup`, etc. +- Improve the accuracy of the broker load import progress and the performance when importing multiple compressed files. +- Improve the routine load timeout strategy and thread - pool usage to prevent routine load timeout failures and impacts on queries. + +### Others + +- The Docker quick - start image supports starting without setting environment parameters. Add the environment variable `SKIP_CHECK_ULIMIT` to skip the `start_be.sh` script and the swap, `max_map_count`, ulimit - related verification checks within the BE process. This is only applicable to applications in the Docker quick - start scenario. [#45269](https://github.com/apache/doris/pull/45269) +- Add the new LDAP configuration `ldap_group_filter` for custom group filtering. [#43292](https://github.com/apache/doris/pull/43292) +- Optimize performance when using ranger. [#41207](https://github.com/apache/doris/pull/41207) +- Fix the inaccurate statistics of `scan bytes` in the audit log. [#45167](https://github.com/apache/doris/pull/45167) +- Now, the default values of columns can be correctly displayed in the `COLUMNS` system table. [#44849](https://github.com/apache/doris/pull/44849) +- Now, the definition of views can be correctly displayed in the `VIEWS` system table. [#45857](https://github.com/apache/doris/pull/45857) +- Now, the `admin` user cannot be deleted. [#44751](https://github.com/apache/doris/pull/44751) + +## Bug Fixes + +### Lakehouse + +#### Hive + +- Fix the problem of being unable to query Hive views created by Spark. [#43553](https://github.com/apache/doris/pull/43553) +- Fix the problem of being unable to correctly read some Hive Transaction tables. [#45753](https://github.com/apache/doris/pull/45753) +- Fix the problem of incorrect partition pruning when Hive table partitions contain special characters. [#42906](https://github.com/apache/doris/pull/42906) + +#### Iceberg + +- Fix the problem of being unable to create Iceberg tables in a Kerberos - authenticated environment. [#43445](https://github.com/apache/doris/pull/43445) +- Fix the problem of inaccurate `count(*)` queries when there are dangling deletes in Iceberg tables in some cases. [#44039](https://github.com/apache/doris/pull/44039) +- Fix the problem of query errors due to column name mismatches in Iceberg tables in some cases . [#44470](https://github.com/apache/doris/pull/44470) +- Fix the problem of being unable to read Iceberg tables when their partitions are modified in some cases .[#45367](https://github.com/apache/doris/pull/45367) + +#### Paimon + +- Fix the problem that the Paimon Catalog cannot access Alibaba Cloud OSS - HDFS. [#42585](https://github.com/apache/doris/pull/42585) + +#### Hudi + +- Fix the problem of ineffective partition pruning in Hudi tables in some cases. [#44669](https://github.com/apache/doris/pull/44669) + +#### JDBC + +- Fix the problem of being unable to obtain tables using the JDBC Catalog after enabling the case insensitive table name feature in some cases. + +#### MaxCompute + +- Fix the problem of ineffective partition pruning in MaxCompute tables in some cases[#44508](https://github.com/apache/doris/pull/44508). + +#### Others + +- Fix the problem of FE memory leaks caused by EXPORT tasks in some cases.[#44019](https://github.com/apache/doris/pull/44019) +- Fix the problem of being unable to access S3 object storage using the https protocol in some cases [#44242](https://github.com/apache/doris/pull/44242). +- Fix the problem of the inability to automatically refresh Kerberos authentication tickets in some cases [#44916](https://github.com/apache/doris/pull/44916) +- Fix the problem of errors when reading Hadoop Block compressed format files in some cases. [#45289](https://github.com/apache/doris/pull/45289) +- When querying ORC - formatted data, no longer push down CHAR - type predicates to avoid possible result errors. [#45484](https://github.com/apache/doris/pull/45484) + +### Asynchronous Materialized Views + +- Fix the problem that when there is a CTE in the materialized view definition, it cannot be refreshed [#44857](https://github.com/apache/doris/pull/44857). +- Fix the problem that when columns are added to the base table, the asynchronous materialized view cannot hit the transparent rewrite. [#44867](https://github.com/apache/doris/pull/44867) +- Fix the problem that when the same filter predicate is included in different positions in a query, the transparent rewrite fails. [#44575](https://github.com/apache/doris/pull/44575) +- Fix the problem that when column aliases are used in filter predicates or join predicates, the transparent rewrite cannot be performed. [#44779](https://github.com/apache/doris/pull/44779) + +### Inverted Index + +- Fix the problem of abnormal handling of inverted index compaction. [#45773](https://github.com/apache/doris/pull/45773) +- Fix the problem that inverted index construction fails due to lock - waiting timeout. [#43589](https://github.com/apache/doris/pull/43589) +- Fix the problem of inverted index write crashes in abnormal situations. [#46075](https://github.com/apache/doris/pull/46075) +- Fix the null - pointer problem of the `match` function with special parameters. [#45774](https://github.com/apache/doris/pull/45774) +- Fix problems related to the variant inverted index and disable the use of the index v1 format for variants [#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) +- Fix the problem of crashes when setting `gram_size = 65535` for the ngram bloomfilter index [#43654](https://github.com/apache/doris/pull/43654) +- Fix the problem of incorrect calculation of DATE and DATETIME for the bloomfilter index [#43622](https://github.com/apache/doris/pull/43622) +- Fix the problem that dropping a column does not automatically drop the bloomfilter index [#44478](https://github.com/apache/doris/pull/44478) +- Reduce the memory footprint when writing the bloomfilter index [#46047](https://github.com/apache/doris/pull/46047) + +### Semi-Structure Data + +- Optimize memory usage and reduce the memory consumption of the `variant` data type [#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- Optimize the performance of `variant` schema copy. [#45731](https://github.com/apache/doris/pull/45731) +- Do not use `variant` as a key when automatically inferring tablet keys. [#44736](https://github.com/apache/doris/pull/44736) +- Fix the problem of changing `variant` from `NOT NULL` to `NULL` [#45734](https://github.com/apache/doris/pull/45734) +- Fix the problem of incorrect type inference of lambda functions. [#45798](https://github.com/apache/doris/pull/45798) +- Fix the coredump problem at the boundary conditions of the `ipv6_cidr_to_range` function [#46252](https://github.com/apache/doris/pull/46252) + +### Query Optimizer + +- Fix the potential deadlock problem caused by mutual exclusion of table read locks and optimize the lock - using logic [#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995). +- Fix the problem that the SQL Cache function incorrectly uses constant folding, resulting in incorrect results when using functions containing time formats . [#44631](https://github.com/apache/doris/pull/44631) +- Fix the problem of incorrect optimization of comparison expressions in edge cases, which may lead to incorrect results. [#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- Fix the problem of incorrect audit logs for high - concurrent point queries [ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- Fix the problem of continuous error reporting after an exception occurs in high - concurrent point queries [#44582](https://github.com/apache/doris/pull/44582) +- Fix the problem of incorrectly prepared statements for some fields.[#45732 ](https://github.com/apache/doris/pull/45732) + +### Query Execution Engine + +- Fix the problem of incorrect results of regular expressions and `like` functions for special characters. [#44547](https://github.com/apache/doris/pull/44547) +- Fix the problem that the SQL Cache may have incorrect results when switching databases. [#44782](https://github.com/apache/doris/pull/44782) +- Fix the problem of incorrect results of the `cut_ipv6` function. [#43921](https://github.com/apache/doris/pull/43921) +- Fix the problem of casting from numeric types to bool types. [#46275](https://github.com/apache/doris/pull/46275) +- Fix a series of problems related to arrow flight. [#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- Fix the problem of incorrect results in some cases when the hash table of hash join exceeds 4G. [#46461](https://github.com/apache/doris/pull/46461/files) +- Fix the overflow problem of the `convert_to` function for Chinese characters. [#46505](https://github.com/apache/doris/pull/46405) + +### Storage Management + +- Fix the problem that high - concurrent DDL may cause FE startup failure. +- Fix the problem that auto - increment columns may have duplicate values. +- Fix the problem that routine load cannot use the newly expanded BE during expansion. + +### Permission Management + +- Fix the problem of frequent access to the Ranger service when using Ranger as the authentication plugin [#45645](https://github.com/apache/doris/pull/45645). + +### Others + +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file diff --git a/blog/release-note-3.0.0.md b/blog/release-note-3.0.0.md index 1c54a3db989..1d623dc5991 100644 --- a/blog/release-note-3.0.0.md +++ b/blog/release-note-3.0.0.md @@ -6,8 +6,6 @@ 'date': '2024-10-15', 'author': 'Apache Doris', 'tags': ['Release Notes'], - 'picked': "true", - 'order': "3", "image": '/images/3.0.0.jpeg' } --- diff --git a/docs/releasenotes/all-release.md b/docs/releasenotes/all-release.md index 392e8e1a956..0f5212e98f9 100644 --- a/docs/releasenotes/all-release.md +++ b/docs/releasenotes/all-release.md @@ -32,13 +32,15 @@ This document presents a summary of Apache Doris versions released within one ye <br /> -🎉 Version 2.1.7 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.6) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] +🎉 Version 2.1.8 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.8) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] ::: <br /> +- [2025-01-24, Apache Doris 2.1.8 is released](../releasenotes/v2.1/release-2.1.8.md) + - [2024-12-02, Apache Doris 3.0.3 is released](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 is released](../releasenotes/v2.1/release-2.1.7.md) diff --git a/docs/releasenotes/v2.1/release-2.1.8.md b/docs/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..0daf1385d41 --- /dev/null +++ b/docs/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,186 @@ +--- +{ + "title": "Release 2.1.8", + "language": "en" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +Dear Community, **Apache Doris version 2.1.8 was officially released on January 24, 2025.** This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more. + +- [Quick Download](https://doris.apache.org/download) + +- [GitHub Release](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + +## Behavior Changes + +- Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) +- Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. +- In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. Downgrading is not possible after enabling these configurations. + +## New Features + +- The Arrow flight protocol supports accessing BE through a load - balancing device. [#43281](https://github.com/apache/doris/pull/43281) +- Now lambda expressions support capturing external columns (#45186).[#45186](https://github.com/apache/doris/pull/45186) + +## Improvements + +### Lakehouse + +- Update the Hudi version to 0.15. And optimize the query planning performance of Hudi tables. +- Optimize the read performance of MaxCompute partitioned tables. [#45148](https://github.com/apache/doris/pull/45148) +- Support the session variable `enable_text_validate_utf8`, which can ignore the UTF8 encoding detection in CSV format. [#45537](https://github.com/apache/doris/pull/45537) +- Optimize the performance of Parquet file lazy materialization under high - filtering - rate conditions. [#46183](https://github.com/apache/doris/pull/46183) + +### Asynchronous Materialized Views + +- Now it supports manually refreshing partitions that do not exist in an asynchronous materialized view [#45290](https://github.com/apache/doris/pull/45290). +- Optimize the performance of transparent rewrite planning [#44786](https://github.com/apache/doris/pull/44786). + +### Query Optimizer + +- Improve the adaptive ability of runtime filters [#42640](https://github.com/apache/doris/pull/42640). +- Add the ability to generate original column filter conditions from filter conditions on `max/min` aggregate function columns [#39252](https://github.com/apache/doris/pull/39252) +- Add the ability to extract single - side filter conditions from join predicates [#38479](https://github.com/apache/doris/pull/38479). +- Optimize the ability of predicate derivation on set operators to better generate filter predicates [#39450](https://github.com/apache/doris/pull/39450). +- Optimize the exception handling ability of statistic information collection and usage to avoid generating unexpected execution plans when collection exceptions occur. [#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### Query Execution Engine + +- Optimize the execution of queries with `limit` to end faster and avoid unnecessary data scanning [#44255](https://github.com/apache/doris/pull/44255). + +### Storage Management + +- CCR supports more comprehensive operations, such as `rename table`, `rename column`, `modify comment`, `drop view`, `drop rollup`, etc. +- Improve the accuracy of the broker load import progress and the performance when importing multiple compressed files. +- Improve the routine load timeout strategy and thread - pool usage to prevent routine load timeout failures and impacts on queries. + +### Others + +- The Docker quick - start image supports starting without setting environment parameters. Add the environment variable `SKIP_CHECK_ULIMIT` to skip the `start_be.sh` script and the swap, `max_map_count`, ulimit - related verification checks within the BE process. This is only applicable to applications in the Docker quick - start scenario. [#45269](https://github.com/apache/doris/pull/45269) +- Add the new LDAP configuration `ldap_group_filter` for custom group filtering. [#43292](https://github.com/apache/doris/pull/43292) +- Optimize performance when using ranger. [#41207](https://github.com/apache/doris/pull/41207) +- Fix the inaccurate statistics of `scan bytes` in the audit log. [#45167](https://github.com/apache/doris/pull/45167) +- Now, the default values of columns can be correctly displayed in the `COLUMNS` system table. [#44849](https://github.com/apache/doris/pull/44849) +- Now, the definition of views can be correctly displayed in the `VIEWS` system table. [#45857](https://github.com/apache/doris/pull/45857) +- Now, the `admin` user cannot be deleted. [#44751](https://github.com/apache/doris/pull/44751) + +## Bug Fixes + +### Lakehouse + +#### Hive + +- Fix the problem of being unable to query Hive views created by Spark. [#43553](https://github.com/apache/doris/pull/43553) +- Fix the problem of being unable to correctly read some Hive Transaction tables. [#45753](https://github.com/apache/doris/pull/45753) +- Fix the problem of incorrect partition pruning when Hive table partitions contain special characters. [#42906](https://github.com/apache/doris/pull/42906) + +#### Iceberg + +- Fix the problem of being unable to create Iceberg tables in a Kerberos - authenticated environment. [#43445](https://github.com/apache/doris/pull/43445) +- Fix the problem of inaccurate `count(*)` queries when there are dangling deletes in Iceberg tables in some cases. [#44039](https://github.com/apache/doris/pull/44039) +- Fix the problem of query errors due to column name mismatches in Iceberg tables in some cases . [#44470](https://github.com/apache/doris/pull/44470) +- Fix the problem of being unable to read Iceberg tables when their partitions are modified in some cases .[#45367](https://github.com/apache/doris/pull/45367) + +#### Paimon + +- Fix the problem that the Paimon Catalog cannot access Alibaba Cloud OSS - HDFS. [#42585](https://github.com/apache/doris/pull/42585) + +#### Hudi + +- Fix the problem of ineffective partition pruning in Hudi tables in some cases. [#44669](https://github.com/apache/doris/pull/44669) + +#### JDBC + +- Fix the problem of being unable to obtain tables using the JDBC Catalog after enabling the case insensitive table name feature in some cases. + +#### MaxCompute + +- Fix the problem of ineffective partition pruning in MaxCompute tables in some cases[#44508](https://github.com/apache/doris/pull/44508). + +#### Others + +- Fix the problem of FE memory leaks caused by EXPORT tasks in some cases.[#44019](https://github.com/apache/doris/pull/44019) +- Fix the problem of being unable to access S3 object storage using the https protocol in some cases [#44242](https://github.com/apache/doris/pull/44242). +- Fix the problem of the inability to automatically refresh Kerberos authentication tickets in some cases [#44916](https://github.com/apache/doris/pull/44916) +- Fix the problem of errors when reading Hadoop Block compressed format files in some cases. [#45289](https://github.com/apache/doris/pull/45289) +- When querying ORC - formatted data, no longer push down CHAR - type predicates to avoid possible result errors. [#45484](https://github.com/apache/doris/pull/45484) + +### Asynchronous Materialized Views + +- Fix the problem that when there is a CTE in the materialized view definition, it cannot be refreshed [#44857](https://github.com/apache/doris/pull/44857). +- Fix the problem that when columns are added to the base table, the asynchronous materialized view cannot hit the transparent rewrite. [#44867](https://github.com/apache/doris/pull/44867) +- Fix the problem that when the same filter predicate is included in different positions in a query, the transparent rewrite fails. [#44575](https://github.com/apache/doris/pull/44575) +- Fix the problem that when column aliases are used in filter predicates or join predicates, the transparent rewrite cannot be performed. [#44779](https://github.com/apache/doris/pull/44779) + +### Inverted Index + +- Fix the problem of abnormal handling of inverted index compaction. [#45773](https://github.com/apache/doris/pull/45773) +- Fix the problem that inverted index construction fails due to lock - waiting timeout. [#43589](https://github.com/apache/doris/pull/43589) +- Fix the problem of inverted index write crashes in abnormal situations. [#46075](https://github.com/apache/doris/pull/46075) +- Fix the null - pointer problem of the `match` function with special parameters. [#45774](https://github.com/apache/doris/pull/45774) +- Fix problems related to the variant inverted index and disable the use of the index v1 format for variants [#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) +- Fix the problem of crashes when setting `gram_size = 65535` for the ngram bloomfilter index [#43654](https://github.com/apache/doris/pull/43654) +- Fix the problem of incorrect calculation of DATE and DATETIME for the bloomfilter index [#43622](https://github.com/apache/doris/pull/43622) +- Fix the problem that dropping a column does not automatically drop the bloomfilter index [#44478](https://github.com/apache/doris/pull/44478) +- Reduce the memory footprint when writing the bloomfilter index [#46047](https://github.com/apache/doris/pull/46047) + +### Semi-Structure Data + +- Optimize memory usage and reduce the memory consumption of the `variant` data type [#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- Optimize the performance of `variant` schema copy. [#45731](https://github.com/apache/doris/pull/45731) +- Do not use `variant` as a key when automatically inferring tablet keys. [#44736](https://github.com/apache/doris/pull/44736) +- Fix the problem of changing `variant` from `NOT NULL` to `NULL` [#45734](https://github.com/apache/doris/pull/45734) +- Fix the problem of incorrect type inference of lambda functions. [#45798](https://github.com/apache/doris/pull/45798) +- Fix the coredump problem at the boundary conditions of the `ipv6_cidr_to_range` function [#46252](https://github.com/apache/doris/pull/46252) + +### Query Optimizer + +- Fix the potential deadlock problem caused by mutual exclusion of table read locks and optimize the lock - using logic [#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995). +- Fix the problem that the SQL Cache function incorrectly uses constant folding, resulting in incorrect results when using functions containing time formats . [#44631](https://github.com/apache/doris/pull/44631) +- Fix the problem of incorrect optimization of comparison expressions in edge cases, which may lead to incorrect results. [#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- Fix the problem of incorrect audit logs for high - concurrent point queries [ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- Fix the problem of continuous error reporting after an exception occurs in high - concurrent point queries [#44582](https://github.com/apache/doris/pull/44582) +- Fix the problem of incorrectly prepared statements for some fields.[#45732 ](https://github.com/apache/doris/pull/45732) + +### Query Execution Engine + +- Fix the problem of incorrect results of regular expressions and `like` functions for special characters. [#44547](https://github.com/apache/doris/pull/44547) +- Fix the problem that the SQL Cache may have incorrect results when switching databases. [#44782](https://github.com/apache/doris/pull/44782) +- Fix the problem of incorrect results of the `cut_ipv6` function. [#43921](https://github.com/apache/doris/pull/43921) +- Fix the problem of casting from numeric types to bool types. [#46275](https://github.com/apache/doris/pull/46275) +- Fix a series of problems related to arrow flight. [#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- Fix the problem of incorrect results in some cases when the hash table of hash join exceeds 4G. [#46461](https://github.com/apache/doris/pull/46461/files) +- Fix the overflow problem of the `convert_to` function for Chinese characters. [#46505](https://github.com/apache/doris/pull/46405) + +### Storage Management + +- Fix the problem that high - concurrent DDL may cause FE startup failure. +- Fix the problem that auto - increment columns may have duplicate values. +- Fix the problem that routine load cannot use the newly expanded BE during expansion. + +### Permission Management + +- Fix the problem of frequent access to the Ranger service when using Ranger as the authentication plugin [#45645](https://github.com/apache/doris/pull/45645). + +### Others + +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/all-release.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/all-release.md index 994cfca2c67..6b4121609da 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/all-release.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/all-release.md @@ -34,12 +34,14 @@ under the License. <br /> -🎉 2.1.7 版本现已于 2024 年 10 月 15 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.7)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 +🎉 2.1.8 版本现已于 2025 年 01 月 24 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.8)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 ::: <br /> +- [2025-01-24, Apache Doris 2.1.8 版本发布](../releasenotes/v2.1/release-2.1.8.md) + - [2024-12-02, Apache Doris 3.0.3 版本发布](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 版本发布](../releasenotes/v2.1/release-2.1.7.md) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..bf2205218c9 --- /dev/null +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,198 @@ +--- +{ + "title": "Release 2.1.8", + "language": "zh-CN" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +亲爱的社区小伙伴们,**Apache Doris 2.1.8 版本已于 2025 年 01 月 24 日正式发布。** 该版本持续在湖仓一体、异步物化视图、查询优化器与执行引擎、存储管理等方面进行改进提升与问题修复,进一步加强系统的性能和稳定性,欢迎大家下载体验。 + +- [立即下载](https://doris.apache.org/download) + +- [GitHub 下载](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + + +## 行为变更 + +- 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) +- 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 +- FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,打开之后无法降级 + +## 新功能 + +- **查询执行引擎:**Arrowflight 协议支持通过负载均衡设备访问 BE。 [#43281](https://github.com/apache/doris/pull/43281) +- **其他:**当前 Lambda 表达式支持捕获外部的列。 [#45186](https://github.com/apache/doris/pull/45186) + +## 改进提升 + +### 湖仓一体 + +- Hudi 版本更新至 0.15,并且优化了 Hudi 表的查询规划性能。 +- 优化了 MaxCompute 分区表的读取性能。 [#45148](https://github.com/apache/doris/pull/45148) +- 支持会话变量 enable_text_validate_utf8,可以忽略 CSV 格式中的 UTF8 编码检测。[#45537](https://github.com/apache/doris/pull/45537) +- 优化在高过滤率情况下,Parquet 文件延迟物化的性能。[#46183](https://github.com/apache/doris/pull/46183) + +### 异步物化视图 + +- 现在支持手动刷新异步物化视图中不存在的分区。[#45290](https://github.com/apache/doris/pull/45290) +- 优化了透明改写规划的性能。[#44786](https://github.com/apache/doris/pull/44786) + +### 查询优化器 + +- 提升了 Runtime Filter 的自适应能力。[#42640](https://github.com/apache/doris/pull/42640) +- 增加了在 MAX / MIN 聚合函数列上的过滤条件生成原始列过滤条件的能力。[#39252](https://github.com/apache/doris/pull/39252) +- 增加了在连接谓词上抽取单测过滤条件的能力。[#38479](https://github.com/apache/doris/pull/38479) +- 优化了谓词推导在集合算子上的能力,可以更好的生成过滤谓词。[#39450](https://github.com/apache/doris/pull/39450) +- 优化了统计信息收集和使用的异常处理能力,避免在收集异常时产生非预期的执行计划。[#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### 查询执行引擎 + +- Resource group 支持在当前 group 不可用的时候,降级到别的 Group. [#44255](https://github.com/apache/doris/pull/44255) +- 优化带 limit 的查询执行使其能够更快的结束,避免多余的数据扫描。[#45222](https://github.com/apache/doris/pull/45222) + +### 存储管理 + +- CCR 支持了更加全面的操作,比如 Rename Table,Rename Column,Modify Comment,Drop View,Drop Rollup 等。 +- 提升了 Broker Load 导入进度的准确性和多个压缩文件导入时的性能。 +- 改进了 Routine Load 超时策略、线程池使用以防止 Routine Load 超时失败和影响查询。 + +### 其他 + +- Docker 快速启动镜像支持不设置环境参数直接启动,添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 `start_be.sh` 脚本以及 BE 进程内关于 `swap`、`max_map_count`、`ulimit` 相关校验检查,仅适用于 Docker 快速启动场景中应用。[#45269](https://github.com/apache/doris/pull/45269) +- 新增 LDAP 配置型 `ldap_group_filter` 用于自定义 Group 过滤。[#43292](https://github.com/apache/doris/pull/43292) +- 优化了使用 Ranger 时的性能。[#41207](https://github.com/apache/doris/pull/41207) +- 修复审计日志中,`scan bytes` 统计不准的问题。[#45167](https://github.com/apache/doris/pull/45167) +- 在 COLUMNS 系统表中能够正确显示列的默认值。[#44849](https://github.com/apache/doris/pull/44849) +- 在 VIEWS 系统表中能够正确显示视图的定义。[#45857](https://github.com/apache/doris/pull/45857) +- 当前,admin 用户不能被删除。[#44751](https://github.com/apache/doris/pull/44751) + +## Bug 修复 + +### 湖仓一体 + +- Hive + + - 修复无法查询 Spark 创建的 Hive 视图的问题。[#43553](https://github.com/apache/doris/pull/43553) + + - 修复无法正确读取某些 Hive Transaction 表的问题。[#45753](https://github.com/apache/doris/pull/45753) + + - 修复 Hive 表分区存在特殊字符时,无法进行正确分区裁剪的问题。[#42906](https://github.com/apache/doris/pull/42906) + +- Iceberg + + - 修复在 Kerberos 认证环境下,无法创建 Iceberg 表的问题。[#43445](https://github.com/apache/doris/pull/43445) + + - 修复某些情况下,Iceberg 表存在 dangling delete 情况下,`count(*)` 查询不准确的问题。[#44039](https://github.com/apache/doris/pull/44039) + + - 修复某些情况下,Iceberg 表列名不匹配导致查询错误的问题[#44470](https://github.com/apache/doris/pull/44470) + + - 修复某些情况下,当 Iceberg 表分区被修改后,无法读取的问题[#45367](https://github.com/apache/doris/pull/45367) + +- Paimon + + - 修复 Paimon Catalog 无法访问阿里云 OSS-HDFS 的问题。[#42585](https://github.com/apache/doris/pull/42585) + +- Hudi + + - 修复某些情况下,Hudi 表分区裁剪失效的问题。[#44669](https://github.com/apache/doris/pull/44669) + +- JDBC + + - 修复某些情况下,开始表名大小写不敏感功能后,使用 JDBC Catalog 无法获取表的问题。 + +- MaxCompute + + - 修复某些情况下,MaxCompute 表分区裁剪失效的问题。[#44508](https://github.com/apache/doris/pull/44508) + +- 其他 + + - 修复某些情况下,Export 任务导致 FE 内存泄露的问题。[#44019](https://github.com/apache/doris/pull/44019) + + - 修复某些情况下,无法使用 HTTPS 协议访问 S3 对象存储的问题。[#44242](https://github.com/apache/doris/pull/44242) + + - 修复某些情况下,Kerberos 认证票据无法自动刷新的问题。[#44916](https://github.com/apache/doris/pull/44916) + + - 修复某些情况下,读取 Hadoop Block 压缩格式文件出错的问题。[#45289](https://github.com/apache/doris/pull/45289) + + - 查询 ORC 格式的数据时,不再下推 CHAR 类型的谓词,以避免可能的结果错误。[#45484](https://github.com/apache/doris/pull/45484) + +### 异步物化视图 + +- 修复了当物化视图定义中存在 CTE 时,无法刷新的问题。[#44857](https://github.com/apache/doris/pull/44857) +- 修复了当基表增加列后,异步物化视图不能命中透明改写的问题。[#44867](https://github.com/apache/doris/pull/44867) +- 修复了当查询中在不同位置包含相同的过滤谓词时,透明改写失败的问题。[#44575](https://github.com/apache/doris/pull/44575) +- 修复了当过滤谓词或连接谓词中使用列的别名时,无法透明改写的问题。[#44779](https://github.com/apache/doris/pull/44779) + +### 索引 + +- 修复倒排索引 Compaction 异常处理的问题 [#45773](https://github.com/apache/doris/pull/45773) +- 修复倒排索引构建因为等锁超时失败的问题 [#43589](https://github.com/apache/doris/pull/43589) +- 修复异常情况下倒排索引写入 Crash 的问题。[#46075](https://github.com/apache/doris/pull/46075) +- 修复 Match 函数特殊参数时空指针的问题 [#45774](https://github.com/apache/doris/pull/45774) +- 修复 VARIANT 倒排索引相关的问题,禁用 VARIANT 使用索引 v1 格式。[#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) + +- 修复 NGram Bloomfilter Index 设置 `gram_size = 65535` 时 Crash 的问题。[#43654](https://github.com/apache/doris/pull/43654) +- 修复 Bloomfilter Index 计算 DATE 和 DATETIME 不对的问题。[#43622](https://github.com/apache/doris/pull/43622) +- 修复 Drop Coloumn 没有自动 Drop Bloomfilter Index 的问题。[#44478](https://github.com/apache/doris/pull/44478) +- 减少 Bloomfilter Index 写入时的内存占用。[#46047](https://github.com/apache/doris/pull/46047) + +### 半结构化数据类型 + +- 优化内存占用,降低 VARIANT 数据类型的内存消耗。[#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- 优化 VARIANT Schema Copy 性能。[#45731](https://github.com/apache/doris/pull/45731) +- 自动推断 Tablet Key 时不将 VARIANT 作为 Key。[#44736](https://github.com/apache/doris/pull/44736) +- 修复 VARIANT 从 NOT NULL 改成 NULL 的问题。[#45734](https://github.com/apache/doris/pull/45734) +- 修复 Lambda 函数类型推断错误的问题。[#45798](https://github.com/apache/doris/pull/45798) +- 修复 `ipv6_cidr_to_range` 函数边界条件 Coredump。[#46252](https://github.com/apache/doris/pull/46252) + +### 查询优化器 + +- 修复了潜在的表读锁互斥导致的死锁问题,并优化了锁的使用逻辑[#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995) +- 修复了 SQL Cache 功能错误的使用常量折叠导致在使用包含时间格式的函数时结果不正确的问题。[#44631](https://github.com/apache/doris/pull/44631) +- 修复了比较表达式优化,在边缘情况下可能优化错误,导致结果不正确的问题。[#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- 修复高并发点查审计日志不正确的问题。[ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- 修复高并发点查遇到异常后持续报错的问题。[#44582](https://github.com/apache/doris/pull/44582) +- 修复部分字段 Prepared Statement 不正确的问题。[#45732 ](https://github.com/apache/doris/pull/45732) + +### 查询执行引擎 + +- 修复了正则表达式和 LIKE 函数在特殊字符时结果不对的问题。[#44547](https://github.com/apache/doris/pull/44547) +- 修复 SQL Cache 在切换 DB 的时候结果可能不对的问题。[#44782](https://github.com/apache/doris/pull/44782) +- 修复`cut_ipv6` 函数结果不对的问题。[#43921](https://github.com/apache/doris/pull/43921) +- 修复数值类型到 bool 类型 cast 的问题。[#46275](https://github.com/apache/doris/pull/46275) +- 修复了一系列 Arrow Flight 相关的问题。[#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- 修复了当 hashjoin 的 hash 表超过 4G 时,部分情况结果错误的问题。[#46461](https://github.com/apache/doris/pull/46461/files) +- 修复了 convert_to 函数在中文字符时溢出的问题。[#46505](https://github.com/apache/doris/pull/46405) + +### 存储管理 + +- 修复高并发 DDL 可能导致 FE 启动失败的问题。 +- 修复自增列可能出现重复值的问题。 +- 修复扩容时 Routine Load 不能使用新扩容 BE 的问题。 + +### 权限管理 + +- 修复使用 Ranger 作为鉴权插件时,频繁访问 Ranger 服务的问题[#45645](https://github.com/apache/doris/pull/45645) + +### Others + +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311]( \ No newline at end of file diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/all-release.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/all-release.md index 2cb8a1e3206..2900b6cb374 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/all-release.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/all-release.md @@ -33,13 +33,15 @@ under the License. 🎉 3.0.3 版本已于 2024 年 12 月 02 日正式发布,详情可查看[版本发布](../releasenotes/v3.0/release-3.0.3)。从 3.X 版本开始,Apache Doris 除了支持计算存储一体模式外,还支持计算存储分离模式进行集群部署。借助将计算和存储层解耦的云原生架构,用户可以在多个计算集群之间实现查询负载的物理隔离,以及读写负载的隔离。 -🎉 2.1.7 版本现已于 2024 年 10 月 15 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.7)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 +🎉 2.1.8 版本现已于 2025 年 01 月 24 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.8)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 ::: <br /> -- [2024-12-02, Apache Doris 3.0.2 版本发布](../releasenotes/v3.0/release-3.0.2.md) +- [2025-01-24, Apache Doris 2.1.8 版本发布](../releasenotes/v2.1/release-2.1.8.md) + +- [2024-12-02, Apache Doris 3.0.3 版本发布](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 版本发布](../releasenotes/v2.1/release-2.1.7.md) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..bf2205218c9 --- /dev/null +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,198 @@ +--- +{ + "title": "Release 2.1.8", + "language": "zh-CN" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +亲爱的社区小伙伴们,**Apache Doris 2.1.8 版本已于 2025 年 01 月 24 日正式发布。** 该版本持续在湖仓一体、异步物化视图、查询优化器与执行引擎、存储管理等方面进行改进提升与问题修复,进一步加强系统的性能和稳定性,欢迎大家下载体验。 + +- [立即下载](https://doris.apache.org/download) + +- [GitHub 下载](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + + +## 行为变更 + +- 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) +- 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 +- FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,打开之后无法降级 + +## 新功能 + +- **查询执行引擎:**Arrowflight 协议支持通过负载均衡设备访问 BE。 [#43281](https://github.com/apache/doris/pull/43281) +- **其他:**当前 Lambda 表达式支持捕获外部的列。 [#45186](https://github.com/apache/doris/pull/45186) + +## 改进提升 + +### 湖仓一体 + +- Hudi 版本更新至 0.15,并且优化了 Hudi 表的查询规划性能。 +- 优化了 MaxCompute 分区表的读取性能。 [#45148](https://github.com/apache/doris/pull/45148) +- 支持会话变量 enable_text_validate_utf8,可以忽略 CSV 格式中的 UTF8 编码检测。[#45537](https://github.com/apache/doris/pull/45537) +- 优化在高过滤率情况下,Parquet 文件延迟物化的性能。[#46183](https://github.com/apache/doris/pull/46183) + +### 异步物化视图 + +- 现在支持手动刷新异步物化视图中不存在的分区。[#45290](https://github.com/apache/doris/pull/45290) +- 优化了透明改写规划的性能。[#44786](https://github.com/apache/doris/pull/44786) + +### 查询优化器 + +- 提升了 Runtime Filter 的自适应能力。[#42640](https://github.com/apache/doris/pull/42640) +- 增加了在 MAX / MIN 聚合函数列上的过滤条件生成原始列过滤条件的能力。[#39252](https://github.com/apache/doris/pull/39252) +- 增加了在连接谓词上抽取单测过滤条件的能力。[#38479](https://github.com/apache/doris/pull/38479) +- 优化了谓词推导在集合算子上的能力,可以更好的生成过滤谓词。[#39450](https://github.com/apache/doris/pull/39450) +- 优化了统计信息收集和使用的异常处理能力,避免在收集异常时产生非预期的执行计划。[#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### 查询执行引擎 + +- Resource group 支持在当前 group 不可用的时候,降级到别的 Group. [#44255](https://github.com/apache/doris/pull/44255) +- 优化带 limit 的查询执行使其能够更快的结束,避免多余的数据扫描。[#45222](https://github.com/apache/doris/pull/45222) + +### 存储管理 + +- CCR 支持了更加全面的操作,比如 Rename Table,Rename Column,Modify Comment,Drop View,Drop Rollup 等。 +- 提升了 Broker Load 导入进度的准确性和多个压缩文件导入时的性能。 +- 改进了 Routine Load 超时策略、线程池使用以防止 Routine Load 超时失败和影响查询。 + +### 其他 + +- Docker 快速启动镜像支持不设置环境参数直接启动,添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 `start_be.sh` 脚本以及 BE 进程内关于 `swap`、`max_map_count`、`ulimit` 相关校验检查,仅适用于 Docker 快速启动场景中应用。[#45269](https://github.com/apache/doris/pull/45269) +- 新增 LDAP 配置型 `ldap_group_filter` 用于自定义 Group 过滤。[#43292](https://github.com/apache/doris/pull/43292) +- 优化了使用 Ranger 时的性能。[#41207](https://github.com/apache/doris/pull/41207) +- 修复审计日志中,`scan bytes` 统计不准的问题。[#45167](https://github.com/apache/doris/pull/45167) +- 在 COLUMNS 系统表中能够正确显示列的默认值。[#44849](https://github.com/apache/doris/pull/44849) +- 在 VIEWS 系统表中能够正确显示视图的定义。[#45857](https://github.com/apache/doris/pull/45857) +- 当前,admin 用户不能被删除。[#44751](https://github.com/apache/doris/pull/44751) + +## Bug 修复 + +### 湖仓一体 + +- Hive + + - 修复无法查询 Spark 创建的 Hive 视图的问题。[#43553](https://github.com/apache/doris/pull/43553) + + - 修复无法正确读取某些 Hive Transaction 表的问题。[#45753](https://github.com/apache/doris/pull/45753) + + - 修复 Hive 表分区存在特殊字符时,无法进行正确分区裁剪的问题。[#42906](https://github.com/apache/doris/pull/42906) + +- Iceberg + + - 修复在 Kerberos 认证环境下,无法创建 Iceberg 表的问题。[#43445](https://github.com/apache/doris/pull/43445) + + - 修复某些情况下,Iceberg 表存在 dangling delete 情况下,`count(*)` 查询不准确的问题。[#44039](https://github.com/apache/doris/pull/44039) + + - 修复某些情况下,Iceberg 表列名不匹配导致查询错误的问题[#44470](https://github.com/apache/doris/pull/44470) + + - 修复某些情况下,当 Iceberg 表分区被修改后,无法读取的问题[#45367](https://github.com/apache/doris/pull/45367) + +- Paimon + + - 修复 Paimon Catalog 无法访问阿里云 OSS-HDFS 的问题。[#42585](https://github.com/apache/doris/pull/42585) + +- Hudi + + - 修复某些情况下,Hudi 表分区裁剪失效的问题。[#44669](https://github.com/apache/doris/pull/44669) + +- JDBC + + - 修复某些情况下,开始表名大小写不敏感功能后,使用 JDBC Catalog 无法获取表的问题。 + +- MaxCompute + + - 修复某些情况下,MaxCompute 表分区裁剪失效的问题。[#44508](https://github.com/apache/doris/pull/44508) + +- 其他 + + - 修复某些情况下,Export 任务导致 FE 内存泄露的问题。[#44019](https://github.com/apache/doris/pull/44019) + + - 修复某些情况下,无法使用 HTTPS 协议访问 S3 对象存储的问题。[#44242](https://github.com/apache/doris/pull/44242) + + - 修复某些情况下,Kerberos 认证票据无法自动刷新的问题。[#44916](https://github.com/apache/doris/pull/44916) + + - 修复某些情况下,读取 Hadoop Block 压缩格式文件出错的问题。[#45289](https://github.com/apache/doris/pull/45289) + + - 查询 ORC 格式的数据时,不再下推 CHAR 类型的谓词,以避免可能的结果错误。[#45484](https://github.com/apache/doris/pull/45484) + +### 异步物化视图 + +- 修复了当物化视图定义中存在 CTE 时,无法刷新的问题。[#44857](https://github.com/apache/doris/pull/44857) +- 修复了当基表增加列后,异步物化视图不能命中透明改写的问题。[#44867](https://github.com/apache/doris/pull/44867) +- 修复了当查询中在不同位置包含相同的过滤谓词时,透明改写失败的问题。[#44575](https://github.com/apache/doris/pull/44575) +- 修复了当过滤谓词或连接谓词中使用列的别名时,无法透明改写的问题。[#44779](https://github.com/apache/doris/pull/44779) + +### 索引 + +- 修复倒排索引 Compaction 异常处理的问题 [#45773](https://github.com/apache/doris/pull/45773) +- 修复倒排索引构建因为等锁超时失败的问题 [#43589](https://github.com/apache/doris/pull/43589) +- 修复异常情况下倒排索引写入 Crash 的问题。[#46075](https://github.com/apache/doris/pull/46075) +- 修复 Match 函数特殊参数时空指针的问题 [#45774](https://github.com/apache/doris/pull/45774) +- 修复 VARIANT 倒排索引相关的问题,禁用 VARIANT 使用索引 v1 格式。[#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) + +- 修复 NGram Bloomfilter Index 设置 `gram_size = 65535` 时 Crash 的问题。[#43654](https://github.com/apache/doris/pull/43654) +- 修复 Bloomfilter Index 计算 DATE 和 DATETIME 不对的问题。[#43622](https://github.com/apache/doris/pull/43622) +- 修复 Drop Coloumn 没有自动 Drop Bloomfilter Index 的问题。[#44478](https://github.com/apache/doris/pull/44478) +- 减少 Bloomfilter Index 写入时的内存占用。[#46047](https://github.com/apache/doris/pull/46047) + +### 半结构化数据类型 + +- 优化内存占用,降低 VARIANT 数据类型的内存消耗。[#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- 优化 VARIANT Schema Copy 性能。[#45731](https://github.com/apache/doris/pull/45731) +- 自动推断 Tablet Key 时不将 VARIANT 作为 Key。[#44736](https://github.com/apache/doris/pull/44736) +- 修复 VARIANT 从 NOT NULL 改成 NULL 的问题。[#45734](https://github.com/apache/doris/pull/45734) +- 修复 Lambda 函数类型推断错误的问题。[#45798](https://github.com/apache/doris/pull/45798) +- 修复 `ipv6_cidr_to_range` 函数边界条件 Coredump。[#46252](https://github.com/apache/doris/pull/46252) + +### 查询优化器 + +- 修复了潜在的表读锁互斥导致的死锁问题,并优化了锁的使用逻辑[#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995) +- 修复了 SQL Cache 功能错误的使用常量折叠导致在使用包含时间格式的函数时结果不正确的问题。[#44631](https://github.com/apache/doris/pull/44631) +- 修复了比较表达式优化,在边缘情况下可能优化错误,导致结果不正确的问题。[#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- 修复高并发点查审计日志不正确的问题。[ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- 修复高并发点查遇到异常后持续报错的问题。[#44582](https://github.com/apache/doris/pull/44582) +- 修复部分字段 Prepared Statement 不正确的问题。[#45732 ](https://github.com/apache/doris/pull/45732) + +### 查询执行引擎 + +- 修复了正则表达式和 LIKE 函数在特殊字符时结果不对的问题。[#44547](https://github.com/apache/doris/pull/44547) +- 修复 SQL Cache 在切换 DB 的时候结果可能不对的问题。[#44782](https://github.com/apache/doris/pull/44782) +- 修复`cut_ipv6` 函数结果不对的问题。[#43921](https://github.com/apache/doris/pull/43921) +- 修复数值类型到 bool 类型 cast 的问题。[#46275](https://github.com/apache/doris/pull/46275) +- 修复了一系列 Arrow Flight 相关的问题。[#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- 修复了当 hashjoin 的 hash 表超过 4G 时,部分情况结果错误的问题。[#46461](https://github.com/apache/doris/pull/46461/files) +- 修复了 convert_to 函数在中文字符时溢出的问题。[#46505](https://github.com/apache/doris/pull/46405) + +### 存储管理 + +- 修复高并发 DDL 可能导致 FE 启动失败的问题。 +- 修复自增列可能出现重复值的问题。 +- 修复扩容时 Routine Load 不能使用新扩容 BE 的问题。 + +### 权限管理 + +- 修复使用 Ranger 作为鉴权插件时,频繁访问 Ranger 服务的问题[#45645](https://github.com/apache/doris/pull/45645) + +### Others + +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311]( \ No newline at end of file diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/all-release.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/all-release.md index 14e9ae2cc66..7abb5a2711f 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/all-release.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/all-release.md @@ -33,12 +33,14 @@ under the License. 🎉 3.0.3 版本已于 2024 年 12 月 02 日正式发布,详情可查看[版本发布](../releasenotes/v3.0/release-3.0.3)。从 3.X 版本开始,Apache Doris 除了支持计算存储一体模式外,还支持计算存储分离模式进行集群部署。借助将计算和存储层解耦的云原生架构,用户可以在多个计算集群之间实现查询负载的物理隔离,以及读写负载的隔离。 -🎉 2.1.7 版本现已于 2024 年 10 月 15 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.7)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 +🎉 2.1.8 版本现已于 2025 年 01 月 24 日正式发布,详情可查看[版本发布](../releasenotes/v2.1/release-2.1.8)。子查询性能方面 2.1 版本开箱即用查询的性能提高了 100%;在数据湖分析场景方面,相对于 Trino 和 Spark 分别有 4-6 倍性能提升;在半结构化数据分析场景中提供了强有力的支持,包括新的 Variant 类型和一系列分析函数。此外,2.1 版本起支持异步物化视图以加速查询,优化了大规模实时写入,并通过稳定性和运行时 SQL 资源跟踪改进了工作负载管理。 ::: <br /> +- [2025-01-24, Apache Doris 2.1.8 版本发布](../releasenotes/v2.1/release-2.1.8.md) + - [2024-12-02, Apache Doris 3.0.3 版本发布](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 版本发布](../releasenotes/v2.1/release-2.1.7) diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..bf2205218c9 --- /dev/null +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,198 @@ +--- +{ + "title": "Release 2.1.8", + "language": "zh-CN" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +亲爱的社区小伙伴们,**Apache Doris 2.1.8 版本已于 2025 年 01 月 24 日正式发布。** 该版本持续在湖仓一体、异步物化视图、查询优化器与执行引擎、存储管理等方面进行改进提升与问题修复,进一步加强系统的性能和稳定性,欢迎大家下载体验。 + +- [立即下载](https://doris.apache.org/download) + +- [GitHub 下载](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + + +## 行为变更 + +- 添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 BE 进程内关于 ulimit 值校验检查,仅适用于 Docker 快速启动场景中应用。[#45267](https://github.com/apache/doris/pull/45267) +- 添加 `enable_cooldown_replica_affinity session` 变量控制冷热分层下查询选用副本亲和性 +- FE 添加配置` restore_job_compressed_serialization` 和 `backup_job_compressed_serialization` 用于解决 db tablet 数量非常大情况下备份和恢复操作时 FE OOM 的问题,打开之后无法降级 + +## 新功能 + +- **查询执行引擎:**Arrowflight 协议支持通过负载均衡设备访问 BE。 [#43281](https://github.com/apache/doris/pull/43281) +- **其他:**当前 Lambda 表达式支持捕获外部的列。 [#45186](https://github.com/apache/doris/pull/45186) + +## 改进提升 + +### 湖仓一体 + +- Hudi 版本更新至 0.15,并且优化了 Hudi 表的查询规划性能。 +- 优化了 MaxCompute 分区表的读取性能。 [#45148](https://github.com/apache/doris/pull/45148) +- 支持会话变量 enable_text_validate_utf8,可以忽略 CSV 格式中的 UTF8 编码检测。[#45537](https://github.com/apache/doris/pull/45537) +- 优化在高过滤率情况下,Parquet 文件延迟物化的性能。[#46183](https://github.com/apache/doris/pull/46183) + +### 异步物化视图 + +- 现在支持手动刷新异步物化视图中不存在的分区。[#45290](https://github.com/apache/doris/pull/45290) +- 优化了透明改写规划的性能。[#44786](https://github.com/apache/doris/pull/44786) + +### 查询优化器 + +- 提升了 Runtime Filter 的自适应能力。[#42640](https://github.com/apache/doris/pull/42640) +- 增加了在 MAX / MIN 聚合函数列上的过滤条件生成原始列过滤条件的能力。[#39252](https://github.com/apache/doris/pull/39252) +- 增加了在连接谓词上抽取单测过滤条件的能力。[#38479](https://github.com/apache/doris/pull/38479) +- 优化了谓词推导在集合算子上的能力,可以更好的生成过滤谓词。[#39450](https://github.com/apache/doris/pull/39450) +- 优化了统计信息收集和使用的异常处理能力,避免在收集异常时产生非预期的执行计划。[#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### 查询执行引擎 + +- Resource group 支持在当前 group 不可用的时候,降级到别的 Group. [#44255](https://github.com/apache/doris/pull/44255) +- 优化带 limit 的查询执行使其能够更快的结束,避免多余的数据扫描。[#45222](https://github.com/apache/doris/pull/45222) + +### 存储管理 + +- CCR 支持了更加全面的操作,比如 Rename Table,Rename Column,Modify Comment,Drop View,Drop Rollup 等。 +- 提升了 Broker Load 导入进度的准确性和多个压缩文件导入时的性能。 +- 改进了 Routine Load 超时策略、线程池使用以防止 Routine Load 超时失败和影响查询。 + +### 其他 + +- Docker 快速启动镜像支持不设置环境参数直接启动,添加环境变量 `SKIP_CHECK_ULIMIT` 以跳过 `start_be.sh` 脚本以及 BE 进程内关于 `swap`、`max_map_count`、`ulimit` 相关校验检查,仅适用于 Docker 快速启动场景中应用。[#45269](https://github.com/apache/doris/pull/45269) +- 新增 LDAP 配置型 `ldap_group_filter` 用于自定义 Group 过滤。[#43292](https://github.com/apache/doris/pull/43292) +- 优化了使用 Ranger 时的性能。[#41207](https://github.com/apache/doris/pull/41207) +- 修复审计日志中,`scan bytes` 统计不准的问题。[#45167](https://github.com/apache/doris/pull/45167) +- 在 COLUMNS 系统表中能够正确显示列的默认值。[#44849](https://github.com/apache/doris/pull/44849) +- 在 VIEWS 系统表中能够正确显示视图的定义。[#45857](https://github.com/apache/doris/pull/45857) +- 当前,admin 用户不能被删除。[#44751](https://github.com/apache/doris/pull/44751) + +## Bug 修复 + +### 湖仓一体 + +- Hive + + - 修复无法查询 Spark 创建的 Hive 视图的问题。[#43553](https://github.com/apache/doris/pull/43553) + + - 修复无法正确读取某些 Hive Transaction 表的问题。[#45753](https://github.com/apache/doris/pull/45753) + + - 修复 Hive 表分区存在特殊字符时,无法进行正确分区裁剪的问题。[#42906](https://github.com/apache/doris/pull/42906) + +- Iceberg + + - 修复在 Kerberos 认证环境下,无法创建 Iceberg 表的问题。[#43445](https://github.com/apache/doris/pull/43445) + + - 修复某些情况下,Iceberg 表存在 dangling delete 情况下,`count(*)` 查询不准确的问题。[#44039](https://github.com/apache/doris/pull/44039) + + - 修复某些情况下,Iceberg 表列名不匹配导致查询错误的问题[#44470](https://github.com/apache/doris/pull/44470) + + - 修复某些情况下,当 Iceberg 表分区被修改后,无法读取的问题[#45367](https://github.com/apache/doris/pull/45367) + +- Paimon + + - 修复 Paimon Catalog 无法访问阿里云 OSS-HDFS 的问题。[#42585](https://github.com/apache/doris/pull/42585) + +- Hudi + + - 修复某些情况下,Hudi 表分区裁剪失效的问题。[#44669](https://github.com/apache/doris/pull/44669) + +- JDBC + + - 修复某些情况下,开始表名大小写不敏感功能后,使用 JDBC Catalog 无法获取表的问题。 + +- MaxCompute + + - 修复某些情况下,MaxCompute 表分区裁剪失效的问题。[#44508](https://github.com/apache/doris/pull/44508) + +- 其他 + + - 修复某些情况下,Export 任务导致 FE 内存泄露的问题。[#44019](https://github.com/apache/doris/pull/44019) + + - 修复某些情况下,无法使用 HTTPS 协议访问 S3 对象存储的问题。[#44242](https://github.com/apache/doris/pull/44242) + + - 修复某些情况下,Kerberos 认证票据无法自动刷新的问题。[#44916](https://github.com/apache/doris/pull/44916) + + - 修复某些情况下,读取 Hadoop Block 压缩格式文件出错的问题。[#45289](https://github.com/apache/doris/pull/45289) + + - 查询 ORC 格式的数据时,不再下推 CHAR 类型的谓词,以避免可能的结果错误。[#45484](https://github.com/apache/doris/pull/45484) + +### 异步物化视图 + +- 修复了当物化视图定义中存在 CTE 时,无法刷新的问题。[#44857](https://github.com/apache/doris/pull/44857) +- 修复了当基表增加列后,异步物化视图不能命中透明改写的问题。[#44867](https://github.com/apache/doris/pull/44867) +- 修复了当查询中在不同位置包含相同的过滤谓词时,透明改写失败的问题。[#44575](https://github.com/apache/doris/pull/44575) +- 修复了当过滤谓词或连接谓词中使用列的别名时,无法透明改写的问题。[#44779](https://github.com/apache/doris/pull/44779) + +### 索引 + +- 修复倒排索引 Compaction 异常处理的问题 [#45773](https://github.com/apache/doris/pull/45773) +- 修复倒排索引构建因为等锁超时失败的问题 [#43589](https://github.com/apache/doris/pull/43589) +- 修复异常情况下倒排索引写入 Crash 的问题。[#46075](https://github.com/apache/doris/pull/46075) +- 修复 Match 函数特殊参数时空指针的问题 [#45774](https://github.com/apache/doris/pull/45774) +- 修复 VARIANT 倒排索引相关的问题,禁用 VARIANT 使用索引 v1 格式。[#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) + +- 修复 NGram Bloomfilter Index 设置 `gram_size = 65535` 时 Crash 的问题。[#43654](https://github.com/apache/doris/pull/43654) +- 修复 Bloomfilter Index 计算 DATE 和 DATETIME 不对的问题。[#43622](https://github.com/apache/doris/pull/43622) +- 修复 Drop Coloumn 没有自动 Drop Bloomfilter Index 的问题。[#44478](https://github.com/apache/doris/pull/44478) +- 减少 Bloomfilter Index 写入时的内存占用。[#46047](https://github.com/apache/doris/pull/46047) + +### 半结构化数据类型 + +- 优化内存占用,降低 VARIANT 数据类型的内存消耗。[#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- 优化 VARIANT Schema Copy 性能。[#45731](https://github.com/apache/doris/pull/45731) +- 自动推断 Tablet Key 时不将 VARIANT 作为 Key。[#44736](https://github.com/apache/doris/pull/44736) +- 修复 VARIANT 从 NOT NULL 改成 NULL 的问题。[#45734](https://github.com/apache/doris/pull/45734) +- 修复 Lambda 函数类型推断错误的问题。[#45798](https://github.com/apache/doris/pull/45798) +- 修复 `ipv6_cidr_to_range` 函数边界条件 Coredump。[#46252](https://github.com/apache/doris/pull/46252) + +### 查询优化器 + +- 修复了潜在的表读锁互斥导致的死锁问题,并优化了锁的使用逻辑[#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995) +- 修复了 SQL Cache 功能错误的使用常量折叠导致在使用包含时间格式的函数时结果不正确的问题。[#44631](https://github.com/apache/doris/pull/44631) +- 修复了比较表达式优化,在边缘情况下可能优化错误,导致结果不正确的问题。[#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- 修复高并发点查审计日志不正确的问题。[ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- 修复高并发点查遇到异常后持续报错的问题。[#44582](https://github.com/apache/doris/pull/44582) +- 修复部分字段 Prepared Statement 不正确的问题。[#45732 ](https://github.com/apache/doris/pull/45732) + +### 查询执行引擎 + +- 修复了正则表达式和 LIKE 函数在特殊字符时结果不对的问题。[#44547](https://github.com/apache/doris/pull/44547) +- 修复 SQL Cache 在切换 DB 的时候结果可能不对的问题。[#44782](https://github.com/apache/doris/pull/44782) +- 修复`cut_ipv6` 函数结果不对的问题。[#43921](https://github.com/apache/doris/pull/43921) +- 修复数值类型到 bool 类型 cast 的问题。[#46275](https://github.com/apache/doris/pull/46275) +- 修复了一系列 Arrow Flight 相关的问题。[#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- 修复了当 hashjoin 的 hash 表超过 4G 时,部分情况结果错误的问题。[#46461](https://github.com/apache/doris/pull/46461/files) +- 修复了 convert_to 函数在中文字符时溢出的问题。[#46505](https://github.com/apache/doris/pull/46405) + +### 存储管理 + +- 修复高并发 DDL 可能导致 FE 启动失败的问题。 +- 修复自增列可能出现重复值的问题。 +- 修复扩容时 Routine Load 不能使用新扩容 BE 的问题。 + +### 权限管理 + +- 修复使用 Ranger 作为鉴权插件时,频繁访问 Ranger 服务的问题[#45645](https://github.com/apache/doris/pull/45645) + +### Others + +- 修复 BE 端开启 `enable_jvm_monitor=true` 后可能导致的内存泄露问题。[#44311]( \ No newline at end of file diff --git a/sidebars.json b/sidebars.json index db7ef5093b8..93e026b4d04 100644 --- a/sidebars.json +++ b/sidebars.json @@ -2049,6 +2049,7 @@ "type": "category", "label": "v2.1", "items": [ + "releasenotes/v2.1/release-2.1.8", "releasenotes/v2.1/release-2.1.7", "releasenotes/v2.1/release-2.1.6", "releasenotes/v2.1/release-2.1.5", diff --git a/src/components/recent-blogs/recent-blogs.data.ts b/src/components/recent-blogs/recent-blogs.data.ts index bcb704cf973..2ab8d052473 100644 --- a/src/components/recent-blogs/recent-blogs.data.ts +++ b/src/components/recent-blogs/recent-blogs.data.ts @@ -1,7 +1,7 @@ export const RECENT_BLOGS_POSTS = [ { - label: `Apache Doris 2.1.7 just released`, - link: 'https://doris.apache.org/blog/release-note-2.1.7', + label: `Apache Doris 2.1.8 just released`, + link: 'https://doris.apache.org/blog/release-note-2.1.8', }, { label: 'Automatic and flexible data sharding: Auto Partition in Apache Doris', diff --git a/src/constant/download.data.ts b/src/constant/download.data.ts index 957bac81628..d320279a60f 100644 --- a/src/constant/download.data.ts +++ b/src/constant/download.data.ts @@ -31,7 +31,7 @@ export enum ToolsEnum { export const ORIGIN = 'https://apache-doris-releases.oss-accelerate.aliyuncs.com/'; export enum VersionEnum { Latest = '3.0.3', - Prev = '2.1.7', + Prev = '2.1.8', Earlier = '2.0.15', } export enum DownloadTypeEnum { @@ -74,36 +74,36 @@ export const DORIS_VERSIONS: Option[] = [ ], }, { - label: '2.1.7', - value: '2.1.7', + label: '2.1.8', + value: '2.1.8', majorVersion: '2.1', children: [ { label: CPUEnum.X64, value: CPUEnum.X64, - gz: `${ORIGIN}apache-doris-2.1.7-bin-x64.tar.gz`, - asc: `${ORIGIN}apache-doris-2.1.7-bin-x64.tar.gz.asc`, - sha512: `${ORIGIN}apache-doris-2.1.7-bin-x64.tar.gz.sha512`, - source: 'https://downloads.apache.org/doris/2.1/2.1.7/', - version: '2.1.7-rc03', + gz: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', }, { label: CPUEnum.X64NoAvx2, value: CPUEnum.X64NoAvx2, - gz: `${ORIGIN}apache-doris-2.1.7-bin-x64-noavx2.tar.gz`, - asc: `${ORIGIN}apache-doris-2.1.7-bin-x64-noavx2.tar.gz.asc`, - sha512: `${ORIGIN}apache-doris-2.1.7-bin-x64-noavx2.tar.gz.sha512`, - source: 'https://downloads.apache.org/doris/2.1/2.1.7/', - version: '2.1.7-rc03', + gz: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', }, { label: CPUEnum.ARM64, value: CPUEnum.ARM64, - gz: `${ORIGIN}apache-doris-2.1.7-bin-arm64.tar.gz`, - asc: `${ORIGIN}apache-doris-2.1.7-bin-arm64.tar.gz.asc`, - sha512: `${ORIGIN}apache-doris-2.1.7-bin-arm64.tar.gz.sha512`, - source: 'https://downloads.apache.org/doris/2.1/2.1.7/', - version: '2.1.7-rc03', + gz: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', }, ], }, @@ -292,6 +292,40 @@ export const ALL_VERSIONS: AllVersionOption[] = [ label: '2.1', value: '2.1', children: [ + { + label: '2.1.8', + value: '2.1.8', + majorVersion: '2.1', + items: [ + { + label: CPUEnum.X64, + value: CPUEnum.X64, + gz: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-x64.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', + }, + { + label: CPUEnum.X64NoAvx2, + value: CPUEnum.X64NoAvx2, + gz: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-x64-noavx2.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', + }, + { + label: CPUEnum.ARM64, + value: CPUEnum.ARM64, + gz: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz`, + asc: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz.asc`, + sha512: `${ORIGIN}apache-doris-2.1.8-bin-arm64.tar.gz.sha512`, + source: 'https://downloads.apache.org/doris/2.1/2.1.8/', + version: '2.1.8-rc01', + }, + ], + }, { label: '2.1.7', value: '2.1.7', @@ -1923,7 +1957,7 @@ export const RUN_ANYWHERE = [ { title: 'Doris on Kubernetes', description: 'Create, configure and manage Doris clusters on Kubernetes', - link: 'https://doris.apache.org/docs/install/cluster-deployment/k8s-deploy/install-env', + link: 'https://doris.apache.org/docs/install/cluster-deployment/k8s-deploy/install-doris-operator', }, { title: 'Doris on AWS', diff --git a/src/constant/newsletter.data.ts b/src/constant/newsletter.data.ts index c274506093f..325d8abe5e3 100644 --- a/src/constant/newsletter.data.ts +++ b/src/constant/newsletter.data.ts @@ -1,10 +1,9 @@ export const NEWSLETTER_DATA = [ { tags: ['Release Note'], - title: "Apache Doris 3.0.3 just released", - content: `Dear community members, the Apache Doris 3.0.3 version was officially released on December 02, 2024, this version further enhances the performance and stability of the system.`, - to: '/blog/release-note-3.0.3', - image: '3.0.3.jpg', + title: "Apache Doris 2.1.8 just released", + content: `This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more.`, + image: '2.1.8.jpg', }, { tags: ['Best Practice'], diff --git a/src/pages/ecosystem/cluster-management/index.tsx b/src/pages/ecosystem/cluster-management/index.tsx index 6320ec3d871..b60d3646cee 100644 --- a/src/pages/ecosystem/cluster-management/index.tsx +++ b/src/pages/ecosystem/cluster-management/index.tsx @@ -1,4 +1,4 @@ -import React,{useState} from 'react'; +import React, { useState } from 'react'; import Link from '@docusaurus/Link'; import EcomsystemLayout from '@site/src/components/ecomsystem/ecomsystem-layout/ecomsystem-layout'; import ExternalLink from '@site/src/components/external-link/external-link'; @@ -7,7 +7,7 @@ import '../index.scss'; import { ExternalLinkArrowIcon } from '@site/src/components/Icons/external-link-arrow-icon'; export default function ClusterManagement() { - const [flag,setFlag] = useState(true) + const [flag, setFlag] = useState(true) return ( <EcomsystemLayout> <div className="container mx-auto flex flex-col flex-wrap items-center justify-center mb-[5.5rem] lg:flex-row"> @@ -55,9 +55,9 @@ export default function ClusterManagement() { } moreLink={ <> - <ExternalLink href="https://www.velodb.io/download/tools" label="Download"></ExternalLink> + <ExternalLink href="https://github.com/apache/doris-operator" label="GitHub"></ExternalLink> <ExternalLink - href="https://doris.apache.org/docs/install/cluster-deployment/k8s-deploy/install-env" + href="https://doris.apache.org/docs/install/cluster-deployment/k8s-deploy/install-doris-operator" className="sub-btn" label="Docs" ></ExternalLink> diff --git a/static/images/2.1.8.jpg b/static/images/2.1.8.jpg new file mode 100644 index 00000000000..2f6825ec35e Binary files /dev/null and b/static/images/2.1.8.jpg differ diff --git a/versioned_docs/version-2.1/releasenotes/all-release.md b/versioned_docs/version-2.1/releasenotes/all-release.md index 392e8e1a956..0f5212e98f9 100644 --- a/versioned_docs/version-2.1/releasenotes/all-release.md +++ b/versioned_docs/version-2.1/releasenotes/all-release.md @@ -32,13 +32,15 @@ This document presents a summary of Apache Doris versions released within one ye <br /> -🎉 Version 2.1.7 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.6) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] +🎉 Version 2.1.8 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.8) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] ::: <br /> +- [2025-01-24, Apache Doris 2.1.8 is released](../releasenotes/v2.1/release-2.1.8.md) + - [2024-12-02, Apache Doris 3.0.3 is released](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 is released](../releasenotes/v2.1/release-2.1.7.md) diff --git a/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md b/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..0daf1385d41 --- /dev/null +++ b/versioned_docs/version-2.1/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,186 @@ +--- +{ + "title": "Release 2.1.8", + "language": "en" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +Dear Community, **Apache Doris version 2.1.8 was officially released on January 24, 2025.** This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more. + +- [Quick Download](https://doris.apache.org/download) + +- [GitHub Release](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + +## Behavior Changes + +- Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) +- Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. +- In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. Downgrading is not possible after enabling these configurations. + +## New Features + +- The Arrow flight protocol supports accessing BE through a load - balancing device. [#43281](https://github.com/apache/doris/pull/43281) +- Now lambda expressions support capturing external columns (#45186).[#45186](https://github.com/apache/doris/pull/45186) + +## Improvements + +### Lakehouse + +- Update the Hudi version to 0.15. And optimize the query planning performance of Hudi tables. +- Optimize the read performance of MaxCompute partitioned tables. [#45148](https://github.com/apache/doris/pull/45148) +- Support the session variable `enable_text_validate_utf8`, which can ignore the UTF8 encoding detection in CSV format. [#45537](https://github.com/apache/doris/pull/45537) +- Optimize the performance of Parquet file lazy materialization under high - filtering - rate conditions. [#46183](https://github.com/apache/doris/pull/46183) + +### Asynchronous Materialized Views + +- Now it supports manually refreshing partitions that do not exist in an asynchronous materialized view [#45290](https://github.com/apache/doris/pull/45290). +- Optimize the performance of transparent rewrite planning [#44786](https://github.com/apache/doris/pull/44786). + +### Query Optimizer + +- Improve the adaptive ability of runtime filters [#42640](https://github.com/apache/doris/pull/42640). +- Add the ability to generate original column filter conditions from filter conditions on `max/min` aggregate function columns [#39252](https://github.com/apache/doris/pull/39252) +- Add the ability to extract single - side filter conditions from join predicates [#38479](https://github.com/apache/doris/pull/38479). +- Optimize the ability of predicate derivation on set operators to better generate filter predicates [#39450](https://github.com/apache/doris/pull/39450). +- Optimize the exception handling ability of statistic information collection and usage to avoid generating unexpected execution plans when collection exceptions occur. [#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### Query Execution Engine + +- Optimize the execution of queries with `limit` to end faster and avoid unnecessary data scanning [#44255](https://github.com/apache/doris/pull/44255). + +### Storage Management + +- CCR supports more comprehensive operations, such as `rename table`, `rename column`, `modify comment`, `drop view`, `drop rollup`, etc. +- Improve the accuracy of the broker load import progress and the performance when importing multiple compressed files. +- Improve the routine load timeout strategy and thread - pool usage to prevent routine load timeout failures and impacts on queries. + +### Others + +- The Docker quick - start image supports starting without setting environment parameters. Add the environment variable `SKIP_CHECK_ULIMIT` to skip the `start_be.sh` script and the swap, `max_map_count`, ulimit - related verification checks within the BE process. This is only applicable to applications in the Docker quick - start scenario. [#45269](https://github.com/apache/doris/pull/45269) +- Add the new LDAP configuration `ldap_group_filter` for custom group filtering. [#43292](https://github.com/apache/doris/pull/43292) +- Optimize performance when using ranger. [#41207](https://github.com/apache/doris/pull/41207) +- Fix the inaccurate statistics of `scan bytes` in the audit log. [#45167](https://github.com/apache/doris/pull/45167) +- Now, the default values of columns can be correctly displayed in the `COLUMNS` system table. [#44849](https://github.com/apache/doris/pull/44849) +- Now, the definition of views can be correctly displayed in the `VIEWS` system table. [#45857](https://github.com/apache/doris/pull/45857) +- Now, the `admin` user cannot be deleted. [#44751](https://github.com/apache/doris/pull/44751) + +## Bug Fixes + +### Lakehouse + +#### Hive + +- Fix the problem of being unable to query Hive views created by Spark. [#43553](https://github.com/apache/doris/pull/43553) +- Fix the problem of being unable to correctly read some Hive Transaction tables. [#45753](https://github.com/apache/doris/pull/45753) +- Fix the problem of incorrect partition pruning when Hive table partitions contain special characters. [#42906](https://github.com/apache/doris/pull/42906) + +#### Iceberg + +- Fix the problem of being unable to create Iceberg tables in a Kerberos - authenticated environment. [#43445](https://github.com/apache/doris/pull/43445) +- Fix the problem of inaccurate `count(*)` queries when there are dangling deletes in Iceberg tables in some cases. [#44039](https://github.com/apache/doris/pull/44039) +- Fix the problem of query errors due to column name mismatches in Iceberg tables in some cases . [#44470](https://github.com/apache/doris/pull/44470) +- Fix the problem of being unable to read Iceberg tables when their partitions are modified in some cases .[#45367](https://github.com/apache/doris/pull/45367) + +#### Paimon + +- Fix the problem that the Paimon Catalog cannot access Alibaba Cloud OSS - HDFS. [#42585](https://github.com/apache/doris/pull/42585) + +#### Hudi + +- Fix the problem of ineffective partition pruning in Hudi tables in some cases. [#44669](https://github.com/apache/doris/pull/44669) + +#### JDBC + +- Fix the problem of being unable to obtain tables using the JDBC Catalog after enabling the case insensitive table name feature in some cases. + +#### MaxCompute + +- Fix the problem of ineffective partition pruning in MaxCompute tables in some cases[#44508](https://github.com/apache/doris/pull/44508). + +#### Others + +- Fix the problem of FE memory leaks caused by EXPORT tasks in some cases.[#44019](https://github.com/apache/doris/pull/44019) +- Fix the problem of being unable to access S3 object storage using the https protocol in some cases [#44242](https://github.com/apache/doris/pull/44242). +- Fix the problem of the inability to automatically refresh Kerberos authentication tickets in some cases [#44916](https://github.com/apache/doris/pull/44916) +- Fix the problem of errors when reading Hadoop Block compressed format files in some cases. [#45289](https://github.com/apache/doris/pull/45289) +- When querying ORC - formatted data, no longer push down CHAR - type predicates to avoid possible result errors. [#45484](https://github.com/apache/doris/pull/45484) + +### Asynchronous Materialized Views + +- Fix the problem that when there is a CTE in the materialized view definition, it cannot be refreshed [#44857](https://github.com/apache/doris/pull/44857). +- Fix the problem that when columns are added to the base table, the asynchronous materialized view cannot hit the transparent rewrite. [#44867](https://github.com/apache/doris/pull/44867) +- Fix the problem that when the same filter predicate is included in different positions in a query, the transparent rewrite fails. [#44575](https://github.com/apache/doris/pull/44575) +- Fix the problem that when column aliases are used in filter predicates or join predicates, the transparent rewrite cannot be performed. [#44779](https://github.com/apache/doris/pull/44779) + +### Inverted Index + +- Fix the problem of abnormal handling of inverted index compaction. [#45773](https://github.com/apache/doris/pull/45773) +- Fix the problem that inverted index construction fails due to lock - waiting timeout. [#43589](https://github.com/apache/doris/pull/43589) +- Fix the problem of inverted index write crashes in abnormal situations. [#46075](https://github.com/apache/doris/pull/46075) +- Fix the null - pointer problem of the `match` function with special parameters. [#45774](https://github.com/apache/doris/pull/45774) +- Fix problems related to the variant inverted index and disable the use of the index v1 format for variants [#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) +- Fix the problem of crashes when setting `gram_size = 65535` for the ngram bloomfilter index [#43654](https://github.com/apache/doris/pull/43654) +- Fix the problem of incorrect calculation of DATE and DATETIME for the bloomfilter index [#43622](https://github.com/apache/doris/pull/43622) +- Fix the problem that dropping a column does not automatically drop the bloomfilter index [#44478](https://github.com/apache/doris/pull/44478) +- Reduce the memory footprint when writing the bloomfilter index [#46047](https://github.com/apache/doris/pull/46047) + +### Semi-Structure Data + +- Optimize memory usage and reduce the memory consumption of the `variant` data type [#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- Optimize the performance of `variant` schema copy. [#45731](https://github.com/apache/doris/pull/45731) +- Do not use `variant` as a key when automatically inferring tablet keys. [#44736](https://github.com/apache/doris/pull/44736) +- Fix the problem of changing `variant` from `NOT NULL` to `NULL` [#45734](https://github.com/apache/doris/pull/45734) +- Fix the problem of incorrect type inference of lambda functions. [#45798](https://github.com/apache/doris/pull/45798) +- Fix the coredump problem at the boundary conditions of the `ipv6_cidr_to_range` function [#46252](https://github.com/apache/doris/pull/46252) + +### Query Optimizer + +- Fix the potential deadlock problem caused by mutual exclusion of table read locks and optimize the lock - using logic [#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995). +- Fix the problem that the SQL Cache function incorrectly uses constant folding, resulting in incorrect results when using functions containing time formats . [#44631](https://github.com/apache/doris/pull/44631) +- Fix the problem of incorrect optimization of comparison expressions in edge cases, which may lead to incorrect results. [#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- Fix the problem of incorrect audit logs for high - concurrent point queries [ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- Fix the problem of continuous error reporting after an exception occurs in high - concurrent point queries [#44582](https://github.com/apache/doris/pull/44582) +- Fix the problem of incorrectly prepared statements for some fields.[#45732 ](https://github.com/apache/doris/pull/45732) + +### Query Execution Engine + +- Fix the problem of incorrect results of regular expressions and `like` functions for special characters. [#44547](https://github.com/apache/doris/pull/44547) +- Fix the problem that the SQL Cache may have incorrect results when switching databases. [#44782](https://github.com/apache/doris/pull/44782) +- Fix the problem of incorrect results of the `cut_ipv6` function. [#43921](https://github.com/apache/doris/pull/43921) +- Fix the problem of casting from numeric types to bool types. [#46275](https://github.com/apache/doris/pull/46275) +- Fix a series of problems related to arrow flight. [#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- Fix the problem of incorrect results in some cases when the hash table of hash join exceeds 4G. [#46461](https://github.com/apache/doris/pull/46461/files) +- Fix the overflow problem of the `convert_to` function for Chinese characters. [#46505](https://github.com/apache/doris/pull/46405) + +### Storage Management + +- Fix the problem that high - concurrent DDL may cause FE startup failure. +- Fix the problem that auto - increment columns may have duplicate values. +- Fix the problem that routine load cannot use the newly expanded BE during expansion. + +### Permission Management + +- Fix the problem of frequent access to the Ranger service when using Ranger as the authentication plugin [#45645](https://github.com/apache/doris/pull/45645). + +### Others + +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file diff --git a/versioned_docs/version-3.0/releasenotes/all-release.md b/versioned_docs/version-3.0/releasenotes/all-release.md index 392e8e1a956..0f5212e98f9 100644 --- a/versioned_docs/version-3.0/releasenotes/all-release.md +++ b/versioned_docs/version-3.0/releasenotes/all-release.md @@ -32,13 +32,15 @@ This document presents a summary of Apache Doris versions released within one ye <br /> -🎉 Version 2.1.7 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.6) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] +🎉 Version 2.1.8 released now. Check out the 🔗[Release Notes](../releasenotes/v2.1/release-2.1.8) here. The 2.1 version delivers exceptional performance with 100% higher out-of-the-box queries proven by TPC-DS 1TB tests, enhanced data lake analytics that are 4-6 times speedier than Trino and Spark, solid support for semi-structured data analysis with new Variant types and suite of analytical functions, asynchronous materialized views for query acceleration, optimized real-time writing at [...] ::: <br /> +- [2025-01-24, Apache Doris 2.1.8 is released](../releasenotes/v2.1/release-2.1.8.md) + - [2024-12-02, Apache Doris 3.0.3 is released](../releasenotes/v3.0/release-3.0.3.md) - [2024-11-10, Apache Doris 2.1.7 is released](../releasenotes/v2.1/release-2.1.7.md) diff --git a/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md b/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md new file mode 100644 index 00000000000..0daf1385d41 --- /dev/null +++ b/versioned_docs/version-3.0/releasenotes/v2.1/release-2.1.8.md @@ -0,0 +1,186 @@ +--- +{ + "title": "Release 2.1.8", + "language": "en" +} +--- + +<!-- +Licensed to the Apache Software Foundation (ASF) under one +or more contributor license agreements. See the NOTICE file +distributed with this work for additional information +regarding copyright ownership. The ASF licenses this file +to you under the Apache License, Version 2.0 (the +"License"); you may not use this file except in compliance +with the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + +Unless required by applicable law or agreed to in writing, +software distributed under the License is distributed on an +"AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +KIND, either express or implied. See the License for the +specific language governing permissions and limitations +under the License. +--> + +Dear Community, **Apache Doris version 2.1.8 was officially released on January 24, 2025.** This version introduces continuous upgrades and enhancements in several key areas, including Lakehouse, Asynchronous Materialized Views, Query Optimizer and Execution Engine, Storage Management, and more. + +- [Quick Download](https://doris.apache.org/download) + +- [GitHub Release](https://github.com/apache/doris/releases/tag/2.1.8-rc01) + +## Behavior Changes + +- Add the environment variable `SKIP_CHECK_ULIMIT` to skip the ulimit value verification check within the BE process. This is only available to applications in the Docker quick start scenario. [#45267](https://github.com/apache/doris/pull/45267) +- Add the `enable_cooldown_replica_affinity` session variable to control the selection of replica affinity for queries under cold - hot separation. +- In FE, add the configurations `restore_job_compressed_serialization` and `backup_job_compressed_serialization` to solve the OOM problem of FE during backup and restore operations when the number of db tablets is extremely large. Downgrading is not possible after enabling these configurations. + +## New Features + +- The Arrow flight protocol supports accessing BE through a load - balancing device. [#43281](https://github.com/apache/doris/pull/43281) +- Now lambda expressions support capturing external columns (#45186).[#45186](https://github.com/apache/doris/pull/45186) + +## Improvements + +### Lakehouse + +- Update the Hudi version to 0.15. And optimize the query planning performance of Hudi tables. +- Optimize the read performance of MaxCompute partitioned tables. [#45148](https://github.com/apache/doris/pull/45148) +- Support the session variable `enable_text_validate_utf8`, which can ignore the UTF8 encoding detection in CSV format. [#45537](https://github.com/apache/doris/pull/45537) +- Optimize the performance of Parquet file lazy materialization under high - filtering - rate conditions. [#46183](https://github.com/apache/doris/pull/46183) + +### Asynchronous Materialized Views + +- Now it supports manually refreshing partitions that do not exist in an asynchronous materialized view [#45290](https://github.com/apache/doris/pull/45290). +- Optimize the performance of transparent rewrite planning [#44786](https://github.com/apache/doris/pull/44786). + +### Query Optimizer + +- Improve the adaptive ability of runtime filters [#42640](https://github.com/apache/doris/pull/42640). +- Add the ability to generate original column filter conditions from filter conditions on `max/min` aggregate function columns [#39252](https://github.com/apache/doris/pull/39252) +- Add the ability to extract single - side filter conditions from join predicates [#38479](https://github.com/apache/doris/pull/38479). +- Optimize the ability of predicate derivation on set operators to better generate filter predicates [#39450](https://github.com/apache/doris/pull/39450). +- Optimize the exception handling ability of statistic information collection and usage to avoid generating unexpected execution plans when collection exceptions occur. [#43009](https://github.com/apache/doris/pull/43009) [#43776](https://github.com/apache/doris/pull/43776) [#43865](https://github.com/apache/doris/pull/43865) [#42104](https://github.com/apache/doris/pull/42104) [#42399](https://github.com/apache/doris/pull/42399) [#41729](https://github.com/apache/doris/pull/41729) + +### Query Execution Engine + +- Optimize the execution of queries with `limit` to end faster and avoid unnecessary data scanning [#44255](https://github.com/apache/doris/pull/44255). + +### Storage Management + +- CCR supports more comprehensive operations, such as `rename table`, `rename column`, `modify comment`, `drop view`, `drop rollup`, etc. +- Improve the accuracy of the broker load import progress and the performance when importing multiple compressed files. +- Improve the routine load timeout strategy and thread - pool usage to prevent routine load timeout failures and impacts on queries. + +### Others + +- The Docker quick - start image supports starting without setting environment parameters. Add the environment variable `SKIP_CHECK_ULIMIT` to skip the `start_be.sh` script and the swap, `max_map_count`, ulimit - related verification checks within the BE process. This is only applicable to applications in the Docker quick - start scenario. [#45269](https://github.com/apache/doris/pull/45269) +- Add the new LDAP configuration `ldap_group_filter` for custom group filtering. [#43292](https://github.com/apache/doris/pull/43292) +- Optimize performance when using ranger. [#41207](https://github.com/apache/doris/pull/41207) +- Fix the inaccurate statistics of `scan bytes` in the audit log. [#45167](https://github.com/apache/doris/pull/45167) +- Now, the default values of columns can be correctly displayed in the `COLUMNS` system table. [#44849](https://github.com/apache/doris/pull/44849) +- Now, the definition of views can be correctly displayed in the `VIEWS` system table. [#45857](https://github.com/apache/doris/pull/45857) +- Now, the `admin` user cannot be deleted. [#44751](https://github.com/apache/doris/pull/44751) + +## Bug Fixes + +### Lakehouse + +#### Hive + +- Fix the problem of being unable to query Hive views created by Spark. [#43553](https://github.com/apache/doris/pull/43553) +- Fix the problem of being unable to correctly read some Hive Transaction tables. [#45753](https://github.com/apache/doris/pull/45753) +- Fix the problem of incorrect partition pruning when Hive table partitions contain special characters. [#42906](https://github.com/apache/doris/pull/42906) + +#### Iceberg + +- Fix the problem of being unable to create Iceberg tables in a Kerberos - authenticated environment. [#43445](https://github.com/apache/doris/pull/43445) +- Fix the problem of inaccurate `count(*)` queries when there are dangling deletes in Iceberg tables in some cases. [#44039](https://github.com/apache/doris/pull/44039) +- Fix the problem of query errors due to column name mismatches in Iceberg tables in some cases . [#44470](https://github.com/apache/doris/pull/44470) +- Fix the problem of being unable to read Iceberg tables when their partitions are modified in some cases .[#45367](https://github.com/apache/doris/pull/45367) + +#### Paimon + +- Fix the problem that the Paimon Catalog cannot access Alibaba Cloud OSS - HDFS. [#42585](https://github.com/apache/doris/pull/42585) + +#### Hudi + +- Fix the problem of ineffective partition pruning in Hudi tables in some cases. [#44669](https://github.com/apache/doris/pull/44669) + +#### JDBC + +- Fix the problem of being unable to obtain tables using the JDBC Catalog after enabling the case insensitive table name feature in some cases. + +#### MaxCompute + +- Fix the problem of ineffective partition pruning in MaxCompute tables in some cases[#44508](https://github.com/apache/doris/pull/44508). + +#### Others + +- Fix the problem of FE memory leaks caused by EXPORT tasks in some cases.[#44019](https://github.com/apache/doris/pull/44019) +- Fix the problem of being unable to access S3 object storage using the https protocol in some cases [#44242](https://github.com/apache/doris/pull/44242). +- Fix the problem of the inability to automatically refresh Kerberos authentication tickets in some cases [#44916](https://github.com/apache/doris/pull/44916) +- Fix the problem of errors when reading Hadoop Block compressed format files in some cases. [#45289](https://github.com/apache/doris/pull/45289) +- When querying ORC - formatted data, no longer push down CHAR - type predicates to avoid possible result errors. [#45484](https://github.com/apache/doris/pull/45484) + +### Asynchronous Materialized Views + +- Fix the problem that when there is a CTE in the materialized view definition, it cannot be refreshed [#44857](https://github.com/apache/doris/pull/44857). +- Fix the problem that when columns are added to the base table, the asynchronous materialized view cannot hit the transparent rewrite. [#44867](https://github.com/apache/doris/pull/44867) +- Fix the problem that when the same filter predicate is included in different positions in a query, the transparent rewrite fails. [#44575](https://github.com/apache/doris/pull/44575) +- Fix the problem that when column aliases are used in filter predicates or join predicates, the transparent rewrite cannot be performed. [#44779](https://github.com/apache/doris/pull/44779) + +### Inverted Index + +- Fix the problem of abnormal handling of inverted index compaction. [#45773](https://github.com/apache/doris/pull/45773) +- Fix the problem that inverted index construction fails due to lock - waiting timeout. [#43589](https://github.com/apache/doris/pull/43589) +- Fix the problem of inverted index write crashes in abnormal situations. [#46075](https://github.com/apache/doris/pull/46075) +- Fix the null - pointer problem of the `match` function with special parameters. [#45774](https://github.com/apache/doris/pull/45774) +- Fix problems related to the variant inverted index and disable the use of the index v1 format for variants [#43971](https://github.com/apache/doris/pull/43971) [#45179](https://github.com/apache/doris/pull/45179/) +- Fix the problem of crashes when setting `gram_size = 65535` for the ngram bloomfilter index [#43654](https://github.com/apache/doris/pull/43654) +- Fix the problem of incorrect calculation of DATE and DATETIME for the bloomfilter index [#43622](https://github.com/apache/doris/pull/43622) +- Fix the problem that dropping a column does not automatically drop the bloomfilter index [#44478](https://github.com/apache/doris/pull/44478) +- Reduce the memory footprint when writing the bloomfilter index [#46047](https://github.com/apache/doris/pull/46047) + +### Semi-Structure Data + +- Optimize memory usage and reduce the memory consumption of the `variant` data type [#43349](https://github.com/apache/doris/pull/43349) [#44585](https://github.com/apache/doris/pull/44585) [#45734](https://github.com/apache/doris/pull/45734) +- Optimize the performance of `variant` schema copy. [#45731](https://github.com/apache/doris/pull/45731) +- Do not use `variant` as a key when automatically inferring tablet keys. [#44736](https://github.com/apache/doris/pull/44736) +- Fix the problem of changing `variant` from `NOT NULL` to `NULL` [#45734](https://github.com/apache/doris/pull/45734) +- Fix the problem of incorrect type inference of lambda functions. [#45798](https://github.com/apache/doris/pull/45798) +- Fix the coredump problem at the boundary conditions of the `ipv6_cidr_to_range` function [#46252](https://github.com/apache/doris/pull/46252) + +### Query Optimizer + +- Fix the potential deadlock problem caused by mutual exclusion of table read locks and optimize the lock - using logic [#45045](https://github.com/apache/doris/pull/45045) [#43376](https://github.com/apache/doris/pull/43376) [#44164](https://github.com/apache/doris/pull/44164) [#44967](https://github.com/apache/doris/pull/44967) [#45995](https://github.com/apache/doris/pull/45995). +- Fix the problem that the SQL Cache function incorrectly uses constant folding, resulting in incorrect results when using functions containing time formats . [#44631](https://github.com/apache/doris/pull/44631) +- Fix the problem of incorrect optimization of comparison expressions in edge cases, which may lead to incorrect results. [#44054](https://github.com/apache/doris/pull/44054) [#44725](https://github.com/apache/doris/pull/44725) [#44922](https://github.com/apache/doris/pull/44922) [#45735](https://github.com/apache/doris/pull/45735) [#45868](https://github.com/apache/doris/pull/45868) +- Fix the problem of incorrect audit logs for high - concurrent point queries [ #43345 ](https://github.com/apache/doris/pull/43345)[#44588](https://github.com/apache/doris/pull/44588) +- Fix the problem of continuous error reporting after an exception occurs in high - concurrent point queries [#44582](https://github.com/apache/doris/pull/44582) +- Fix the problem of incorrectly prepared statements for some fields.[#45732 ](https://github.com/apache/doris/pull/45732) + +### Query Execution Engine + +- Fix the problem of incorrect results of regular expressions and `like` functions for special characters. [#44547](https://github.com/apache/doris/pull/44547) +- Fix the problem that the SQL Cache may have incorrect results when switching databases. [#44782](https://github.com/apache/doris/pull/44782) +- Fix the problem of incorrect results of the `cut_ipv6` function. [#43921](https://github.com/apache/doris/pull/43921) +- Fix the problem of casting from numeric types to bool types. [#46275](https://github.com/apache/doris/pull/46275) +- Fix a series of problems related to arrow flight. [#45661](https://github.com/apache/doris/pull/45661) [#45023](https://github.com/apache/doris/pull/45023) [#43960](https://github.com/apache/doris/pull/43960) [#43929](https://github.com/apache/doris/pull/43929) +- Fix the problem of incorrect results in some cases when the hash table of hash join exceeds 4G. [#46461](https://github.com/apache/doris/pull/46461/files) +- Fix the overflow problem of the `convert_to` function for Chinese characters. [#46505](https://github.com/apache/doris/pull/46405) + +### Storage Management + +- Fix the problem that high - concurrent DDL may cause FE startup failure. +- Fix the problem that auto - increment columns may have duplicate values. +- Fix the problem that routine load cannot use the newly expanded BE during expansion. + +### Permission Management + +- Fix the problem of frequent access to the Ranger service when using Ranger as the authentication plugin [#45645](https://github.com/apache/doris/pull/45645). + +### Others + +- Fix the potential memory leak problem when `enable_jvm_monitor=true` is enabled on the BE side [#44311](https://github.com/apache/doris/pull/44311). \ No newline at end of file diff --git a/versioned_sidebars/version-2.1-sidebars.json b/versioned_sidebars/version-2.1-sidebars.json index d777db97fd0..b5c11de9393 100644 --- a/versioned_sidebars/version-2.1-sidebars.json +++ b/versioned_sidebars/version-2.1-sidebars.json @@ -2016,6 +2016,7 @@ "type": "category", "label": "v2.1", "items": [ + "releasenotes/v2.1/release-2.1.8", "releasenotes/v2.1/release-2.1.7", "releasenotes/v2.1/release-2.1.6", "releasenotes/v2.1/release-2.1.5", diff --git a/versioned_sidebars/version-3.0-sidebars.json b/versioned_sidebars/version-3.0-sidebars.json index c26d462bfda..23deb717edf 100644 --- a/versioned_sidebars/version-3.0-sidebars.json +++ b/versioned_sidebars/version-3.0-sidebars.json @@ -2092,6 +2092,7 @@ "type": "category", "label": "v2.1", "items": [ + "releasenotes/v2.1/release-2.1.8", "releasenotes/v2.1/release-2.1.7", "releasenotes/v2.1/release-2.1.6", "releasenotes/v2.1/release-2.1.5", --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org