This is an automated email from the ASF dual-hosted git repository. kxiao pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new fb7462fd710 [fix](release) Fix 2.0.15 release note (#1190) fb7462fd710 is described below commit fb7462fd71019769a55d06738cecff13adbb4b3f Author: KassieZ <139741991+kass...@users.noreply.github.com> AuthorDate: Sat Oct 12 20:31:44 2024 +0900 [fix](release) Fix 2.0.15 release note (#1190) --- blog/release-note-2.0.15.md | 75 +++++++++++++----- common_docs_zh/releasenotes/v2.0/release-2.0.15.md | 89 +++++++++++++++------- releasenotes/v2.0/release-2.0.15.md | 74 +++++++++++++----- 3 files changed, 170 insertions(+), 68 deletions(-) diff --git a/blog/release-note-2.0.15.md b/blog/release-note-2.0.15.md index 399e443cc8e..86544d9caae 100644 --- a/blog/release-note-2.0.15.md +++ b/blog/release-note-2.0.15.md @@ -27,35 +27,68 @@ specific language governing permissions and limitations under the License. --> - Thanks to our community users and developers, about 157 improvements and bug fixes have been made in Doris 2.0.15 version - Quick Download: https://doris.apache.org/download - -## 1 New features -- Adds a REST interface to retrieve the most recent query profile: `curl http://user:password@127.0.0.1:8030/api/profile/text`.[#38268](https://github.com/apache/doris/pull/38268) - -## 2 Improvements - -- Optimizes the primary key point query performance for MOW tables with sequence columns.[#38287](https://github.com/apache/doris/pull/38287) +- GitHub: https://github.com/apache/doris/releases/tag/2.0.15 + +## 1 Behavior Change + +NA + +## 2 New Features + +- Restore now supports deleting redundant tablets and partition options. [#39028](https://github.com/apache/doris/pull/39028) + +- Support JSON function `json_search`.[#40948](https://github.com/apache/doris/pull/40948) + +## 3 Improvement and Optimizations + +### Stability + +- Add a FE configuration `abort_txn_after_lost_heartbeat_time_second` for transaction abort time. [#28662](https://github.com/apache/doris/pull/28662) + +- Abort transactions after a BE loses heartbeat for over 1 minute instead of 5 seconds, to avoid overly sensitive transaction aborts. [#22781](https://github.com/apache/doris/pull/22781) + +- Delay scheduling EOF tasks of routine load to avoid an excessive number of small transactions. [#39975](https://github.com/apache/doris/pull/39975) + +- Prefer querying from online disk services to be more robust. [#39467](https://github.com/apache/doris/pull/39467) + +- Skip checking newly inserted rows in non-strict mode partial updates if the row's delete sign is marked. [#40322](https://github.com/apache/doris/pull/40322) + +- To prevent FE OOM, limit the number of tablets in backup tasks, with a default value of 300,000. [#39987](https://github.com/apache/doris/pull/39987) + +### Performance + +- Optimize slow column updates caused by concurrent column updates and compactions. [#38487](https://github.com/apache/doris/pull/38487) + +- When a NullLiteral exists in a filter condition, it can now be folded into False and further converted to an EmptySet to reduce unnecessary data scanning and computation. [#38135](https://github.com/apache/doris/pull/38135) + +- Improve performance of `ORDER BY` permutation. [#38985](https://github.com/apache/doris/pull/38985) + +- Improve the performance of string processing in inverted indexes. [#37395](https://github.com/apache/doris/pull/37395) + +### Optimizer and Statistics + +- Added support for statements beginning with a semicolon. [#39399](https://github.com/apache/doris/pull/39399) + +- Polish aggregate function signature matching. [#39352](https://github.com/apache/doris/pull/39352) + +- Drop column statistics and trigger auto analysis after schema change. [#39101](https://github.com/apache/doris/pull/39101) + +- Support dropping cached stats using `DROP CACHED STATS table_name`. [#39367](https://github.com/apache/doris/pull/39367) -- Enhances the performance of inverted index queries with many conditions. [#35346](https://github.com/apache/doris/pull/35346) - -- Automatically enables the `support_phrase` option when creating a tokenized inverted index to accelerate `match_phrase` phrase queries.[#37949](https://github.com/apache/doris/pull/37949) +### Multi Catalog and Others -- Supports simplified SQL hints, for example: `SELECT /*+ query_timeout(3000) */ * FROM t;`. [#37720](https://github.com/apache/doris/pull/37720) +- Optimize JDBC Catalog refresh to reduce the frequency of client creation. [#40261](https://github.com/apache/doris/pull/40261) -- Automatically retries reading from object storage when encountering a `429` error to improve stability.[#35396](https://github.com/apache/doris/pull/35396) +- Fix thread leaks in JDBC Catalog under certain conditions. [#39423](https://github.com/apache/doris/pull/39423) -- LEFT SEMI / ANTI JOIN terminates subsequent matching execution upon matching a qualifying data row to enhance performance. [#34703](https://github.com/apache/doris/pull/34703) +- ARRAY MAP STRUCT types now support `REPLACE_IF_NOT_NULL`. [#38304](https://github.com/apache/doris/pull/38304) -- Prevents coredump when returning illegal data to MySQL results. [#28069](https://github.com/apache/doris/pull/28069) +- Retry delete jobs for failures that are not `DELETE_INVALID_XXX`. [#37834](https://github.com/apache/doris/pull/37834) -- Unifies the output of type names in lowercase to maintain compatibility with MySQL and be more friendly to BI tools. [38521](https://github.com/apache/doris/pull/38521) - -## Credits - -Thanks all who contribute to this release: +**Credits** -@924060929, @BePPPower, @BiteTheDDDDt, @CalvinKirs, @GoGoWen, @HappenLee, @Jibing-Li, @Johnnyssc,@LiBinfeng-01,@Mryange, @SWJTU-ZhangLei,@TangSiyang2001, @Toms1999, @Vallishp, @Yukang-Lian, @airborne12, @amorynan, @bobhan1, @cambyzju, @csun5285, @dataroaring, @eldenmoon, @englefly, @feiniaofeiafei,@hello-stephen, @htyoung, @hubgeter, @justfortaste, @liaoxin01, @liugddx, @liutang123, @luwei16, @mongo360,@morrySnow, @qidaye, @smallx, @sollhui, @starocean999, @w41ter, @xiaokang, @xzj7019, @ [...] \ No newline at end of file +@924060929, @BePPPower, @BiteTheDDDDt, @CalvinKirs, @GoGoWen, @HappenLee, @Jibing-Li, @Johnnyssc, @LiBinfeng-01, @Mryange, @SWJTU-ZhangLei, @TangSiyang2001, @Toms1999, @Vallishp, @Yukang-Lian, @airborne12, @amorynan, @bobhan1, @cambyzju, @csun5285, @dataroaring, @eldenmoon, @englefly, @feiniaofeiafei, @hello-stephen, @htyoung, @hubgeter, @justfortaste, @liaoxin01, @liugddx, @liutang123, @luwei16, @mongo360, @morrySnow, @qidaye, @smallx, @sollhui, @starocean999, @w41ter, @xiaokang, @xzj70 [...] \ No newline at end of file diff --git a/common_docs_zh/releasenotes/v2.0/release-2.0.15.md b/common_docs_zh/releasenotes/v2.0/release-2.0.15.md index 453f00f5745..c770043556a 100644 --- a/common_docs_zh/releasenotes/v2.0/release-2.0.15.md +++ b/common_docs_zh/releasenotes/v2.0/release-2.0.15.md @@ -24,34 +24,69 @@ specific language governing permissions and limitations under the License. --> -亲爱的社区小伙伴们,Apache Doris 2.0.15 版本已于 2024 年 9 月 19 日正式与大家见面,该版本提交了 157 个改进项以及问题修复,进一步提升了系统的性能及稳定性,欢迎大家下载体验。 +亲爱的社区小伙伴们,Apache Doris 2.0.15 版本已于 2024 年 9 月 30 日正式与大家见面,该版本提交了 157 个改进项以及问题修复,进一步提升了系统的性能及稳定性,欢迎大家下载体验。 - 立即下载:https://doris.apache.org/download +- GitHub 下载:https://github.com/apache/doris/releases/tag/2.0.15 -## 1 新功能 - -- 增加获取最近一个查询 Profile 的 REST 接口 `curl http://user:password@127.0.0.1:8030/api/profile/text`。[#38268](https://github.com/apache/doris/pull/38268) - -## 2 改进和优化 - -- 优化 MOW 表带有 Sequence 列的主键点查性能。[#38287](https://github.com/apache/doris/pull/38287) - -- 优化倒排索引在查询条件很多时的性能。[#35346](https://github.com/apache/doris/pull/35346) - -- 创建带分词的倒排索引时,自动开启 `support_phrase` 选项加速 `match_phrase` 系列短语查询。[#37949](https://github.com/apache/doris/pull/37949) - -- 支持简化的 SQL Hint, 例如 `SELECT /*+ query_timeout(3000) */ * FROM t;`。[#37720](https://github.com/apache/doris/pull/37720) - -- 读对象存储遇到 `429` 错误时自动重试提升稳定性。[#35396](https://github.com/apache/doris/pull/35396) - -- LEFT SEMI / ANTI JOIN 在匹配到符合的数据行时,终止后续的匹配执行提升性能。 [#34703](https://github.com/apache/doris/pull/34703) - -- 避免非法数据返回 MySQL 结果时出发 Coredump。[#28069](https://github.com/apache/doris/pull/28069) - -- 输出类型名字时统一使用小写,保持跟 MySQL 兼容对 BI 工具更加友好。[#38521](https://github.com/apache/doris/pull/38521) - - -## 致谢 - -@924060929, @BePPPower, @BiteTheDDDDt, @CalvinKirs, @GoGoWen, @HappenLee, @Jibing-Li, @Johnnyssc,@LiBinfeng-01,@Mryange, @SWJTU-ZhangLei,@TangSiyang2001, @Toms1999, @Vallishp, @Yukang-Lian, @airborne12, @amorynan, @bobhan1, @cambyzju, @csun5285, @dataroaring, @eldenmoon, @englefly, @feiniaofeiafei,@hello-stephen, @htyoung, @hubgeter, @justfortaste, @liaoxin01, @liugddx, @liutang123, @luwei16, @mongo360,@morrySnow, @qidaye, @smallx, @sollhui, @starocean999, @w41ter, @xiaokang, @xzj7019, @ [...] \ No newline at end of file + +## 行为变更 + +无 + +## 新功能 + +- 恢复功能现在支持删除冗余的表块和分区选项。[#39028](https://github.com/apache/doris/pull/39028) + +- 支持 JSON 函数 `json_search`。[#40948](https://github.com/apache/doris/pull/40948) + +## 改进与优化 + +### 稳定性 + +- 添加了 FE 配置 `abort_txn_after_lost_heartbeat_time_second`,用于设置事务中止时间。[#28662](https://github.com/apache/doris/pull/28662) + +- BE 失去心跳信号超过 1 分钟后中止事务,而不是 5 秒,以避免事务中止过于敏感。[#22781](https://github.com/apache/doris/pull/22781) + +- 延迟调度例行加载的 EOF 任务,以避免过多的小事务。[#39975](https://github.com/apache/doris/pull/39975) + +- 优先从在线磁盘服务进行查询,以提高稳健性。[#39467](https://github.com/apache/doris/pull/39467) + +- 在非严格模式的部分更新中,如果行的删除标志已标记,则跳过检查新插入的行。[#40322](https://github.com/apache/doris/pull/40322) + +- 为防止 FE 内存不足,限制备份任务中的表块数量,默认值为 300,000。[#39987](https://github.com/apache/doris/pull/39987) + +- ARRAY MAP STRUCT 类型支持 `REPLACE_IF_NOT_NULL`。[#38304](https://github.com/apache/doris/pull/38304) + +- 对非 `DELETE_INVALID_XXX `失败的删除作业进行重试。[#37834](https://github.com/apache/doris/pull/37834) + +### 查询性能 + +- 优化由并发列更新和 compaction 引起的慢速列更新问题。[#38487](https://github.com/apache/doris/pull/38487) + +- 当过滤条件中存在 NullLiteral 时,可以将其折叠为 false 并进一步转换为 EmptySet,以减少不必要的数据扫描和计算。[#38135](https://github.com/apache/doris/pull/38135) + +- 提高 `ORDER BY` 全排序的性能。[#38985](https://github.com/apache/doris/pull/38985) + +- 提高倒排索引中字符串处理的性能。[#37395](https://github.com/apache/doris/pull/37395) + +### 查询优化器 + +- 增加了对以分号开头的语句的支持以兼容老优化器。[#39399](https://github.com/apache/doris/pull/39399) + +- 完善了一些聚合函数签名匹配。[#39352](https://github.com/apache/doris/pull/39352) + +- 在 Schema 变更后删除列统计信息并触发自动分析。[#39101](https://github.com/apache/doris/pull/39101) + +- 支持使用 `DROP CACHED STATS table_name` 删除缓存的统计信息。[#39367](https://github.com/apache/doris/pull/39367) + +### Multi Catalog + +- 优化 JDBC Catalog 刷新,减少客户端创建频率。[#40261](https://github.com/apache/doris/pull/40261) + +- 修复 JDBC Catalog 在某些条件下存在的线程泄漏问题。[#39423](https://github.com/apache/doris/pull/39423) + +**致谢** + +@924060929、@BePPPower、@BiteTheDDDDt、@CalvinKirs、@GoGoWen、@HappenLee、@Jibing-Li、@Johnnyssc、@LiBinfeng-01、@Mryange、@SWJTU-ZhangLei、@TangSiyang2001、@Toms1999、@Vallishp、@Yukang-Lian、@airborne12、@amorynan、@bobhan1、@cambyzju、@csun5285、@dataroaring、@eldenmoon、@englefly、@feiniaofeiafei、@hello-stephen、@htyoung、@hubgeter、@justfortaste、@liaoxin01、@liugddx、@liutang123、@luwei16、@mongo360、@morrySnow、@qidaye、@smallx、@sollhui、@starocean999、@w41ter、@xiaokang、@xzj7019、@yujun777、@zclllyybb、@zddr、@zhangstar [...] \ No newline at end of file diff --git a/releasenotes/v2.0/release-2.0.15.md b/releasenotes/v2.0/release-2.0.15.md index e48a212ad94..58237f7c3f0 100644 --- a/releasenotes/v2.0/release-2.0.15.md +++ b/releasenotes/v2.0/release-2.0.15.md @@ -27,31 +27,65 @@ under the License. Thanks to our community users and developers, about 157 improvements and bug fixes have been made in Doris 2.0.15 version - Quick Download: https://doris.apache.org/download - -## 1 New features -- Adds a REST interface to retrieve the most recent query profile: `curl http://user:password@127.0.0.1:8030/api/profile/text`.[#38268](https://github.com/apache/doris/pull/38268) - -## 2 Improvements - -- Optimizes the primary key point query performance for MOW tables with sequence columns.[#38287](https://github.com/apache/doris/pull/38287) +- GitHub: https://github.com/apache/doris/releases/tag/2.0.15 -- Enhances the performance of inverted index queries with many conditions. [#35346](https://github.com/apache/doris/pull/35346) - -- Automatically enables the `support_phrase` option when creating a tokenized inverted index to accelerate `match_phrase` phrase queries.[#37949](https://github.com/apache/doris/pull/37949) +## 1 Behavior Change -- Supports simplified SQL hints, for example: `SELECT /*+ query_timeout(3000) */ * FROM t;`. [#37720](https://github.com/apache/doris/pull/37720) +NA -- Automatically retries reading from object storage when encountering a `429` error to improve stability.[#35396](https://github.com/apache/doris/pull/35396) +## 2 New Features -- LEFT SEMI / ANTI JOIN terminates subsequent matching execution upon matching a qualifying data row to enhance performance. [#34703](https://github.com/apache/doris/pull/34703) +- Restore now supports deleting redundant tablets and partition options. [#39028](https://github.com/apache/doris/pull/39028) -- Prevents coredump when returning illegal data to MySQL results. [#28069](https://github.com/apache/doris/pull/28069) +- Support JSON function `json_search`.[#40948](https://github.com/apache/doris/pull/40948) -- Unifies the output of type names in lowercase to maintain compatibility with MySQL and be more friendly to BI tools. [38521](https://github.com/apache/doris/pull/38521) - -## Credits - -Thanks all who contribute to this release: +## 3 Improvement and Optimizations -@924060929, @BePPPower, @BiteTheDDDDt, @CalvinKirs, @GoGoWen, @HappenLee, @Jibing-Li, @Johnnyssc,@LiBinfeng-01,@Mryange, @SWJTU-ZhangLei,@TangSiyang2001, @Toms1999, @Vallishp, @Yukang-Lian, @airborne12, @amorynan, @bobhan1, @cambyzju, @csun5285, @dataroaring, @eldenmoon, @englefly, @feiniaofeiafei,@hello-stephen, @htyoung, @hubgeter, @justfortaste, @liaoxin01, @liugddx, @liutang123, @luwei16, @mongo360,@morrySnow, @qidaye, @smallx, @sollhui, @starocean999, @w41ter, @xiaokang, @xzj7019, @ [...] \ No newline at end of file +### Stability + +- Add a FE configuration `abort_txn_after_lost_heartbeat_time_second` for transaction abort time. [#28662](https://github.com/apache/doris/pull/28662) + +- Abort transactions after a BE loses heartbeat for over 1 minute instead of 5 seconds, to avoid overly sensitive transaction aborts. [#22781](https://github.com/apache/doris/pull/22781) + +- Delay scheduling EOF tasks of routine load to avoid an excessive number of small transactions. [#39975](https://github.com/apache/doris/pull/39975) + +- Prefer querying from online disk services to be more robust. [#39467](https://github.com/apache/doris/pull/39467) + +- Skip checking newly inserted rows in non-strict mode partial updates if the row's delete sign is marked. [#40322](https://github.com/apache/doris/pull/40322) + +- To prevent FE OOM, limit the number of tablets in backup tasks, with a default value of 300,000. [#39987](https://github.com/apache/doris/pull/39987) + +### Performance + +- Optimize slow column updates caused by concurrent column updates and compactions. [#38487](https://github.com/apache/doris/pull/38487) + +- When a NullLiteral exists in a filter condition, it can now be folded into False and further converted to an EmptySet to reduce unnecessary data scanning and computation. [#38135](https://github.com/apache/doris/pull/38135) + +- Improve performance of `ORDER BY` permutation. [#38985](https://github.com/apache/doris/pull/38985) + +- Improve the performance of string processing in inverted indexes. [#37395](https://github.com/apache/doris/pull/37395) + +### Optimizer and Statistics + +- Added support for statements beginning with a semicolon. [#39399](https://github.com/apache/doris/pull/39399) + +- Polish aggregate function signature matching. [#39352](https://github.com/apache/doris/pull/39352) + +- Drop column statistics and trigger auto analysis after schema change. [#39101](https://github.com/apache/doris/pull/39101) + +- Support dropping cached stats using `DROP CACHED STATS table_name`. [#39367](https://github.com/apache/doris/pull/39367) + +### Multi Catalog and Others + +- Optimize JDBC Catalog refresh to reduce the frequency of client creation. [#40261](https://github.com/apache/doris/pull/40261) + +- Fix thread leaks in JDBC Catalog under certain conditions. [#39423](https://github.com/apache/doris/pull/39423) + +- ARRAY MAP STRUCT types now support `REPLACE_IF_NOT_NULL`. [#38304](https://github.com/apache/doris/pull/38304) + +- Retry delete jobs for failures that are not `DELETE_INVALID_XXX`. [#37834](https://github.com/apache/doris/pull/37834) + +**Credits** + +@924060929, @BePPPower, @BiteTheDDDDt, @CalvinKirs, @GoGoWen, @HappenLee, @Jibing-Li, @Johnnyssc, @LiBinfeng-01, @Mryange, @SWJTU-ZhangLei, @TangSiyang2001, @Toms1999, @Vallishp, @Yukang-Lian, @airborne12, @amorynan, @bobhan1, @cambyzju, @csun5285, @dataroaring, @eldenmoon, @englefly, @feiniaofeiafei, @hello-stephen, @htyoung, @hubgeter, @justfortaste, @liaoxin01, @liugddx, @liutang123, @luwei16, @mongo360, @morrySnow, @qidaye, @smallx, @sollhui, @starocean999, @w41ter, @xiaokang, @xzj70 [...] \ No newline at end of file --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org