This is an automated email from the ASF dual-hosted git repository.
luzhijing pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new 7c7db9ce93 [typo](docs) Add an open page cache hint to the benchmark
(#19449)
7c7db9ce93 is described below
commit 7c7db9ce937f2ae1acde93b90bf7d74f69018453
Author: yongkang.zhong <zhong...@qq.com>
AuthorDate: Tue May 9 21:28:39 2023 +0800
[typo](docs) Add an open page cache hint to the benchmark (#19449)
---
docs/en/docs/benchmark/ssb.md | 4 +++-
docs/en/docs/benchmark/tpch.md | 2 ++
docs/zh-CN/docs/benchmark/ssb.md | 4 +++-
docs/zh-CN/docs/benchmark/tpch.md | 3 +++
4 files changed, 11 insertions(+), 2 deletions(-)
diff --git a/docs/en/docs/benchmark/ssb.md b/docs/en/docs/benchmark/ssb.md
index bde5802d80..7d3720eeca 100644
--- a/docs/en/docs/benchmark/ssb.md
+++ b/docs/en/docs/benchmark/ssb.md
@@ -33,6 +33,8 @@ This document mainly introduces the performance of Doris on
the SSB 100G test se
> Note 1: The standard test set including SSB usually has a large gap with the
> actual business scenario, and some tests will perform parameter tuning for
> the test set. Therefore, the test results of the standard test set can only
> reflect the performance of the database in a specific scenario. It is
> recommended that users use actual business data for further testing.
>
> Note 2: The operations involved in this document are all performed in the
> Ubuntu Server 20.04 environment, and CentOS 7 as well.
+>
+> Note 3: Doris starting from version 1.2.2, the page cache is turned off by
default to reduce memory usage, which has a certain impact on performance. For
performance testing, enable the page cache by adding
disable_storage_page_cache=false to be.conf.
With 13 queries on the SSB standard test data set, we conducted a comparison
test based on Apache Doris 1.2.0-rc01, Apache Doris 1.1.3 and Apache Doris
0.15.0 RC04 versions.
@@ -270,7 +272,7 @@ We use the following command to complete all data import of
SSB test set and SSB
> Notes.
>
-> 1. To get faster import speed, you can add `flush_thread_num_per_store=5` in
be.conf and then restart BE. This configuration indicates the number of disk
writing threads for each data directory, 2 by default. Larger data can improve
write data throughput, but may increase IO Util. (Reference value: 1 mechanical
disk, with 2 by default, the IO Util during the import process is about 12%.
When it is set to 5, the IO Util is about 26%. If it is an SSD disk, it is
almost 0%) .
+> 1. To get faster import speed, you can add `flush_thread_num_per_store=10`
in be.conf and then restart BE. This configuration indicates the number of disk
writing threads for each data directory, 6 by default. Larger data can improve
write data throughput, but may increase IO Util. (Reference value: 1 mechanical
disk, with 2 by default, the IO Util during the import process is about 12%.
When it is set to 5, the IO Util is about 26%. If it is an SSD disk, it is
almost 0%) .
>
> 2. The flat table data is imported by 'INSERT INTO ... SELECT ... '.
diff --git a/docs/en/docs/benchmark/tpch.md b/docs/en/docs/benchmark/tpch.md
index b3a73f55e9..00301f7c8a 100644
--- a/docs/en/docs/benchmark/tpch.md
+++ b/docs/en/docs/benchmark/tpch.md
@@ -33,6 +33,8 @@ This document mainly introduces the performance of Doris on
the TPC-H 100G test
> Note 1: The standard test set including TPC-H is usually far from the actual
> business scenario, and some tests will perform parameter tuning for the test
> set. Therefore, the test results of the standard test set can only reflect
> the performance of the database in a specific scenario. We suggest users use
> actual business data for further testing.
>
> Note 2: The operations involved in this document are all tested on CentOS
> 7.x.
+>
+> Note 3: Doris starting from version 1.2.2, the page cache is turned off by
default to reduce memory usage, which has a certain impact on performance. For
performance testing, enable the page cache by adding
disable_storage_page_cache=false to be.conf.
On 22 queries on the TPC-H standard test data set, we conducted a comparison
test based on Apache Doris 1.2.0-rc01, Apache Doris 1.1.3 and Apache Doris
0.15.0 RC04 versions. Compared with Apache Doris 1.1.3, the overall performance
of Apache Doris 1.2.0-rc01 has been improved by nearly 3 times, and by nearly
11 times compared with Apache Doris 0.15.0 RC04.
diff --git a/docs/zh-CN/docs/benchmark/ssb.md b/docs/zh-CN/docs/benchmark/ssb.md
index a78d3d7066..9c567a6dae 100644
--- a/docs/zh-CN/docs/benchmark/ssb.md
+++ b/docs/zh-CN/docs/benchmark/ssb.md
@@ -33,6 +33,8 @@ under the License.
> 注 1：包括 SSB
> 在内的标准测试集通常和实际业务场景差距较大，并且部分测试会针对测试集进行参数调优。所以标准测试集的测试结果仅能反映数据库在特定场景下的性能表现。建议用户使用实际业务数据进行进一步的测试。
>
> 注 2：本文档涉及的操作都在 Ubuntu Server 20.04 环境进行，CentOS 7 也可测试。
+>
+> 注 3: Doris 从 1.2.2 版本开始，为了减少内存占用，默认关闭了 Page Cache，会对性能有一定影响，所以在进行性能测试时请在
be.conf 添加 disable_storage_page_cache=false 来打开 Page Cache。
在 SSB 标准测试数据集上的 13 个查询上，我们基于 Apache Doris 1.2.0-rc01， Apache Doris 1.1.3 及
Apache Doris 0.15.0 RC04 版本进行了对别测试。
@@ -271,7 +273,7 @@ sh bin/load-ssb-data.sh -c 10
> 注：
>
-> 1. 为获得更快的导入速度，你可以在 be.conf 中添加 `flush_thread_num_per_store=5`
后重启BE。该配置表示每个数据目录的写盘线程数，默认为2。较大的数据可以提升写数据吞吐，但可能会增加 IO
Util。（参考值：1块机械磁盘，在默认为2的情况下，导入过程中的 IO Util 约为12%，设置为5时，IO Util 约为26%。如果是 SSD
盘，则几乎为 0）。
+> 1. 为获得更快的导入速度，你可以在 be.conf 中添加 `flush_thread_num_per_store=10`
后重启BE。该配置表示每个数据目录的写盘线程数，默认为6。较大的数据可以提升写数据吞吐，但可能会增加 IO
Util。（参考值：1块机械磁盘，在默认为2的情况下，导入过程中的 IO Util 约为12%，设置为5时，IO Util 约为26%。如果是 SSD
盘，则几乎为 0）。
>
> 2. flat 表数据采用 'INSERT INTO ... SELECT ... ' 的方式导入。
diff --git a/docs/zh-CN/docs/benchmark/tpch.md
b/docs/zh-CN/docs/benchmark/tpch.md
index e0a5cf3ca6..9ebc3c3bc3 100644
--- a/docs/zh-CN/docs/benchmark/tpch.md
+++ b/docs/zh-CN/docs/benchmark/tpch.md
@@ -33,6 +33,9 @@ TPC-H是一个决策支持基准（Decision Support Benchmark），它由一套
> 注1：包括 TPC-H
> 在内的标准测试集通常和实际业务场景差距较大，并且部分测试会针对测试集进行参数调优。所以标准测试集的测试结果仅能反映数据库在特定场景下的性能表现。建议用户使用实际业务数据进行进一步的测试。
>
> 注2：本文档涉及的操作都在 CentOS 7.x 上进行测试。
+>
+> 注 3: Doris 从 1.2.2 版本开始，为了减少内存占用，默认关闭了 Page Cache，会对性能有一定影响，所以在进行性能测试时请在
be.conf 添加 disable_storage_page_cache=false 来打开 Page Cache。
+
在 TPC-H 标准测试数据集上的 22 个查询上，我们基于 Apache Doris 1.2.0-rc01， Apache Doris 1.1.3 及
Apache Doris 0.15.0 RC04 版本进行了对别测试， Apache Doris 1.2.0-rc01上相对 Apache Doris
1.1.3 整体性能提升了将近 3 倍，相对于 Apache Doris 0.15.0 RC04 ,性能提升了将近 11 倍 。
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
