This is an automated email from the ASF dual-hosted git repository. xxyu pushed a commit to branch doc5.0 in repository https://gitbox.apache.org/repos/asf/kylin.git
commit 29820147d7a2af89c4039009f4edec3e537230e3 Author: Mukvin <boyboys...@163.com> AuthorDate: Tue Aug 30 15:54:41 2022 +0800 KYLIN-5242 add doc for modeling --- website/docs/modeling/load_data/intro.md | 3 --- .../model_design/advance_guide/fast_bitmap.md | 28 ++++++++++++--------- .../advance_guide/images/add_index.png | Bin 159722 -> 39638 bytes .../advance_guide/images/low_usage.png | Bin 58193 -> 0 bytes .../model_design/advance_guide/images/model.png | Bin 54246 -> 19282 bytes .../advance_guide/images/model_config_1.png | Bin 75469 -> 20004 bytes .../advance_guide/images/model_config_2.png | Bin 50629 -> 14212 bytes .../multilevel_partioning_build_subp_first.png | Bin 205443 -> 58618 bytes .../multilevel_partioning_build_subp_second.png | Bin 102751 -> 33751 bytes .../multilevel_partioning_build_subp_second_0.png | Bin 115055 -> 27725 bytes .../multilevel_partioning_build_subp_second_1.png | Bin 144275 -> 35684 bytes .../multilevel_partitioning_add_subp_value.png | Bin 63550 -> 0 bytes .../images/multilevel_partitioning_close.png | Bin 103983 -> 24600 bytes .../images/multilevel_partitioning_model_save.png | Bin 141412 -> 55706 bytes .../images/multilevel_partitioning_model_set.png | Bin 18583 -> 0 bytes .../images/multilevel_partitioning_subp_value.png | Bin 127585 -> 20846 bytes .../advance_guide/images/query_new.png | Bin 1609864 -> 72705 bytes .../advance_guide/images/query_old.png | Bin 1610676 -> 72666 bytes .../advance_guide/images/spark_plan_new.png | Bin 108820 -> 23233 bytes .../advance_guide/images/spark_plan_old.png | Bin 227357 -> 44444 bytes 20 files changed, 16 insertions(+), 15 deletions(-) diff --git a/website/docs/modeling/load_data/intro.md b/website/docs/modeling/load_data/intro.md index dad7b871d2..c3e0d6467b 100644 --- a/website/docs/modeling/load_data/intro.md +++ b/website/docs/modeling/load_data/intro.md @@ -14,9 +14,6 @@ last_update: date: 08/19/2022 --- - -## Load Data - Load data calculates the source data based on the model and index definition. This chapter takes the sample data as an example to introduce two data load methods and processes: - full load diff --git a/website/docs/modeling/model_design/advance_guide/fast_bitmap.md b/website/docs/modeling/model_design/advance_guide/fast_bitmap.md index 19576ec9a8..b7a66b8162 100644 --- a/website/docs/modeling/model_design/advance_guide/fast_bitmap.md +++ b/website/docs/modeling/model_design/advance_guide/fast_bitmap.md @@ -14,7 +14,7 @@ last_update: date: 08/19/2022 --- -Since Kylin 5, the system has enhanced the optimization of queries that hit the index exactly (the query contains dimensions that are exactly the same as the dimensions of the selected index), and it also improve the performance in count distinct scenario. +Since Kylin 5, the system has enhanced the optimization of queries that hit the index exactly (the query contains dimensions that are exactly the same as the dimensions of the selected index), and it also improves the performance in count distinct scenario. With the following settings, optimization of precise count distinct queries can be applied: @@ -42,29 +42,33 @@ GROUP BY LINEITEM.L_SHIPDATE ``` - 1. Create the model: +1. Create the model: +  - 2. Switch to the **Model Settings** interface: - <img src="images/model_config_1.en.png" alt="Settings" style="zoom:50%;" /> +2. Switch to the **Model Settings** interface: + +  + +3. Enter the configuration to enable the function: + +  - 3. Enter the configuration to enable the function: - <img src="images/model_config_2.en.png" alt="Settings" style="zoom:50%;" /> +4. Add indexes: - 4. Add indexes:  - 5. After building successfully, the query performance is improved a lot when the query exactly matches index. +5. After building successfully, the query performance is improved a lot when the query exactly matches index. -  +  -  +  6. Compare the execution plans before and after optimization -  +  -  +  ### Known Limitations diff --git a/website/docs/modeling/model_design/advance_guide/images/add_index.png b/website/docs/modeling/model_design/advance_guide/images/add_index.png index c8d4134ac2..a2258e6cf0 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/add_index.png and b/website/docs/modeling/model_design/advance_guide/images/add_index.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/low_usage.png b/website/docs/modeling/model_design/advance_guide/images/low_usage.png deleted file mode 100644 index 9b26333390..0000000000 Binary files a/website/docs/modeling/model_design/advance_guide/images/low_usage.png and /dev/null differ diff --git a/website/docs/modeling/model_design/advance_guide/images/model.png b/website/docs/modeling/model_design/advance_guide/images/model.png index f2b48e2b5d..edf569a2c5 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/model.png and b/website/docs/modeling/model_design/advance_guide/images/model.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/model_config_1.png b/website/docs/modeling/model_design/advance_guide/images/model_config_1.png index c1013a7957..2df77861ef 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/model_config_1.png and b/website/docs/modeling/model_design/advance_guide/images/model_config_1.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/model_config_2.png b/website/docs/modeling/model_design/advance_guide/images/model_config_2.png index 451b380718..8cdb727085 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/model_config_2.png and b/website/docs/modeling/model_design/advance_guide/images/model_config_2.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_first.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_first.png index aaeccf177a..da34e2b490 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_first.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_first.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second.png index 24fd1fe8f0..ee030494ae 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_0.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_0.png index 909840c351..448e7cc8ca 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_0.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_0.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_1.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_1.png index 87f5c7fbec..1467946ac1 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_1.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partioning_build_subp_second_1.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_add_subp_value.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_add_subp_value.png deleted file mode 100644 index d77a568481..0000000000 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_add_subp_value.png and /dev/null differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_close.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_close.png index a51b8a2cd4..75aa15d820 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_close.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_close.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_save.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_save.png index bc1b2b43d8..9e466f46ec 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_save.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_save.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_set.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_set.png deleted file mode 100644 index 7474181686..0000000000 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_model_set.png and /dev/null differ diff --git a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_subp_value.png b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_subp_value.png index ba99c09b81..73de9918b1 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_subp_value.png and b/website/docs/modeling/model_design/advance_guide/images/multilevel_partitioning_subp_value.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/query_new.png b/website/docs/modeling/model_design/advance_guide/images/query_new.png index fc214c74d3..de1c9fa6c8 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/query_new.png and b/website/docs/modeling/model_design/advance_guide/images/query_new.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/query_old.png b/website/docs/modeling/model_design/advance_guide/images/query_old.png index 0e7db49a2d..99b3e19baa 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/query_old.png and b/website/docs/modeling/model_design/advance_guide/images/query_old.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/spark_plan_new.png b/website/docs/modeling/model_design/advance_guide/images/spark_plan_new.png index 034dcaf2e0..f3ad1a865a 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/spark_plan_new.png and b/website/docs/modeling/model_design/advance_guide/images/spark_plan_new.png differ diff --git a/website/docs/modeling/model_design/advance_guide/images/spark_plan_old.png b/website/docs/modeling/model_design/advance_guide/images/spark_plan_old.png index 689b9ac1f0..1450d11352 100644 Binary files a/website/docs/modeling/model_design/advance_guide/images/spark_plan_old.png and b/website/docs/modeling/model_design/advance_guide/images/spark_plan_old.png differ