This is an automated email from the ASF dual-hosted git repository.

xxyu pushed a commit to branch doc5.0
in repository https://gitbox.apache.org/repos/asf/kylin.git

commit 02e31db7f0b14469d39efa49fbbd242512ccede5
Author: Mukvin <boyboys...@163.com>
AuthorDate: Tue Aug 16 14:35:11 2022 +0800

    KYLIN-5221 add operations docs
---
 website/docs/operations/cli_tool/diagnosis.md      | 139 +++++++++++++++++++++
 website/docs/operations/cli_tool/intro.md          |  17 +++
 .../operations/project-maintenance/alerting.md     |  50 ++++++++
 .../images/project_settings.png                    | Bin 0 -> 244469 bytes
 .../images/project_settings_acceleration.png       | Bin 0 -> 213058 bytes
 .../images/project_settings_acceleration_tips.png  | Bin 0 -> 150813 bytes
 .../images/project_settings_basic_general.png      | Bin 0 -> 170160 bytes
 .../images/project_settings_cc_expose.png          | Bin 0 -> 48912 bytes
 .../images/project_settings_custom_config.png      | Bin 0 -> 58667 bytes
 .../project_settings_default_database_en.png       | Bin 0 -> 297604 bytes
 .../images/project_settings_job_notification.png   | Bin 0 -> 144128 bytes
 .../project_settings_job_notification_page.png     | Bin 0 -> 354436 bytes
 .../images/project_settings_model_rewrite.png      | Bin 0 -> 250137 bytes
 .../images/project_settings_pushdown.png           | Bin 0 -> 302372 bytes
 .../images/project_settings_segment_en.png         | Bin 0 -> 191173 bytes
 .../images/project_settings_storage.png            | Bin 0 -> 233852 bytes
 .../images/project_settings_storage_low_usage.png  | Bin 0 -> 240252 bytes
 .../images/project_settings_yarn_queue.png         | Bin 0 -> 90074 bytes
 .../images/recommendation_preferences_en.png       | Bin 0 -> 153741 bytes
 .../images/service_state.en.png                    | Bin 0 -> 58508 bytes
 .../images/storage_quota.en.png                    | Bin 0 -> 34171 bytes
 .../project-maintenance/images/toolbar.en.png      | Bin 0 -> 688505 bytes
 .../docs/operations/project-maintenance/intro.md   |  17 +++
 .../project-maintenance/project_settings.md        | 127 +++++++++++++++++++
 24 files changed, 350 insertions(+)

diff --git a/website/docs/operations/cli_tool/diagnosis.md 
b/website/docs/operations/cli_tool/diagnosis.md
new file mode 100644
index 0000000000..e26e470720
--- /dev/null
+++ b/website/docs/operations/cli_tool/diagnosis.md
@@ -0,0 +1,139 @@
+---
+title: Diagnostic Package
+language: en
+sidebar_label: Diagnostic Package
+pagination_label: Diagnostic Package
+toc_min_heading_level: 2
+toc_max_heading_level: 6
+pagination_prev: null
+pagination_next: null
+keywords:
+    - diagnostic package
+draft: false
+last_update:
+    date: 08/16/2022
+---
+
+Kylin users may face with many problems during usage, such as failure in 
creating a model or query errors. Kylin provides a cli tool to pack related 
information into a zip package to help system administrator to better analyze 
the root cause of these problems.
+Diagnosis function including System Diagnosis、Job Diagnosis and Query 
Diagnosis.
+
+### Generate Diagnostic Package using bash script
+- In FusionInsight, you need to execute command `source 
/opt/hadoopclient/bigdata_env` first. The `hadoopclient` is a variable.
+
+- Generate system diagnostic package
+Execute `$KYLIN_HOME/bin/diag.sh [-startTime <START_TIMESTAMP> -endTime 
<END_TIMESTAMP>] [-destDir <DESTINATION_DIR>]` to generate the system 
diagnostic package. The default time range is last 1 day, START_TIMESTAMP and 
END_TIMESTAMP is in unix timestamp. You may get the current unix timestamp by 
run ```echo $((`date +%s`*1000))``` in Linux.
+
+- Generate job diagnostic package
+Execute `$KYLIN_HOME/bin/diag.sh -job <jobid> [-destDir <DESTINATION_DIR>]` to 
generate the job diagnostic package with replacing `<jobid>` with the job ID 
number.
+
+- Generate query diagnostic package
+  Execute `$KYLIN_HOME/bin/diag.sh -project <project> -query <queryid> 
[-destDir <DESTINATION_DIR>]` to generate the query diagnostic package with 
replacing `<queryid>` with the actual query ID number and `<project>` with the 
name of the project in which the actual query is made.
+  
+- Diagnostic package storage location
+Diagnostic packages generated by scripts are stored under 
`$KYLIN_HOME/diag_dump/` by default, you can specify the location by 
configuring `-destDir` parameter.
+   > Note: In order to avoid the diagnostic package occupying a lot of 
storage, please clean up the `$KYLIN_HOME/diag_dump/` directory in time.
+
+- Skip metadata files
+    If you want to exclude metadata files, please specify `-includeMeta false`.
+
+- Skip audit log files
+    If you want to exclude audit log files, please specify `-includeAuditLog 
false` or add configuration `kylin.diag.include-auditlog=false` in the 
`kylin.properties`
+
+### Diagnostic Package Content
+
+#### Full Diagnostic Package Content
+
+- `/conf`: configuration information under the `$KYLIN_HOME/conf` directory.
+- `/hadoop_conf`: configuration information under the 
`$KYLIN_HOME/hadoop_conf` directory.
+- `/metadata`: metadata files.
+- `/logs`: all the logs in the specified time range, 1 day is by default.
+- `/spark_logs`: all Spark executor logs of query in the specified time range.
+- `/sparder_history`:all Sparder logs of query in  the specified time range.
+- `/system_metrics`: all system metrics in the specified time range. 
+- `/audit_log`: all audit logs of metdata in the specified time range.
+- `/job_tmp`: the optimization suggestions log.
+- `/client`: operating system resources occupied information, Hadoop version 
and Kerberos information.
+- `/bin`: program execute and manager binary files.
+- `/monitor_metrics`: System monitoring statistics.
+- `/rec_candidate`: optimization suggestions for the model.
+- `/write_ hadoop_ conf`:`$KYLIN_HOME/write_hadoop_conf`, Hadoop configuration 
of the build cluster. This directory will not be available when Read/Write 
separation deployment is not configured.
+- file `catalog_info`: directory structure of install package.
+- file `commit_SHA1`: git-commit version.
+- file `hadoop_env`: hadoop environment information.
+- file `info`: license,package and hostname.
+- file `kylin_env`: Kylin version, operating system information, Java related 
information, git-commit information.
+- file `time_used_info`: Time statistics of each file generated in the 
diagnostic package.
+
+#### Job Diagnostic Package Content
+
+- `/conf`: configuration information under the `$KYLIN_HOME/conf` directory.
+- `/hadoop_conf`: configuration information under the 
`$KYLIN_HOME/hadoop_conf` directory.
+- `/job_history`:Job execution history information mainly includes the 
execution information of yarn application.
+- `/metadata`: metadata files.
+- `/logs`: the logs generated during the execution of the job.
+- `/spark_logs`: all spark executor logs generated during job execution.
+- `/system_metrics`: the system metrics generated during the execution.
+- `/audit_log`: the audit logs generated during the execution.
+- `/job_tmp`: the temporary files, logs and optimization suggestions log of 
job.
+- `/yarn_application_log`: specifies the logs of yarn application of job. 
+- `/client`: operating system resources occupied information, Hadoop version 
and Kerberos information.
+- `/bin`: program execute and manager binary files.
+- `/monitor_metrics`: System monitoring statistics.
+- `/rec_candidate`: optimization suggestions for the model.
+- `/write_ hadoop_ conf`:`$KYLIN_HOME/write_hadoop_conf`, Hadoop configuration 
of the build cluster. This directory will not be available when Read/Write 
separation deployment is not configured.
+- file `catalog_info`: directory structure of install package.
+- file `commit_SHA1`: git-commit version.
+- file `hadoop_env`: hadoop environment information.
+- file `info`: license, package and hostname.
+- file `kylin_env`:kyligence Enterprise version, operating system information, 
Java related information, git-commit information.
+- file `time_used_info`: Time statistics of each file generated in the 
diagnostic package.
+
+#### Query Diagnostic Package Content
+
+- `/conf`: configuration information under the `$KYLIN_HOME/conf` directory.
+- `/hadoop_conf`: configuration information under the 
`$KYLIN_HOME/hadoop_conf` directory.
+- `/metadata`:specify the metadata for all models under the project.
+- `/logs`:`$KYLIN_HOME/logs/kylin.log`,specify the log of the query.
+- `/spark_logs`:all Spark executor logs within the time range are included in 
the query diagnostic package.
+- `/sparder_history`:all Sparder logs within the time range are included in 
the query diagnostic package.
+- `/client`:operating system resource usage, Version information for Hadoop, 
and Kerberos information.
+- file `catalog_info`: directory structure of install package.
+- file `commit_SHA1`: git-commit version.
+- file `hadoop_env`: hadoop environment information.
+- file `info`: license, package and hostname.
+- file `kylin_env`:kyligence Enterprise version, operating system information, 
Java related information, git-commit information.
+- file `time_used_info`: Time statistics of each file generated in the 
diagnostic package.
+
+### Multi-Node Diagnosis
+At present, there is no API to know which nodes are in the cluster. You need 
to record the deployed nodes by yourself, and then go to each node to generate 
diagnostic package separately. The method of generating the diagnostic package 
is the same as the above.
+
+### Diagnostic package desensitization
+
+The diagnostic package desensitization function can hide sensitive information 
in the diagnostic package, such as user names, passwords, etc. While helping 
users solve problems, it can meet users' data security requirements.
+
+You can enable the diagnostic package desensitization function through the 
following configuration item:
+
+```properties
+## The desensitization level of the diagnostic package. RAW stands for no 
desensitization, OBF stands for desensitization
+kylin.diag.obf.level=OBF
+```
+
+After the configuration is enabled, the diagnostic package generated through 
the Web UI or through the terminal CLI tool will be desensitized. The system 
will desensitize all files starting with `kylin.properties` in the 
`KYLIN_HONE/conf` directory. All configuration items including `password`, 
`user`, `zookeeper.zk-auth`, ` The configuration items of source.jdbc.pass` 
will be desensitized. The desensitization method is to replace the value of the 
configuration item with `<hidden>`.
+
+### Common Questions
+
+**Q: Why is the system diagnostic package log content incomplete?**
+
+A: The extraction of the log is a text-based match (based on the minute-level 
time string). If the content is found to be incomplete, it may be that the 
specified timestamp is not converted to the corresponding one when converted to 
a time string. You can try to modify the time range and re-generate the 
diagnostic package.
+
+**Q: Why is the `system_metrics` directory missing content in diagnostic 
package?**
+
+A: `system_metrics` contains system metrics, which are stored in InfluxDB. You 
need to specify an RPC port when using InfluxDB to back up the data, so please 
verify whether the configuration item 
`kylin.metrics.influx-rpc-service-bind-address` in the file 
`$KYLIN_HOME/conf/kylin.properties` is correct.
+
+**Q: How to deal with Out of Memory (OOM) problem that happens during 
diagnostic package generating?**
+
+A: Please check the value of `JAVA_VM_XMX` in `conf/setenv.sh`, which is 
recommended to be adjusted to more than 4 times the size of metadata. For 
example, if the size of metadata is 1G, please set the value to 4G or above.
+
+**Q: Why is the file of the exported model optimization suggestion 0KB? **
+
+A: If the model has no optimization suggestions, then the optimization 
suggestions generated by the corresponding model will be 0KB.
diff --git a/website/docs/operations/cli_tool/intro.md 
b/website/docs/operations/cli_tool/intro.md
new file mode 100644
index 0000000000..4c034e42c8
--- /dev/null
+++ b/website/docs/operations/cli_tool/intro.md
@@ -0,0 +1,17 @@
+---
+title: CLI Operation Tool
+language: en
+sidebar_label: CLI Operation Tool
+pagination_label: CLI Operation Tool
+toc_min_heading_level: 2
+toc_max_heading_level: 6
+pagination_prev: null
+pagination_next: null
+keywords:
+    - cli operation tool
+draft: false
+last_update:
+    date: 08/12/2022
+---
+
+This chapter introduces how to use the Command-Line Interface tool to do daily 
operation work. Such as environment dependency checking tool, metadata tool, 
and diagnostic package.
diff --git a/website/docs/operations/project-maintenance/alerting.md 
b/website/docs/operations/project-maintenance/alerting.md
new file mode 100755
index 0000000000..23477573fd
--- /dev/null
+++ b/website/docs/operations/project-maintenance/alerting.md
@@ -0,0 +1,50 @@
+---
+title: Job Status Alert
+language: en
+sidebar_label: Job Status Alert
+pagination_label: Job Status Alert
+toc_min_heading_level: 2
+toc_max_heading_level: 6
+pagination_prev: null
+pagination_next: null
+keywords:
+    - job status alert
+draft: true
+last_update:
+    date: 08/16/2022
+---
+
+Kylin provides *Job Status Alert* feature that sends emails to system 
administrator if any job loads empty data or failed. It is very convenient for 
follow-ups like troubleshooting or incremental building.
+
+Job status alert by email can be enabled by the following steps,
+
+**Step one**: You need to additionally set following properties in the 
configuration file `$KYLIN_HOME/conf/kylin.properties`,
+
+   ```properties
+   kylin.job.notification-enabled=true|false  # set to true to enable the 
feature
+   kylin.job.notification-mail-enable-starttls=true|false 
+   kylin.job.notification-mail-host=your-smtp-server  # address of SMTP server
+   kylin.job.notification-mail-port=your-smtp-port  # port of SMTP server
+   kylin.job.notification-mail-username=your-smtp-account  # SMTP account 
username
+   kylin.job.notification-mail-password=your-smtp-pwd  # SMTP account password
+   kylin.job.notification-mail-sender=your-sender-address  # sender address 
+   ```
+
+> **Note**: If you need to encrypt `kylin.job.notification-mail-password`, you 
can do it like this:
+>
+> i. run following commands in `${KYLIN_HOME}`, it will print encrypted 
password
+>  ```shell
+>  ./bin/kylin.sh org.apache.kylin.tool.general.CryptTool -e AES -s <password>
+>  ```
+> ii. config `kylin.job.notification-mail-password` like this
+>  ```properties
+>   kylin.job.notification-mail-password=ENC('${encrypted_password}')
+>  ```
+
+   Please **Restart Kylin** to make configurations take effect.
+
+**Step two**: Set in the project settings page,
+
+   - Modelers and Analysts need to fill in the **Advanced Settings** --> 
**Email Notification** with your email addresses.
+
+   ![job notification](images/project_settings_job_notification_page.png)
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings.png 
b/website/docs/operations/project-maintenance/images/project_settings.png
new file mode 100644
index 0000000000..20a687a052
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings.png differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_acceleration.png
 
b/website/docs/operations/project-maintenance/images/project_settings_acceleration.png
new file mode 100644
index 0000000000..e88b5e7167
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_acceleration.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_acceleration_tips.png
 
b/website/docs/operations/project-maintenance/images/project_settings_acceleration_tips.png
new file mode 100644
index 0000000000..e5d611f514
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_acceleration_tips.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_basic_general.png
 
b/website/docs/operations/project-maintenance/images/project_settings_basic_general.png
new file mode 100644
index 0000000000..6f5ddd598b
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_basic_general.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_cc_expose.png
 
b/website/docs/operations/project-maintenance/images/project_settings_cc_expose.png
new file mode 100644
index 0000000000..1f5a5a9ea1
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_cc_expose.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_custom_config.png
 
b/website/docs/operations/project-maintenance/images/project_settings_custom_config.png
new file mode 100644
index 0000000000..84324896a0
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_custom_config.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_default_database_en.png
 
b/website/docs/operations/project-maintenance/images/project_settings_default_database_en.png
new file mode 100644
index 0000000000..c7a28165ac
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_default_database_en.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_job_notification.png
 
b/website/docs/operations/project-maintenance/images/project_settings_job_notification.png
new file mode 100644
index 0000000000..1e082cc79b
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_job_notification.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_job_notification_page.png
 
b/website/docs/operations/project-maintenance/images/project_settings_job_notification_page.png
new file mode 100644
index 0000000000..05de4610b3
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_job_notification_page.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_model_rewrite.png
 
b/website/docs/operations/project-maintenance/images/project_settings_model_rewrite.png
new file mode 100644
index 0000000000..43b61350ac
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_model_rewrite.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_pushdown.png
 
b/website/docs/operations/project-maintenance/images/project_settings_pushdown.png
new file mode 100644
index 0000000000..c4b9a45cdd
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_pushdown.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_segment_en.png
 
b/website/docs/operations/project-maintenance/images/project_settings_segment_en.png
new file mode 100644
index 0000000000..825e3a384f
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_segment_en.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_storage.png
 
b/website/docs/operations/project-maintenance/images/project_settings_storage.png
new file mode 100644
index 0000000000..5aa17d2588
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_storage.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_storage_low_usage.png
 
b/website/docs/operations/project-maintenance/images/project_settings_storage_low_usage.png
new file mode 100644
index 0000000000..e11df66530
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_storage_low_usage.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/project_settings_yarn_queue.png
 
b/website/docs/operations/project-maintenance/images/project_settings_yarn_queue.png
new file mode 100644
index 0000000000..3d3590f228
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/project_settings_yarn_queue.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/recommendation_preferences_en.png
 
b/website/docs/operations/project-maintenance/images/recommendation_preferences_en.png
new file mode 100644
index 0000000000..6538741e6c
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/recommendation_preferences_en.png
 differ
diff --git 
a/website/docs/operations/project-maintenance/images/service_state.en.png 
b/website/docs/operations/project-maintenance/images/service_state.en.png
new file mode 100644
index 0000000000..69dd4e44b1
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/service_state.en.png differ
diff --git 
a/website/docs/operations/project-maintenance/images/storage_quota.en.png 
b/website/docs/operations/project-maintenance/images/storage_quota.en.png
new file mode 100644
index 0000000000..40953f6ebc
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/storage_quota.en.png differ
diff --git a/website/docs/operations/project-maintenance/images/toolbar.en.png 
b/website/docs/operations/project-maintenance/images/toolbar.en.png
new file mode 100644
index 0000000000..2e88c1d75a
Binary files /dev/null and 
b/website/docs/operations/project-maintenance/images/toolbar.en.png differ
diff --git a/website/docs/operations/project-maintenance/intro.md 
b/website/docs/operations/project-maintenance/intro.md
new file mode 100755
index 0000000000..93b8062075
--- /dev/null
+++ b/website/docs/operations/project-maintenance/intro.md
@@ -0,0 +1,17 @@
+---
+title: Project Operation
+language: en
+sidebar_label: Project Operation
+pagination_label: Project Operation
+toc_min_heading_level: 2
+toc_max_heading_level: 6
+pagination_prev: null
+pagination_next: null
+keywords:
+    - project operation
+draft: false
+last_update:
+    date: 08/16/2022
+---
+
+The following sections introduce how to do project operation.
diff --git a/website/docs/operations/project-maintenance/project_settings.md 
b/website/docs/operations/project-maintenance/project_settings.md
new file mode 100644
index 0000000000..4f247ffbd6
--- /dev/null
+++ b/website/docs/operations/project-maintenance/project_settings.md
@@ -0,0 +1,127 @@
+---
+title: Project Settings
+language: en
+sidebar_label: Project Settings
+pagination_label: Project Settings
+toc_min_heading_level: 2
+toc_max_heading_level: 6
+pagination_prev: null
+pagination_next: null
+keywords:
+       - project settings
+draft: true
+last_update: 
+    date: Aug 16, 2022
+---
+
+On the left side navigation bar of the page, click **Setting**,you can adjust 
some settings at the project level on your business demands.
+
+![project settings](images/project_settings.png)
+
+All settings are composed of three main parts:
+
+- [Project Settings](#project-settings)
+       - [<span id="basic">Basic Settings</span>](#basic-settings)
+       - [<span id="advanced">Advanced Settings</span>](#advanced-settings)
+       - [<span id="rewrite_models">Model/Index Group Rewrite 
Settings</span>](#modelindex-group-rewrite-settings)
+
+### <span id="basic">Basic Settings</span>
+
+#### 1. General Information
+
+In this part, you can check current project's name, type and description, 
also, you can modify project description.
+
+![general information](images/project_settings_basic_general.png)
+
+#### 2. Storage Setting
+
+In this part, you can check the storage quota, which is the upper limit of the 
storage. By default, storage size is 10TB.
+
+The picture below shows where to set storage quota:
+
+![storage setting](images/project_settings_storage.png)
+
+#### 3. Pushdown Setting
+
+If you don't have any models or there is no avaliable models to answer your 
queries, you can use **pushdown** to get results for a more flexible user 
experience, and your queries will be pushdown to Spark SQL by default. This 
setting is turned on by default.
+
+![pushdown setting](images/project_settings_pushdown.png)
+
+#### 4. Segment Settings
+
+This part is about settings of segment, including Segment Merge, Retention 
Threshold and Creating Reserved Segments.
+
+**Segment Merge** means the system will automatically merge segments when 
those segments match the rules and contain the same indexes. Below is how to 
define the rules.
+
+- **Auto-Merge**: You can choose to automatically merge segments within the 
time range in 1 hour / 1 day / 1 week / 1 month / 1 quarter / 1 year (natural 
concepts).
+      
+        > Example of natural concept: Natural week means Monday to Sunday. 
Natural month means the first day of a month to the last day of the month.     
Civil year means the first day of a year to the last day of the year.
+
+- **Volatile Range**: The system will delay for a period of time (i.e. 
Volatile Range) to trigger automatic merging of Segments. You can set the time 
range to N hour(s), day(s), week(s), month(s), quarter(s), and year(s), where 
day(s), week(s), and month(s) are natural concepts. N is an integer, and the 
default value is 0.
+  
+  - Usage scenario: In actual business, due to the delay of the ETL process, 
for example, the business often needs to refresh the data of the past N days 
every day. During auto-merge, in order to reduce resource waste, you can set 
Volatile Range to prevent the system from automatically merging segments to be 
refreshed for the past N days.
+    
+> For example: If you build a segment every day and you set the auto-merge 
time range as 1 week, then you will have 7 segments no.01-07 over last week. 
+>
+> - Volatile range is 0 day , the system will automatically merge 7 segments.
+> - Volatile range is 1 day(i.e. the business needs to refresh no.07 Segment 
on the next day), therefore, the system will not merge no.01-07 segments; the 
system will not merge the 01-07 segments until the segment no.08 is added in 
the second week. 
+> - Volatile range is 2 days(i.e. the business needs to refresh no.06-07 
Segments on the next day), therefore, the system will not merge no.01-07 
segments until the segments no.08-09 are added in the second week.
+
+**Retention Threshold** sets the oldest segment time range. Support setting 
day, month, or year as units. By default, Kylin only keeps segments for 1 year, 
segments beyond 1 year will be deleted automatically.
+
+**Creating Reserved Segments** With this switch ON, you may create a segment 
with no index (reserved segment). Please note that queries would be answered by 
pushdown engine when they hit reserved segments.
+
+The picture below is the segment setting page.
+
+![segment settings](images/project_settings_segment_en.png)
+
+### <span id="advanced">Advanced Settings</span>
+
+This module includes 5 parts mainly: default database, job notification, YARN 
application queue, computed column exposure and custom project configuration.
+
+#### 1. Default Database
+
+After setting the default database, the database name can be omitted in SQL 
statements when executing a query or importing a SQL file. Modifying the 
default database may result in saved queries or SQL files being unavailable, 
historical queries cannot hit the models. Please modify the default database 
prudently.
+
+The picture below is the default database setting page:
+
+![default database](images/project_settings_default_database_en.png)
+
+#### 2. Job Notification
+
+If you want to receive notification of abnormal jobs, you can add your email 
addresses in this page, once there is any job which loads empty data or gets 
failed, the system will send you a notification email, the example email goes 
like this:
+
+![job notification](images/project_settings_job_notification.png)
+
+For specific configuration, please refer to [Job Status Alert](alerting.md) 
for more details.
+
+#### 3. YARN Application Queue
+
+The system admin user can set the YARN Application Queue of the project. After 
setting the queue, the jobs will be submitted to the specified queue to achieve 
computing resources allocation and separation between projects. This queue 
resource is used for non-query jobs such as refreshing data, merging segments, 
building indexes, loading data and sampling table.
+
+The system will submit the job to the **default** queue of YARN by default. 
The name of YARN queue is case sensitive. Please make sure the queue you set is 
available, otherwise the jobs may fail to execute or be submitted to the 
default queue according to the current **Scheduler Policy** of YARN.
+
+The picture below is the yarn queue setting page:
+
+![yarn_queue](images/project_settings_yarn_queue.png)
+
+#### 4. Computed Column Exposure
+
+This config will control the exposure of the computed columns in current 
project. If this config is on, Kylin will add computed columns of current 
project to the table schemas returned. Otherwise, computed columns are hidden 
from the table schema. This config will influence the table schemas in JDBC, 
ODBC or BI tools.
+You may not want to change this config frequently as it might break the 
project in your BI tools.
+
+![computed_column_exposure](images/project_settings_cc_expose.png)
+
+#### 5. Custom Project Configuration
+
+Administrators can add additional project configuration items needed by 
customizing the project configuration. You can click the **+ Configuration** 
button, enter the configuration item and parameter value in the pop-up window, 
and then click **OK**. If you need to modify or delete the added configuration 
items, you can click the **Edit** or **Delete** button on the right side of the 
list. These operations take effect immediately.
+
+![computed_column_exposure](images/project_settings_custom_config.png)
+
+### <span id="rewrite_models">Model/Index Group Rewrite Settings</span>
+
+Kylin supports rewriting some specific properties at level, including 
Auto-Merge, Volatile Range, Retention Threshold, spark executor resource size 
and Custom Settings.
+
+Click **+** button (Add Setting Item) under the right **Actions** tab:
+
+![model rewrite](images/project_settings_model_rewrite.png)

Reply via email to