Re: [I] Avoid loading resources from external domains [doris-website]
KassieZ commented on issue #402: URL: https://github.com/apache/doris-website/issues/402#issuecomment-1970932203 Hi raboof, thanks for reporting it. We are now replacing GA with Matomo Analytics, and will continue to address the other issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[PR] init doris-kafka-connector [doris-kafka-connector]
DongLiang-0 opened a new pull request, #1: URL: https://github.com/apache/doris-kafka-connector/pull/1 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] init doris-kafka-connector [doris-kafka-connector]
morningman merged PR #1: URL: https://github.com/apache/doris-kafka-connector/pull/1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[PR] Bump commons-io:commons-io from 2.3 to 2.7 [doris-kafka-connector]
dependabot[bot] opened a new pull request, #2: URL: https://github.com/apache/doris-kafka-connector/pull/2 Bumps commons-io:commons-io from 2.3 to 2.7. [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/doris-kafka-connector/network/alerts). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[PR] Bump com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4.2 [doris-kafka-connector]
dependabot[bot] opened a new pull request, #3: URL: https://github.com/apache/doris-kafka-connector/pull/3 Bumps [com.fasterxml.jackson.core:jackson-databind](https://github.com/FasterXML/jackson) from 2.13.2.1 to 2.13.4.2. Commits See full diff in https://github.com/FasterXML/jackson/commits";>compare view [](https://docs.github.com/en/github/managing-security-vulnerabilities/about-dependabot-security-updates#about-compatibility-scores) Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting `@dependabot rebase`. [//]: # (dependabot-automerge-start) [//]: # (dependabot-automerge-end) --- Dependabot commands and options You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself) You can disable automated security fix PRs for this repo from the [Security Alerts page](https://github.com/apache/doris-kafka-connector/network/alerts). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[PR] [Improve]Added About file and github action build file [doris-kafka-connector]
DongLiang-0 opened a new pull request, #4: URL: https://github.com/apache/doris-kafka-connector/pull/4 (no comment) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Improve]Added asf.yaml file and github action build file [doris-kafka-connector]
morningman merged PR #4: URL: https://github.com/apache/doris-kafka-connector/pull/4 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] add new data types [doris-sdk]
JNSimba commented on code in PR #7:
URL: https://github.com/apache/doris-sdk/pull/7#discussion_r1512176926
##
thrift-service/src/main/thrift/Types.thrift:
##
@@ -88,14 +91,21 @@ enum TPrimitiveType {
DECIMAL64,
DECIMAL128I,
JSONB,
- UNSUPPORTED
+ UNSUPPORTED,
+ VARIANT,
+ LAMBDA_FUNCTION,
+ AGG_STATE,
+ DECIMAL256,
+ IPV4,
+ IPV6
Review Comment:
Is it enough to just add it here?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](index compaction)Remove INT32_MAX out of destPostingQueues [doris-thirdparty]
zzzxl1993 commented on PR #198: URL: https://github.com/apache/doris-thirdparty/pull/198#issuecomment-1988268647 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Clucene](chore) fix some implicit conversion [doris-thirdparty]
qidaye commented on PR #197: URL: https://github.com/apache/doris-thirdparty/pull/197#issuecomment-1990217475 @BiteThet Please open a PR to branch clucene-2.0 too. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[I] “通过外部表同步数据"的CREATE EXTERNAL TABLE 链接为空 [doris-website]
anthony-yau opened a new issue, #420: URL: https://github.com/apache/doris-website/issues/420 该文档：https://doris.apache.org/zh-CN/docs/data-operate/import/import-scenes/external-table-load，的请参阅 [CREATE EXTERNAL TABLE](https://doris.apache.org/zh-CN/docs/sql-manual/sql-reference/Data-Definition-Statements/Create/CREATE-EXTERNAL-TABLE.md) 命令手册，这个文档超链接打开404。  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] “通过外部表同步数据"的CREATE EXTERNAL TABLE 链接为空 [doris-website]
morningman commented on issue #420: URL: https://github.com/apache/doris-website/issues/420#issuecomment-1997650509 external table is deprecated, try this: https://doris.apache.org/docs/dev/lakehouse/multi-catalog -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] support multi add different field for one doc [doris-thirdparty]
amorynan commented on PR #200: URL: https://github.com/apache/doris-thirdparty/pull/200#issuecomment-1999209790 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](mtmv)refresh mtmv must add auto [doris-website]
luzhijing commented on PR #441: URL: https://github.com/apache/doris-website/pull/441#issuecomment-2008987866 En: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 Cn: https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](docs) trim_double_quotes is required when enclose is `"` [doris-website]
luzhijing commented on PR #422: URL: https://github.com/apache/doris-website/pull/422#issuecomment-2008991342 There are some conflicts and please rebase it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](docs) Add example and description in sql function cast [doris-website]
luzhijing commented on PR #437: URL: https://github.com/apache/doris-website/pull/437#issuecomment-2008995300 Thanks for your contributions and would you please add it in branch-2.1? En: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 Cn: https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](docs) fix spelling error of double in release-2.0.3.md [doris-website]
wanghuan2054 commented on PR #434: URL: https://github.com/apache/doris-website/pull/434#issuecomment-2009006231 > Thanks for your contributions, would you please fix it in branch-2.0 and branch-2.1? ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](docs) fix spelling error of double in release-2.0.3.md [doris-website]
luzhijing commented on PR #434: URL: https://github.com/apache/doris-website/pull/434#issuecomment-2009012584 En: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 En: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.0 Cn: https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1 Cn: https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](docs) fix spelling error of double in release-2.0.3.md [doris-website]
wanghuan2054 commented on PR #434: URL: https://github.com/apache/doris-website/pull/434#issuecomment-2009023892 > Thanks for your contributions, would you please fix it in branch-2.0 and branch-2.1? ok -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](docs) Add example and description in sql function cast [doris-website]
AcKing-Sam commented on PR #437: URL: https://github.com/apache/doris-website/pull/437#issuecomment-2009260714 @luzhijing Hi, I have got it! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] “通过外部表同步数据"的CREATE EXTERNAL TABLE 链接为空 [doris-website]
anthony-yau commented on issue #420: URL: https://github.com/apache/doris-website/issues/420#issuecomment-2011657377 > external table is deprecated, try this: https://doris.apache.org/docs/dev/lakehouse/multi-catalog 好的 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [enhance](auth)role/user add comment [doris-website]
luzhijing commented on PR #448: URL: https://github.com/apache/doris-website/pull/448#issuecomment-2012116719 Thanks for your contributions. Does the 2.0 branch also need to be modified? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](doc) fix some typo in data_model section [doris-website]
AcKing-Sam commented on PR #444: URL: https://github.com/apache/doris-website/pull/444#issuecomment-2012118116 > This doc please keep consistent with 2.0-branch. @luzhijing Hi, do you mean adding v2.0's files? In addition, need I remove v2.1's files? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](routine-load-manual) remove invalid url [doris-website]
wanghuan2054 commented on PR #443: URL: https://github.com/apache/doris-website/pull/443#issuecomment-2014100539 > Please fix the chinese docs in master branch. done. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](doc) fix some typo in data_model section [doris-website]
luzhijing commented on PR #444: URL: https://github.com/apache/doris-website/pull/444#issuecomment-2014183867 > > This doc please keep consistent with 2.0-branch. > > @luzhijing Hi, do you mean adding v2.0's files? > > In addition, need I remove v2.1's files? You can refer to the 2.0-branch docs : https://doris.apache.org/docs/2.0/table-design/data-model/overview -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](doc) fix some typo in data_model section [doris-website]
AcKing-Sam commented on PR #444: URL: https://github.com/apache/doris-website/pull/444#issuecomment-2014228676 @luzhijing Done! Thanks for your guide! In addition, I found in v2.0, the [usage guideline section](https://doris.apache.org/docs/2.0/table-design/data-model/tips/) is in the `data-model` part. Which is different from v2.1 and master(usage guideline are parallel to data model). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](mtmv) Support more join types for query rewriting by materialized view [doris-website]
seawinde commented on PR #458: URL: https://github.com/apache/doris-website/pull/458#issuecomment-2014651323 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](fqdn) fix fqdn doc [doris-website]
codegit10001 commented on PR #462: URL: https://github.com/apache/doris-website/pull/462#issuecomment-2017258193 > Please also fix it in cn master-branch and 2.1/2.0 branch. > > CN master branch : https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/current EN 2.0-branch: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.0 EN 2.1-branch: https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 done！ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](VARIANT) Update VARIANT.md [doris-website]
luzhijing commented on PR #470: URL: https://github.com/apache/doris-website/pull/470#issuecomment-2020423797 https://github.com/apache/doris-website/pull/471 #470 has included this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] fix typo [doris-website]
luzhijing commented on PR #480: URL: https://github.com/apache/doris-website/pull/480#issuecomment-2024982582 Thanks for your contribution, please also fix it in branch-2.1/master -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] fix typo [doris-website]
drgnchan commented on PR #480: URL: https://github.com/apache/doris-website/pull/480#issuecomment-2025375829 I don't know if i have missed the corresponding doc during the searching of `best-practice.md` of directory `table-design` in directory `version-2.1` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Enhencement](trino-conenctor) add a document of how to access a new Trino Connector plugin [doris-website]
morningman commented on code in PR #491:
URL: https://github.com/apache/doris-website/pull/491#discussion_r1544259838
##
i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/trino-connector-developer-guide.md:
##
@@ -0,0 +1,161 @@
+---
+{
+"title": "如何接入一个新的 Trino Connector插件",
+"language": "zh-CN"
+}
+---
+
+
+
+# 如何接入一个新的 Trino Connector 插件
+
+## 背景
+
+从 4.0 版本开始，Doris 支持对接 Trino Connector 插件。通过丰富的 Trino Connector 插件以及 Doris 的
`trino-connector` Catalog 功能可以让 Doris 支持更多的数据源。
+
+Trino Connector 兼容框架的目的在于帮助 Doris 快速对接更多的数据源，以满足用户需求。
+对于 Hive、Iceberg、Hudi、Paimon、JDBC 等数据源，我们仍然建议使用 Doris 内置的 Catalog
进行连接，已获得更好的性能、稳定性和兼容性。
+
+本文主要介绍，如何在 Doris 中适配一个 Trino Connector 插件。
+
+下面以 Trino 的 Kafka Connector 插件为例，详细介绍如何在 Doris 中适配 Trino 的 Kafka Connector
插件，然后通过 Doris 的 `trino-connector` Catalog 功能访问 Kafka 数据源。
+
+## 步骤一：编译 Kakfa Connecto 插件
+
+Trino 没有提供官方编译好的 Connector 插件，所以需要我们自己编译所需 Connector 插件。
+
+> 注意：由于 Doris 当前使用 435版本的`trino-main` 包，所以最好编译 435 版本的 Connector 插件。对于非 435
版本的 Connector 插件，可能会存在兼容性问题。如遇问题，欢迎通过社区反馈。
Review Comment:
```suggestion
> 注意：由于 Doris 当前使用 435版本的`trino-main` 包，所以最好编译 435 版本的 Connector 插件。对于非 435
版本的 Connector 插件，可能会存在兼容性问题。如遇问题，欢迎向 Apache Doris 社区反馈。
```
##
i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/trino-connector-developer-guide.md:
##
@@ -0,0 +1,161 @@
+---
+{
+"title": "如何接入一个新的 Trino Connector插件",
+"language": "zh-CN"
+}
+---
+
+
+
+# 如何接入一个新的 Trino Connector 插件
+
+## 背景
+
+从 4.0 版本开始，Doris 支持对接 Trino Connector 插件。通过丰富的 Trino Connector 插件以及 Doris 的
`trino-connector` Catalog 功能可以让 Doris 支持更多的数据源。
+
+Trino Connector 兼容框架的目的在于帮助 Doris 快速对接更多的数据源，以满足用户需求。
+对于 Hive、Iceberg、Hudi、Paimon、JDBC 等数据源，我们仍然建议使用 Doris 内置的 Catalog
进行连接，已获得更好的性能、稳定性和兼容性。
+
+本文主要介绍，如何在 Doris 中适配一个 Trino Connector 插件。
+
+下面以 Trino 的 Kafka Connector 插件为例，详细介绍如何在 Doris 中适配 Trino 的 Kafka Connector
插件，然后通过 Doris 的 `trino-connector` Catalog 功能访问 Kafka 数据源。
+
+## 步骤一：编译 Kakfa Connecto 插件
+
+Trino 没有提供官方编译好的 Connector 插件，所以需要我们自己编译所需 Connector 插件。
+
+> 注意：由于 Doris 当前使用 435版本的`trino-main` 包，所以最好编译 435 版本的 Connector 插件。对于非 435
版本的 Connector 插件，可能会存在兼容性问题。如遇问题，欢迎通过社区反馈。
+
+
+1. 拉取 Trino 源码
+`$ git clone https://github.com/trinodb/trino.git`
+2. 将 Trino 切换到 435 版本
+`$ git checkout 435`
+3. 进入到 Kafka 插件源码目录
+`$ cd trino/plugin/trino-kafka`
+4. 编译 Kafka 插件
+`$ mvn clean install -DskipTest`
+5. 编译完成后，在 trino/plugin/trino-kafka/ 目录下会生成 target/trino-kafka-435 目录
+
+> 注意：每一个 Connector 插件都是一个子目录，而不是一个 jar 包。
+
+## 步骤二：设置 Doris 的 fe.conf / be.conf
+
+准备好 Kafka Connector 插件后，需要配置 Doris 的 fe.conf 、be.conf 从而使得 Doris 能够找到该插件。
+
+我们将上述准备好的 `trino-kafka-435` 目录存放在 /path/to/connectors 目录下，然后我们配置：
+
+1. fe.conf
+
+在 fe.conf 文件中配置 `trino_connector_plugin_dir=/path/to/connectors`
（若fe.conf中没有配置 `trino_connector_plugin_dir` 属性，则默认使用
`${Doris_HOME}/fe/connectors` 目录）
+
+2. be.conf
+
+在 be.conf 文件中配置 `trino_connector_plugin_dir=/path/to/connectors` （若
be.conf 中没有配置 `trino_connector_plugin_dir` 属性 ，则默认使用
`${Doris_HOME}/be/connectors` 目录）
+
+> 注意：Doris 采用懒加载的方式加载 Trino Connector 插件，这意味着如果是第一次在 Doris 中使用trino-connector
Catalog 功能，是无需重启 FE / BE 节点的，Doris 会自动加载插件。但是插件只会加载一次，所以如果
`/path/to/connectors/` 目录下插件发生了变化，需要重启 FE / BE 节点，才可以加载变化后的插件。
+
+## 步骤三：使用 trino-connector Catalog 功能
+
+完成前面两个步骤后，我们就可以在 Doris 中使用 trino-connector Catalog 功能了。
Review Comment:
```suggestion
完成前面两个步骤后，我们就可以在 Doris 中使用 Trino-Connector Catalog 功能了。
```
##
i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/trino-connector-developer-guide.md:
##
@@ -0,0 +1,161 @@
+---
+{
+"title": "如何接入一个新的 Trino Connector插件",
+"language": "zh-CN"
+}
+---
+
+
+
+# 如何接入一个新的 Trino Connector 插件
+
+## 背景
+
+从 4.0 版本开始，Doris 支持对接 Trino Connector 插件。通过丰富的 Trino Connector 插件以及 Doris 的
`trino-connector` Catalog 功能可以让 Doris 支持更多的数据源。
+
+Trino Connector 兼容框架的目的在于帮助 Doris 快速对接更多的数据源，以满足用户需求。
+对于 Hive、Iceberg、Hudi、Paimon、JDBC 等数据源，我们仍然建议使用 Doris 内置的 Catalog
进行连接，已获得更好的性能、稳定性和兼容性。
+
+本文主要介绍，如何在 Doris 中适配一个 Trino Connector 插件。
+
+下面以 Trino 的 Kafka Connector 插件为例，详细介绍如何在 Doris 中适配 Trino 的 Kafka Connector
插件，然后通过 Doris 的 `trino-connector` Catalog 功能访问 Kafka 数据源。
Review Comment:
增加一行说明：
> 注：Trino 是一款由 [Trino 软件基金会](https://trino.io/foundation) 提供的 Apache License
2.0 协议开源软件，详情可访问 [Trino 官网](trino.io)
##
i18n/zh-CN/docusaurus-plugin-content-docs-community/current/how-to-contribute/trino-connector-developer-guide.md:
##
@@ -0,0 +1,161 @@
+---
+{
+"title": "如何接入一个新的 Trino Connector插件",
+"language": "zh-CN"
+}
+---
+
+
+
+# 如何接入一个新的 Trino Connector 插件
+
+## 背景
+
+从 4.0 版本开始，Doris 支持对接 Trino Connector 插件。通过丰富的 Trino Connector 插件以及 Doris 的
`trino-connector` Catalog 功能可以让 Doris 支持更多的数据源。
+
+Trino Connector 兼容框架的目的在于帮助 Doris 快速对接更多的数据源，以满足用户需求。
+对于 Hive、Iceberg、Hudi、Paimon、JDBC 等数据源，我们仍然建议使用 Doris 内置的 Catalog
进行连接，已获得更好的性能、稳定性和兼容性。
+
+本文主要介绍，如何在 Doris 中适配一个 Trino Connector 插件
Re: [PR] fix typo [doris-website]
luzhijing commented on PR #480: URL: https://github.com/apache/doris-website/pull/480#issuecomment-2027329942 https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1 https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](benchmark) update tpch benchmark. [doris-website]
luzhijing commented on PR #495: URL: https://github.com/apache/doris-website/pull/495#issuecomment-2027330651 https://github.com/apache/doris-website/tree/master/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1 https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1 Please also update the docs of branch-2.1 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Enhencement](trino-conenctor) add a document of how to access a new Trino Connector plugin [doris-website]
luzhijing commented on PR #491: URL: https://github.com/apache/doris-website/pull/491#issuecomment-2027333742 Some conflicts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] “通过外部表同步数据"的CREATE EXTERNAL TABLE 链接为空 [doris-website]
luzhijing closed issue #420: “通过外部表同步数据"的CREATE EXTERNAL TABLE 链接为空 URL: https://github.com/apache/doris-website/issues/420 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [typo](doc) current_date has supported in column definition [doris-website]
yagagagaga commented on PR #517: URL: https://github.com/apache/doris-website/pull/517#issuecomment-2041813296 2.1 还不支持这个功能，所以只更新 dev 文档 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](docs) add a tip for hive catalog [doris-website]
luzhijing commented on code in PR #518: URL: https://github.com/apache/doris-website/pull/518#discussion_r1555202206 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/multi-catalog/hive.md: ## @@ -36,6 +36,7 @@ under the License. 2. hive 支持 1/2/3 版本。 3. 支持 Managed Table 和 External Table，支持部分 Hive View。 4. 可以识别 Hive Metastore 中存储的 hive、iceberg、hudi 元数据。 +5. 如果 hadoop 节点配置了 hostname，请确保添加对应的映射关系到 /etc/hosts 文件。 Review Comment: Hadoop 首字母大写 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](docs) add a tip for hive catalog [doris-website]
yagagagaga commented on code in PR #518: URL: https://github.com/apache/doris-website/pull/518#discussion_r1555655851 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/multi-catalog/hive.md: ## @@ -36,6 +36,7 @@ under the License. 2. hive 支持 1/2/3 版本。 3. 支持 Managed Table 和 External Table，支持部分 Hive View。 4. 可以识别 Hive Metastore 中存储的 hive、iceberg、hudi 元数据。 +5. 如果 hadoop 节点配置了 hostname，请确保添加对应的映射关系到 /etc/hosts 文件。 Review Comment: Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] add strcmp doc [doris-website]
xiedeyantu commented on PR #530: URL: https://github.com/apache/doris-website/pull/530#issuecomment-2046516247 doc for https://github.com/apache/doris/pull/33272 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] add strcmp doc [doris-website]
luzhijing commented on PR #530: URL: https://github.com/apache/doris-website/pull/530#issuecomment-2049158471 Please add it in sidebar.json -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc] function quote update [doris-website]
luzhijing commented on PR #531: URL: https://github.com/apache/doris-website/pull/531#issuecomment-2049167209 Please add it in sidebar.json -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] variant aggregation model supported [doris-website]
luzhijing commented on PR #536: URL: https://github.com/apache/doris-website/pull/536#issuecomment-2049184029 Please also fix it in CN docs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] add strcmp doc [doris-website]
xiedeyantu commented on PR #530: URL: https://github.com/apache/doris-website/pull/530#issuecomment-2049288855 > Please add it in sidebar.json @luzhijing done, please review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [docs](fix)Update first_last_value doc [doris-website]
zclllyybb commented on code in PR #550: URL: https://github.com/apache/doris-website/pull/550#discussion_r1564538966 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/sql-manual/sql-functions/window-functions/window-function-first-value.md: ## @@ -14,10 +14,10 @@ Unless required by applicable law or agreed to in writing, software distributed ## WINDOW FUNCTION FIRST_VALUE ### description -FIRST_VALUE() 返回窗口范围内的第一个值。 +FIRST_VALUE() 返回窗口范围内的第一个值，ignore_null决定是否忽略null值。 ```sql -FIRST_VALUE(expr) OVER(partition_by_clause order_by_clause [window_clause]) +FIRST_VALUE(expr, ignore_null) OVER(partition_by_clause order_by_clause [window_clause]) Review Comment: 我们现在是否还支持一个入参的first_value函数？如果没有第二个参数是什么行为 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/sql-manual/sql-functions/window-functions/window-function-first-value.md: ## @@ -14,10 +14,10 @@ Unless required by applicable law or agreed to in writing, software distributed ## WINDOW FUNCTION FIRST_VALUE ### description -FIRST_VALUE() 返回窗口范围内的第一个值。 +FIRST_VALUE() 返回窗口范围内的第一个值，ignore_null决定是否忽略null值。 Review Comment: ```suggestion FIRST_VALUE() 返回窗口范围内的第一个值，ignore_null 决定是否忽略 null 值。 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [docs](fix)Update first_last_value doc [doris-website]
zclllyybb commented on code in PR #550: URL: https://github.com/apache/doris-website/pull/550#discussion_r1564587761 ## i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/sql-manual/sql-functions/window-functions/WINDOW-FUNCTION-LAST-VALUE.md: ## @@ -14,30 +14,37 @@ Unless required by applicable law or agreed to in writing, software distributed ## WINDOW FUNCTION LAST_VALUE ### description Review Comment: 2.0版本文档，在这下面加版本信息，ignore_null从2.0.9开始支持 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] Bump com.fasterxml.jackson.core:jackson-databind from 2.13.2.1 to 2.13.4.2 [doris-kafka-connector]
dependabot[bot] commented on PR #3: URL: https://github.com/apache/doris-kafka-connector/pull/3#issuecomment-2054333604 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] Bump commons-io:commons-io from 2.3 to 2.7 [doris-kafka-connector]
dependabot[bot] commented on PR #2: URL: https://github.com/apache/doris-kafka-connector/pull/2#issuecomment-2054333825 OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting `@dependabot ignore this major version` or `@dependabot ignore this minor version`. If you change your mind, just re-open this PR and I'll resolve any conflicts on it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[I] doris-1.2 CREATE-EXTERNAL-TABLE page could not be found [doris-website]
comuser123 opened a new issue, #557: URL: https://github.com/apache/doris-website/issues/557 Your question: This page could not be found Link address: https://doris.apache.org/zh-CN/docs/1.2/sql-manual/sql-reference/Data-Definition-Statements/Create/CREATE-EXTERNAL-TABLE.md -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](function) Support hll_from_base64, hll_to_base64, group_array_intersect functions [doris-website]
luzhijing commented on PR #560: URL: https://github.com/apache/doris-website/pull/560#issuecomment-2058881896 Please update sidebar.json ( https://github.com/apache/doris-website/blob/master/sidebars.json ) and version-2.1-sidebars.json ( https://github.com/apache/doris-website/blob/master/versioned_sidebars/version-2.1-sidebars.json ) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](function) Support agg foreach [doris-website]
luzhijing commented on PR #561: URL: https://github.com/apache/doris-website/pull/561#issuecomment-2058886208 Please add EN docs in 2.1-branch https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1/sql-manual/sql-functions/aggregate-functions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](pred) Support xor function [doris-website]
luzhijing commented on PR #562: URL: https://github.com/apache/doris-website/pull/562#issuecomment-2058887829 Please add EN docs in 2.1-branch https://github.com/apache/doris-website/tree/master/versioned_docs/version-2.1/sql-manual/sql-functions/numeric-functions -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](pred) Support xor function [doris-website]
luzhijing commented on PR #562: URL: https://github.com/apache/doris-website/pull/562#issuecomment-2059241156 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](fix)delete the description of array_agg on 2.0 [doris-website]
luzhijing commented on PR #572: URL: https://github.com/apache/doris-website/pull/572#issuecomment-2065691368 Please also change the 2.0 sidebar.json -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](java-udtf) support java-udtf [doris-website]
luzhijing commented on code in PR #569: URL: https://github.com/apache/doris-website/pull/569#discussion_r1571731870 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/udf/java-user-defined-function.md: ## @@ -324,11 +333,40 @@ CREATE AGGREGATE FUNCTION middle_quantiles(DOUBLE,INT) RETURNS DOUBLE PROPERTIES ); ``` + + +## 编写 UDTF 函数 + +UDTF 和 UDF 函数一样，需要用户自主实现一个 `evaluate` 方法， 但是UDTF函数的返回值必须是array类型。 +另外Doris中表函数会因为_outer后缀有不同的表现，可查看[OUTER组合器](https://doris.apache.org/zh-CN/docs/dev/sql-manual/sql-functions/table-functions/explode-numbers-outer) Review Comment: 使用相对路径即可，[Outer 组合器](../sql-manual/sql-functions/table-functions/explode-numbers-outer) ## i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/udf/java-user-defined-function.md: ## @@ -324,11 +333,40 @@ CREATE AGGREGATE FUNCTION middle_quantiles(DOUBLE,INT) RETURNS DOUBLE PROPERTIES ); ``` + + +## 编写 UDTF 函数 + +UDTF 和 UDF 函数一样，需要用户自主实现一个 `evaluate` 方法， 但是UDTF函数的返回值必须是array类型。 Review Comment: 中文文档在英文和字母前后加空格，Array 首字母大写 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](java-udtf) support java-udtf [doris-website]
luzhijing commented on code in PR #569: URL: https://github.com/apache/doris-website/pull/569#discussion_r1571731870 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/ecosystem/udf/java-user-defined-function.md: ## @@ -324,11 +333,40 @@ CREATE AGGREGATE FUNCTION middle_quantiles(DOUBLE,INT) RETURNS DOUBLE PROPERTIES ); ``` + + +## 编写 UDTF 函数 + +UDTF 和 UDF 函数一样，需要用户自主实现一个 `evaluate` 方法， 但是UDTF函数的返回值必须是array类型。 +另外Doris中表函数会因为_outer后缀有不同的表现，可查看[OUTER组合器](https://doris.apache.org/zh-CN/docs/dev/sql-manual/sql-functions/table-functions/explode-numbers-outer) Review Comment: 使用相对路径即可，路径地址使用 ../sql-manual/sql-functions/table-functions/explode-numbers-outer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] doris-1.2 CREATE-EXTERNAL-TABLE page could not be found [doris-website]
luzhijing commented on issue #557: URL: https://github.com/apache/doris-website/issues/557#issuecomment-2065701271 Thanks for your issue. The external table no longer maintained, and it is recommended to use Multi-Catalog as a replacement from version 1.2 onwards. https://doris.apache.org/zh-CN/docs/1.2/sql-manual/sql-reference/Data-Definition-Statements/Create/CREATE-CATALOG -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [opt](standard95) the ‘standard95’ tokenizer does not include stop wo… [doris-thirdparty]
zzzxl1993 commented on PR #209: URL: https://github.com/apache/doris-thirdparty/pull/209#issuecomment-2065868550 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](function) Support Hive Hll UDFs [doris-website]
superdiaodiao commented on PR #578: URL: https://github.com/apache/doris-website/pull/578#issuecomment-2067808402 > Please add the EN docs and update sibebar.json OK, I will proceed this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [opt](standard95) the "standard95" tokenizer can be configured to disable stop words. [doris-thirdparty]
zzzxl1993 commented on PR #209: URL: https://github.com/apache/doris-thirdparty/pull/209#issuecomment-2068858122 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](partition) Refactor dynamic partition docs [doris-website]
luzhijing commented on PR #592: URL: https://github.com/apache/doris-website/pull/592#issuecomment-2081346018 There are some conflicts and please resolve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] change document for superset [doris-website]
luzhijing commented on PR #589: URL: https://github.com/apache/doris-website/pull/589#issuecomment-2081346115 There are some conflicts and please resolve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] check document for power bi [doris-website]
luzhijing commented on PR #585: URL: https://github.com/apache/doris-website/pull/585#issuecomment-2081346324 There are some conflicts and please resolve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](udf) add some doc about java-udf handle static load [doris-website]
luzhijing commented on PR #583: URL: https://github.com/apache/doris-website/pull/583#issuecomment-2081346469 There are some conflicts and please resolve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](fix)map "Row" of Paimon to "Struct" of Doris [doris-website]
luzhijing commented on PR #577: URL: https://github.com/apache/doris-website/pull/577#issuecomment-2081349273 There are some conflicts and please resolve it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](iceberg) fix iceberg column type map error. [doris-website]
maruyue commented on code in PR #567: URL: https://github.com/apache/doris-website/pull/567#discussion_r1582443778 ## docs/lakehouse/datalake-analytics/iceberg.md: ## @@ -31,6 +31,7 @@ under the License. 1. Support Iceberg V1/V2. 2. The V2 format only supports Position Delete, not Equality Delete. +3. Supports Parquet format. And ORC format since 2.1.3. Review Comment: 3. Support Parquet and ORC format since 2.1.3. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](iceberg) fix iceberg column type map error. [doris-website]
morningman commented on code in PR #567: URL: https://github.com/apache/doris-website/pull/567#discussion_r1582707841 ## docs/lakehouse/datalake-analytics/iceberg.md: ## @@ -31,6 +31,7 @@ under the License. 1. Support Iceberg V1/V2. 2. The V2 format only supports Position Delete, not Equality Delete. +3. Supports Parquet format. And ORC format since 2.1.3. Review Comment: Already support Parquet. ORC is since 2.1.3. I will separate them in 2 lines -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](inverted index) special characters cause buffer overflow in Uni… [doris-thirdparty]
zzzxl1993 commented on PR #210: URL: https://github.com/apache/doris-thirdparty/pull/210#issuecomment-2082182207 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](iceberg) fix iceberg column type map error. [doris-website]
morningman commented on code in PR #567: URL: https://github.com/apache/doris-website/pull/567#discussion_r1582727453 ## docs/lakehouse/datalake-analytics/iceberg.md: ## @@ -31,6 +31,7 @@ under the License. 1. Support Iceberg V1/V2. 2. The V2 format only supports Position Delete, not Equality Delete. +3. Supports Parquet format. And ORC format since 2.1.3. Review Comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](inverted index) special characters cause buffer overflow in Uni… [doris-thirdparty]
zzzxl1993 commented on PR #210: URL: https://github.com/apache/doris-thirdparty/pull/210#issuecomment-2082282258 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](inverted index) special characters cause buffer overflow in Unicode tokenization. [doris-thirdparty]
zzzxl1993 commented on PR #211: URL: https://github.com/apache/doris-thirdparty/pull/211#issuecomment-2088006987 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [docs](fix) Fix Compilation on MacOS [doris-website]
CodePrometheus commented on PR #609: URL: https://github.com/apache/doris-website/pull/609#issuecomment-2092347176 Hi @luzhijing PTAL, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Doc](txn-insert) Add txn-insert doc [doris-website]
luzhijing commented on PR #604: URL: https://github.com/apache/doris-website/pull/604#issuecomment-2093926595 @dataroaring PTAL. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](auth) refactor authentication and authorization doc [doris-website]
luzhijing commented on code in PR #611:
URL: https://github.com/apache/doris-website/pull/611#discussion_r1590298428
##
docs/admin-manual/auth/authentication-and-authorization.md:
##
@@ -0,0 +1,395 @@
+---
+{
+"title": "Authentication and Authorization",
+"language": "en"
+}
+---
+
+
+
+The Doris permission management system is modeled after the MySQL permission
management mechanism. It supports fine-grained permission control at the row
and column level, role-based access control, and also supports a whitelist
mechanism.
+
+## Glossary
+
+1. User Identity
+
+ Within a permission system, a user is identified as a User Identity. A User
Identity consists of two parts: `username` and `host`. The `username` is the
user's name, consisting of English letters (both uppercase and lowercase).
`host` represents the IP from which the user connection originates. User
Identity is represented as `username@'host'`, indicating `username` from `host`.
+
+ Another representation of User Identity is `username@['domain']`, where
`domain` refers to a domain name that can be resolved into a set of IPs through
DNS. Eventually, this is represented as a set of `username@'host'`, hence
moving forward, we uniformly use `username@'host'` to denote it.
+
+2. Privilege
+
+ Privileges apply to nodes, data directories, databases, or tables.
Different privileges represent different operation permissions.
+
+3. Role
+
+ Doris allows the creation of custom-named roles. A role can be viewed as a
collection of privileges. Newly created users can be assigned a role,
automatically inheriting the privileges of that role. Subsequent changes to the
role's privileges will also reflect on the permissions of all users associated
with that role.
+
+4. User Property
+
+ User properties are directly affiliated with a user, not the User Identity.
Meaning, both `user@'192.%'` and `user@['domain']` share the same set of user
properties, which belong to the user `user`, not to `user@'192.%'` or
`user@['domain']`.
+
+ User properties include but are not limited to: maximum number of user
connections, import cluster configurations, etc.
+
+## Authentication and Authorization Framework
+
+The process of a user logging into Apache Doris is divided into two parts:
**Authentication** and **Authorization**.
+
+- Authentication: Identity verification is conducted based on the credentials
provided by the user (such as username, client IP, password). Once verified,
the individual user is mapped to a system-defined User Identity.
+- Authorization: Based on the acquired User Identity, it checks whether the
user has the necessary permissions for the intended operations, according to
the privileges associated with that User Identity.
+
+## Authentication
+
+Doris supports built-in authentication schemes as well as LDAP authentication.
+
+### Doris Built-in Authentication Scheme
+
+Authentication is based on usernames, passwords, and other information stored
within Doris itself.
+
+Administrators create users with the `CREATE USER` command and view all
created users with the `SHOW ALL GRANTS` command.
+
+When a user logs in, the system verifies whether the username, password, and
client IP address are correct.
+
+ Password Policy
+
+Doris supports the following password policies to assist users in better
password management.
+
+1. `PASSWORD_HISTORY`
+
+Determines whether a user can reuse a historical password when resetting
their current password. For example, `PASSWORD_HISTORY 10` means the last 10
passwords cannot be reused as a new password. Setting `PASSWORD_HISTORY
DEFAULT` will use the value from the global variable `password_history`. A
setting of 0 disables this feature. The default is 0.
+
+Examples:
+
+- Set a global variable: `SET GLOBAL password_history = 10`
+- Set for a user: `ALTER USER user1@'ip' PASSWORD_HISTORY 10`
+
+2. `PASSWORD_EXPIRE`
+
+Sets the expiration time for the current user's password. For instance,
`PASSWORD_EXPIRE INTERVAL 10 DAY` means the password will expire after 10 days.
`PASSWORD_EXPIRE NEVER` indicates the password never expires. Setting
`PASSWORD_EXPIRE DEFAULT` will use the value from the global variable
`default_password_lifetime` (in days). The default is NEVER (or 0), indicating
it does not expire.
+
+Examples:
+
+- Set a global variable: `SET GLOBAL default_password_lifetime = 1`
+- Set for a user: `ALTER USER user1@'ip' PASSWORD_EXPIRE INTERVAL 10 DAY`
+
+3. `FAILED_LOGIN_ATTEMPTS` and `PASSWORD_LOCK_TIME`
+
+Configures the number of incorrect password attempts after which the user
account will be locked and sets the lock duration. For example,
`FAILED_LOGIN_ATTEMPTS 3 PASSWORD_LOCK_TIME 1 DAY` means if there are 3
incorrect logins, the account will be locked for one day. Administrators can
unlock the account using the `ALTER USER` statement.
+
+Example:
+
+- Set for a user: `ALTER USER user1@'ip' F
Re: [PR] [doc](auth) refactor authentication and authorization doc [doris-website]
morningman commented on code in PR #611:
URL: https://github.com/apache/doris-website/pull/611#discussion_r1590691122
##
docs/admin-manual/auth/authentication-and-authorization.md:
##
@@ -0,0 +1,395 @@
+---
+{
+"title": "Authentication and Authorization",
+"language": "en"
+}
+---
+
+
+
+The Doris permission management system is modeled after the MySQL permission
management mechanism. It supports fine-grained permission control at the row
and column level, role-based access control, and also supports a whitelist
mechanism.
+
+## Glossary
+
+1. User Identity
+
+ Within a permission system, a user is identified as a User Identity. A User
Identity consists of two parts: `username` and `host`. The `username` is the
user's name, consisting of English letters (both uppercase and lowercase).
`host` represents the IP from which the user connection originates. User
Identity is represented as `username@'host'`, indicating `username` from `host`.
+
+ Another representation of User Identity is `username@['domain']`, where
`domain` refers to a domain name that can be resolved into a set of IPs through
DNS. Eventually, this is represented as a set of `username@'host'`, hence
moving forward, we uniformly use `username@'host'` to denote it.
+
+2. Privilege
+
+ Privileges apply to nodes, data directories, databases, or tables.
Different privileges represent different operation permissions.
+
+3. Role
+
+ Doris allows the creation of custom-named roles. A role can be viewed as a
collection of privileges. Newly created users can be assigned a role,
automatically inheriting the privileges of that role. Subsequent changes to the
role's privileges will also reflect on the permissions of all users associated
with that role.
+
+4. User Property
+
+ User properties are directly affiliated with a user, not the User Identity.
Meaning, both `user@'192.%'` and `user@['domain']` share the same set of user
properties, which belong to the user `user`, not to `user@'192.%'` or
`user@['domain']`.
+
+ User properties include but are not limited to: maximum number of user
connections, import cluster configurations, etc.
+
+## Authentication and Authorization Framework
+
+The process of a user logging into Apache Doris is divided into two parts:
**Authentication** and **Authorization**.
+
+- Authentication: Identity verification is conducted based on the credentials
provided by the user (such as username, client IP, password). Once verified,
the individual user is mapped to a system-defined User Identity.
+- Authorization: Based on the acquired User Identity, it checks whether the
user has the necessary permissions for the intended operations, according to
the privileges associated with that User Identity.
+
+## Authentication
+
+Doris supports built-in authentication schemes as well as LDAP authentication.
+
+### Doris Built-in Authentication Scheme
+
+Authentication is based on usernames, passwords, and other information stored
within Doris itself.
+
+Administrators create users with the `CREATE USER` command and view all
created users with the `SHOW ALL GRANTS` command.
+
+When a user logs in, the system verifies whether the username, password, and
client IP address are correct.
+
+ Password Policy
+
+Doris supports the following password policies to assist users in better
password management.
+
+1. `PASSWORD_HISTORY`
+
+Determines whether a user can reuse a historical password when resetting
their current password. For example, `PASSWORD_HISTORY 10` means the last 10
passwords cannot be reused as a new password. Setting `PASSWORD_HISTORY
DEFAULT` will use the value from the global variable `password_history`. A
setting of 0 disables this feature. The default is 0.
+
+Examples:
+
+- Set a global variable: `SET GLOBAL password_history = 10`
+- Set for a user: `ALTER USER user1@'ip' PASSWORD_HISTORY 10`
+
+2. `PASSWORD_EXPIRE`
+
+Sets the expiration time for the current user's password. For instance,
`PASSWORD_EXPIRE INTERVAL 10 DAY` means the password will expire after 10 days.
`PASSWORD_EXPIRE NEVER` indicates the password never expires. Setting
`PASSWORD_EXPIRE DEFAULT` will use the value from the global variable
`default_password_lifetime` (in days). The default is NEVER (or 0), indicating
it does not expire.
+
+Examples:
+
+- Set a global variable: `SET GLOBAL default_password_lifetime = 1`
+- Set for a user: `ALTER USER user1@'ip' PASSWORD_EXPIRE INTERVAL 10 DAY`
+
+3. `FAILED_LOGIN_ATTEMPTS` and `PASSWORD_LOCK_TIME`
+
+Configures the number of incorrect password attempts after which the user
account will be locked and sets the lock duration. For example,
`FAILED_LOGIN_ATTEMPTS 3 PASSWORD_LOCK_TIME 1 DAY` means if there are 3
incorrect logins, the account will be locked for one day. Administrators can
unlock the account using the `ALTER USER` statement.
+
+Example:
+
+- Set for a user: `ALTER USER user1@'ip'
Re: [PR] [dosc]add workload schedule policy document [doris-website]
morningman commented on code in PR #614:
URL: https://github.com/apache/doris-website/pull/614#discussion_r1591163404
##
versioned_sidebars/version-2.1-sidebars.json:
##
@@ -321,7 +321,8 @@
"items": [
"admin-manual/resource-admin/workload-group",
"admin-manual/resource-admin/multi-tenant",
-"admin-manual/resource-admin/compute-node"
Review Comment:
I think we should put workload related doc together, in order
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-schedule-policy.md:
##
@@ -0,0 +1,175 @@
+---
+{
+"title": "Workload Schedule Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD SCHEDULE POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Schedule
Policy的功能，支持查询负载管理的自动化，比如实现自动cancel运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Schedule Policy的语法
+```
+create workload schedule policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Scheduler Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+* actions，当policy被触发时所采取的动作，比如可以cancel
query，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_cancel_policy的policy，它会cancel掉集群中运行时间超过1s的查询，当前状态为启用。
+
+### 基本用法
+由于action的行为有的只能在FE生效，有的只能在BE生效，因此policy本身也有FE和BE的区别。
+
+ 适用于FE的policy
+# Condition
+* username，当一个查询的username为某个值时，就会触发相应的action
+# Action
+* set_session_variable，这个action可以执行一条set session
variable的语句。同一个policy可以有多个set_session_variable，也就是说一个policy可以执行多个修改session变量的语句。
+
+适用于FE的policy主要是用于修改某个user的session变量，目前不支持set global的用法。
+
+ 适用于BE的policy
+# Condition
+* be_scan_rows，一个sql在单个BE进程内scan的行数，如果有多个并发那就是多个并发的累加值。
+* be_scan_bytes，一个sql在单个BE进程内scan的字节数，如果有多个并发那么就是多个并发的累加值。
+* query_time，一个sql在单个BE进程上的运行时间，时间单位是毫秒。
+
+# Action
+* cancel_query，cancel查询。
+
+目前BE的policy主要是用于BE负载的管理，比如当某个query的scan数据量过大或者查询时间过长，就cancel这个query。
+
+ 属性
+* enabled，取值为true或false，默认值为true，表示当前policy处于启用状态，false表示当前policy处于禁用状态。
+*
priority，取值范围为0到100的正整数，默认值为0，代表policy的优先级，该值越大，优先级越高。这个属性的主要作用是，当匹配到多个policy时，选择优先级最高的policy。
+
+ 注意事项
+1
同一个policy的condition和action要么都是FE的，要么都是BE的，比如set_session_variable和cancel_query无法配置到同一个policy中。condition
be_scan_rows和condition username无法配置到同一个policy中。
+
+2
由于目前的policy是异步线程以固定时间间隔执行的，因此策略的生效存在一定的滞后性。比如用户配置了scan行数大于100万就cancel查询的策略，如果此时集群资源比较空闲，那么有可能在cancel策略生效之前查询就已经结束了。目前这个时间间隔为500ms，这意味着运行时间过短的查询可能会绕过策略的检查。
+
+3 当前支持的负载类型包括select/insert select/stream load/broker load/routine load。
+
+4 一个查询可能匹配到多个policy，但是只有优先级最高的policy会生效。
+
+5 目前不支持action和condition的修改，只能通过删除新建的方式修改。
+
+### 常见用法
+1 将用户名为admin的所有session变量中的workload group修改为normal
+```
+create workload schedule policy test_set_var_policy
+conditions(username='admin')
+actions(set_session_variable 'workload_group=normal')
+```
+
+2 cancel所有单个be上scan行数大于1000行的sql
+```
+create workload schedule policy test_cancel_query
+conditions(be_scan_rows > 1000)
+actions(cancel_query)
+```
+
+3 cancel所有scan字节数大于5G且运行时间超过1s的sql
+```
+create workload schedule policy test_cancel_big_query
+conditions(query_time > 1000, be_scan_bytes > 5368709120)
+actions(cancel_query)
+```
+
+4 修改属性
+```
+alter workload schedule policy test_cancel_big_query
properties('enabled'='false');
+```
+
+5 查看已创建的policy
+```
+mysql [(none)]>show workload schedule policy;
Review Comment:
这里为啥不是系统表？
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-schedule-policy.md:
##
@@ -0,0 +1,175 @@
+---
+{
+"title": "Workload Schedule Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD SCHEDULE POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Schedule
Policy的功能，支持查询负载管理的自动化，比如实现自动cancel运行时间超过5s的查询这样的功能。
Review Comment:
```suggestion
因此Doris实现了Workload Schedule Policy的功能，支持查询负载管理的自动化，比如实现自动取消运行时间超过5s的查询这样的功能。
```
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-schedule-policy.md:
##
@@ -0,0 +1,175 @@
+---
+{
+"title": "Workload Schedule Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD SCHEDULE POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Schedule
Policy的功能，支持查询负载管理的自动化，比如实现自动cancel运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Schedule Policy的语法
+```
+create workload schedule policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Scheduler Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions
Re: [PR] [Doc](txn-insert) Add txn-insert doc [doris-website]
morningman commented on code in PR #604:
URL: https://github.com/apache/doris-website/pull/604#discussion_r1591198774
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/transaction-load-manual.md:
##
@@ -0,0 +1,376 @@
+---
+{
+"title": "Transaction Load",
+"language": "zh-CN"
+}
+---
+
+
+
+事务是指一个操作，包含一个或多个SQL语句，这些语句的执行要么完全成功，要么完全失败，是一个不可分割的工作单位。
+
+## 显式事务和隐式事务
+
+### 显式事务
+
+显式事务需要用户主动的开启，提交或回滚事务。 在 Doris 中，提供了 2 种显式事务：
+
+1. 本文中介绍的事务写方式，即
+
+```sql
+begin;
+[INSERT, UPDATE, DELETE statement]
+COMMIT; / ROLLBACK;
+```
+
+2. [Stream Load 2PC](load-atomicity.md#stream-load)
+
+### 隐式事务
+
+隐式事务是指用户在所执行的一条或多条SQL语句的前后，没有显式添加开启事务和提交事务的语句。
+
+在 Doris 中，除[Group
Commit](group-commit-manual.md)外，每个导入语句在开始执行时都会开启一个事务，并且在该语句执行完成之后，自动提交该事务；或执行失败后，自动回滚该事务。更多详细信息请参考:
[导入事务与原子性](load-atomicity.md)。
+
+## 事务操作
+
+### 开启事务
+
+```sql
+BEGIN;
+
+BEGIN WITH LABEL {user_label};
+```
+
+如果执行该语句时，当前 Session 正处于一个事务的中间过程，那么 Doris 会忽略该语句，也可以理解为事务是不能嵌套的。
+
+### 提交事务
+
+```sql
+COMMIT;
+```
+
+用于提交在当前事务中进行的所有修改。
+
+### 回滚事务
+
+```sql
+ROLLBACK;
+```
+
+用于撤销当前事务的所有修改。
+
+事务是 Session 级别的，如果 Session 中止或关闭，也会自动回滚该事务。
+
+## 事务写入
+
+目前 Doris 中支持 2 种方式的事务写入。
+
+### 单表多次`INSERT INTO VALUES`写入
+
+假如表的结构为：
+
+```sql
+CREATE TABLE `dt` (
+`id` int(11) NOT NULL,
+`name` varchar(50) NULL,
+`score` int(11) NULL
+) ENGINE=OLAP
+UNIQUE KEY(`id`)
+DISTRIBUTED BY HASH(`id`) BUCKETS 1
+PROPERTIES (
+"replication_num" = "1"
+);
+```
+
+写入：
+
+```sql
+mysql> BEGIN;
+Query OK, 0 rows affected (0.01 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':''}
+
+mysql> INSERT INTO dt (id, name, score) VALUES (1, "Emily", 25), (2,
"Benjamin", 35), (3, "Olivia", 28), (4, "Alexander", 60), (5, "Ava", 17);
+Query OK, 5 rows affected (0.08 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':'10013'}
+
+mysql> INSERT INTO dt VALUES (6, "William", 69), (7, "Sophia", 32), (8,
"James", 64), (9, "Emma", 37), (10, "Liam", 64);
+Query OK, 5 rows affected (0.00 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':'10013'}
+
+mysql> COMMIT;
+Query OK, 0 rows affected (1.02 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'VISIBLE',
'txnId':'10013'}
+```
+
+这种写入方式不仅可以实现写入的原子性，而且在 Doris 中，能提升 `INSERT INTO VALUES` 的写入性能。
+
+如果用户同时开启了 Group Commit 和事务写，事务写生效。
+
+也可以参考 [Insert Into](load-atomicity.md#insert-into)获取更多信息。
+
+### 多表多次`INSERT INTO SELECT`, `UPDATE`, `DELETE`写入
+
+假设有`dt1`, `dt2`, `dt3` 3 张表，表结构同上，表中数据为：
+
+```sql
+mysql> select * from dt1;
++--+---+---+
+| id | name | score |
++--+---+---+
+|1 | Emily |25 |
+|2 | Benjamin |35 |
+|3 | Olivia|28 |
+|4 | Alexander |60 |
+|5 | Ava |17 |
++--+---+---+
+5 rows in set (0.04 sec)
+
+mysql> select * from dt2;
++--+-+---+
+| id | name| score |
++--+-+---+
+|6 | William |69 |
+|7 | Sophia |32 |
+|8 | James |64 |
+|9 | Emma|37 |
+| 10 | Liam|64 |
++--+-+---+
+5 rows in set (0.03 sec)
+
+mysql> select * from dt3;
+Empty set (0.03 sec)
+```
+
+做事务写入，把`dt1`和`dt2`的数据写入到`dt3`中，同时，对`dt1`表中的分数进行更新，`dt2`表中的数据进行删除：
+
+```sql
+mysql> BEGIN;
+Query OK, 0 rows affected (0.00 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'PREPARE',
'txnId':''}
+
+# 导入任务的状态是 PREPARE
+mysql> INSERT INTO dt3 SELECT * from dt1;
+Query OK, 5 rows affected (0.07 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'PREPARE',
'txnId':'11024'}
+
+mysql> INSERT INTO dt3 SELECT * from dt2;
+Query OK, 5 rows affected (0.08 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'PREPARE',
'txnId':'11025'}
+
+mysql> UPDATE dt1 SET score = score + 10 where id >= 4;
+Query OK, 2 rows affected (0.07 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'PREPARE',
'txnId':'11026'}
+
+mysql> DELETE FROM dt2 WHERE id >= 9;
+Query OK, 0 rows affected (0.01 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'PREPARE',
'txnId':'11027'}
+
+mysql> COMMIT;
+Query OK, 0 rows affected (0.03 sec)
+{'label':'txn_insert_442a6311f6c541ae-b57d7f00fa5db028', 'status':'VISIBLE',
'txnId':'11024'}
+```
+
+查询数据：
+
+```sql
+# id >= 4 的分数加 10
+mysql> select * from dt1;
++--+---+---+
+| id | name | score |
++--+---+---+
+|1 | Emily |25 |
+|2 | Benjamin |35 |
+|3 | Olivia|28 |
+|4 | Alexander |70 |
+|5 | Ava |27 |
++--+---+---+
+5 rows in set (0.01 sec)
+
+# id >= 9 的数据被删除
+mysql> select * from dt2;
++--+-+---+
+| id | name| score |
++--+-+---+
+|6 | William |69 |
+|7 | Sophia |32 |
+|8 | James |64 |
Re: [PR] [dosc]add workload schedule policy document [doris-website]
wangbo commented on code in PR #614:
URL: https://github.com/apache/doris-website/pull/614#discussion_r1591718750
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-schedule-policy.md:
##
@@ -0,0 +1,175 @@
+---
+{
+"title": "Workload Schedule Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD SCHEDULE POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Schedule
Policy的功能，支持查询负载管理的自动化，比如实现自动cancel运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Schedule Policy的语法
+```
+create workload schedule policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Scheduler Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+* actions，当policy被触发时所采取的动作，比如可以cancel
query，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_cancel_policy的policy，它会cancel掉集群中运行时间超过1s的查询，当前状态为启用。
+
+### 基本用法
+由于action的行为有的只能在FE生效，有的只能在BE生效，因此policy本身也有FE和BE的区别。
+
+ 适用于FE的policy
+# Condition
+* username，当一个查询的username为某个值时，就会触发相应的action
+# Action
+* set_session_variable，这个action可以执行一条set session
variable的语句。同一个policy可以有多个set_session_variable，也就是说一个policy可以执行多个修改session变量的语句。
+
+适用于FE的policy主要是用于修改某个user的session变量，目前不支持set global的用法。
+
+ 适用于BE的policy
+# Condition
+* be_scan_rows，一个sql在单个BE进程内scan的行数，如果有多个并发那就是多个并发的累加值。
+* be_scan_bytes，一个sql在单个BE进程内scan的字节数，如果有多个并发那么就是多个并发的累加值。
+* query_time，一个sql在单个BE进程上的运行时间，时间单位是毫秒。
+
+# Action
+* cancel_query，cancel查询。
+
+目前BE的policy主要是用于BE负载的管理，比如当某个query的scan数据量过大或者查询时间过长，就cancel这个query。
+
+ 属性
+* enabled，取值为true或false，默认值为true，表示当前policy处于启用状态，false表示当前policy处于禁用状态。
+*
priority，取值范围为0到100的正整数，默认值为0，代表policy的优先级，该值越大，优先级越高。这个属性的主要作用是，当匹配到多个policy时，选择优先级最高的policy。
+
+ 注意事项
+1
同一个policy的condition和action要么都是FE的，要么都是BE的，比如set_session_variable和cancel_query无法配置到同一个policy中。condition
be_scan_rows和condition username无法配置到同一个policy中。
+
+2
由于目前的policy是异步线程以固定时间间隔执行的，因此策略的生效存在一定的滞后性。比如用户配置了scan行数大于100万就cancel查询的策略，如果此时集群资源比较空闲，那么有可能在cancel策略生效之前查询就已经结束了。目前这个时间间隔为500ms，这意味着运行时间过短的查询可能会绕过策略的检查。
+
+3 当前支持的负载类型包括select/insert select/stream load/broker load/routine load。
+
+4 一个查询可能匹配到多个policy，但是只有优先级最高的policy会生效。
+
+5 目前不支持action和condition的修改，只能通过删除新建的方式修改。
+
+### 常见用法
+1 将用户名为admin的所有session变量中的workload group修改为normal
+```
+create workload schedule policy test_set_var_policy
+conditions(username='admin')
+actions(set_session_variable 'workload_group=normal')
+```
+
+2 cancel所有单个be上scan行数大于1000行的sql
+```
+create workload schedule policy test_cancel_query
+conditions(be_scan_rows > 1000)
+actions(cancel_query)
+```
+
+3 cancel所有scan字节数大于5G且运行时间超过1s的sql
+```
+create workload schedule policy test_cancel_big_query
+conditions(query_time > 1000, be_scan_bytes > 5368709120)
+actions(cancel_query)
+```
+
+4 修改属性
+```
+alter workload schedule policy test_cancel_big_query
properties('enabled'='false');
+```
+
+5 查看已创建的policy
+```
+mysql [(none)]>show workload schedule policy;
++---+--+---+--+--+-+-+
+| Id| Name | Condition | Action | Priority |
Enabled | Version |
++---+--+---+--+--+-+-+
+| 41057 | test_cancel_3s_query | query_time > 3000 | cancel_query | 0|
true| 0 |
++---+--+---+--+--+-+-+
+1 row in set (0.00 sec)
+```
+
+### 效果测试
+ 1 session变量修改测试
+尝试修改admin账户的session变量中的并发相关的参数
+```
+// 登录 admin账户查看并发参数
+mysql [(none)]>show variables like '%parallel_fragment_exec_instance_num%';
++-+---+---+-+
+| Variable_name | Value | Default_Value | Changed |
++-+---+---+-+
+| parallel_fragment_exec_instance_num | 8 | 8 | 0 |
++-+---+---+-+
+1 row in set (0.00 sec)
+
+// 创建修改admin账户并发参数的policy
Review Comment:
这个是修改某个user的session变量的policy，如果user名为admin，那么就修改他的session变量的parallel_fragment_exec_instance_num为1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.
Re: [PR] [Doc](txn-insert) Add txn-insert doc [doris-website]
mymeiyi commented on code in PR #604:
URL: https://github.com/apache/doris-website/pull/604#discussion_r1591722974
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/data-operate/import/transaction-load-manual.md:
##
@@ -0,0 +1,376 @@
+---
+{
+"title": "Transaction Load",
+"language": "zh-CN"
+}
+---
+
+
+
+事务是指一个操作，包含一个或多个SQL语句，这些语句的执行要么完全成功，要么完全失败，是一个不可分割的工作单位。
+
+## 显式事务和隐式事务
+
+### 显式事务
+
+显式事务需要用户主动的开启，提交或回滚事务。 在 Doris 中，提供了 2 种显式事务：
+
+1. 本文中介绍的事务写方式，即
+
+```sql
+begin;
+[INSERT, UPDATE, DELETE statement]
+COMMIT; / ROLLBACK;
+```
+
+2. [Stream Load 2PC](load-atomicity.md#stream-load)
+
+### 隐式事务
+
+隐式事务是指用户在所执行的一条或多条SQL语句的前后，没有显式添加开启事务和提交事务的语句。
+
+在 Doris 中，除[Group
Commit](group-commit-manual.md)外，每个导入语句在开始执行时都会开启一个事务，并且在该语句执行完成之后，自动提交该事务；或执行失败后，自动回滚该事务。更多详细信息请参考:
[导入事务与原子性](load-atomicity.md)。
+
+## 事务操作
+
+### 开启事务
+
+```sql
+BEGIN;
+
+BEGIN WITH LABEL {user_label};
+```
+
+如果执行该语句时，当前 Session 正处于一个事务的中间过程，那么 Doris 会忽略该语句，也可以理解为事务是不能嵌套的。
+
+### 提交事务
+
+```sql
+COMMIT;
+```
+
+用于提交在当前事务中进行的所有修改。
+
+### 回滚事务
+
+```sql
+ROLLBACK;
+```
+
+用于撤销当前事务的所有修改。
+
+事务是 Session 级别的，如果 Session 中止或关闭，也会自动回滚该事务。
+
+## 事务写入
+
+目前 Doris 中支持 2 种方式的事务写入。
+
+### 单表多次`INSERT INTO VALUES`写入
+
+假如表的结构为：
+
+```sql
+CREATE TABLE `dt` (
+`id` int(11) NOT NULL,
+`name` varchar(50) NULL,
+`score` int(11) NULL
+) ENGINE=OLAP
+UNIQUE KEY(`id`)
+DISTRIBUTED BY HASH(`id`) BUCKETS 1
+PROPERTIES (
+"replication_num" = "1"
+);
+```
+
+写入：
+
+```sql
+mysql> BEGIN;
+Query OK, 0 rows affected (0.01 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':''}
+
+mysql> INSERT INTO dt (id, name, score) VALUES (1, "Emily", 25), (2,
"Benjamin", 35), (3, "Olivia", 28), (4, "Alexander", 60), (5, "Ava", 17);
+Query OK, 5 rows affected (0.08 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':'10013'}
+
+mysql> INSERT INTO dt VALUES (6, "William", 69), (7, "Sophia", 32), (8,
"James", 64), (9, "Emma", 37), (10, "Liam", 64);
+Query OK, 5 rows affected (0.00 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'PREPARE',
'txnId':'10013'}
+
+mysql> COMMIT;
+Query OK, 0 rows affected (1.02 sec)
+{'label':'txn_insert_b55db21aad7451b-b5b6c339704920c5', 'status':'VISIBLE',
'txnId':'10013'}
+```
+
+这种写入方式不仅可以实现写入的原子性，而且在 Doris 中，能提升 `INSERT INTO VALUES` 的写入性能。
Review Comment:
在fe内部攒批后走了stream load，是一个导入
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [dosc]add workload schedule policy document [doris-website]
wangbo commented on code in PR #614:
URL: https://github.com/apache/doris-website/pull/614#discussion_r1591726136
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-schedule-policy.md:
##
@@ -0,0 +1,175 @@
+---
+{
+"title": "Workload Schedule Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD SCHEDULE POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Schedule
Policy的功能，支持查询负载管理的自动化，比如实现自动cancel运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Schedule Policy的语法
+```
+create workload schedule policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Scheduler Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+* actions，当policy被触发时所采取的动作，比如可以cancel
query，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_cancel_policy的policy，它会cancel掉集群中运行时间超过1s的查询，当前状态为启用。
+
+### 基本用法
+由于action的行为有的只能在FE生效，有的只能在BE生效，因此policy本身也有FE和BE的区别。
+
+ 适用于FE的policy
+# Condition
+* username，当一个查询的username为某个值时，就会触发相应的action
+# Action
+* set_session_variable，这个action可以执行一条set session
variable的语句。同一个policy可以有多个set_session_variable，也就是说一个policy可以执行多个修改session变量的语句。
+
+适用于FE的policy主要是用于修改某个user的session变量，目前不支持set global的用法。
+
+ 适用于BE的policy
+# Condition
+* be_scan_rows，一个sql在单个BE进程内scan的行数，如果有多个并发那就是多个并发的累加值。
+* be_scan_bytes，一个sql在单个BE进程内scan的字节数，如果有多个并发那么就是多个并发的累加值。
+* query_time，一个sql在单个BE进程上的运行时间，时间单位是毫秒。
+
+# Action
+* cancel_query，cancel查询。
+
+目前BE的policy主要是用于BE负载的管理，比如当某个query的scan数据量过大或者查询时间过长，就cancel这个query。
+
+ 属性
+* enabled，取值为true或false，默认值为true，表示当前policy处于启用状态，false表示当前policy处于禁用状态。
+*
priority，取值范围为0到100的正整数，默认值为0，代表policy的优先级，该值越大，优先级越高。这个属性的主要作用是，当匹配到多个policy时，选择优先级最高的policy。
+
+ 注意事项
+1
同一个policy的condition和action要么都是FE的，要么都是BE的，比如set_session_variable和cancel_query无法配置到同一个policy中。condition
be_scan_rows和condition username无法配置到同一个policy中。
+
+2
由于目前的policy是异步线程以固定时间间隔执行的，因此策略的生效存在一定的滞后性。比如用户配置了scan行数大于100万就cancel查询的策略，如果此时集群资源比较空闲，那么有可能在cancel策略生效之前查询就已经结束了。目前这个时间间隔为500ms，这意味着运行时间过短的查询可能会绕过策略的检查。
+
+3 当前支持的负载类型包括select/insert select/stream load/broker load/routine load。
+
+4 一个查询可能匹配到多个policy，但是只有优先级最高的policy会生效。
+
+5 目前不支持action和condition的修改，只能通过删除新建的方式修改。
+
+### 常见用法
+1 将用户名为admin的所有session变量中的workload group修改为normal
+```
+create workload schedule policy test_set_var_policy
+conditions(username='admin')
+actions(set_session_variable 'workload_group=normal')
+```
+
+2 cancel所有单个be上scan行数大于1000行的sql
+```
+create workload schedule policy test_cancel_query
+conditions(be_scan_rows > 1000)
+actions(cancel_query)
+```
+
+3 cancel所有scan字节数大于5G且运行时间超过1s的sql
+```
+create workload schedule policy test_cancel_big_query
+conditions(query_time > 1000, be_scan_bytes > 5368709120)
+actions(cancel_query)
+```
+
+4 修改属性
+```
+alter workload schedule policy test_cancel_big_query
properties('enabled'='false');
+```
+
+5 查看已创建的policy
+```
+mysql [(none)]>show workload schedule policy;
++---+--+---+--+--+-+-+
+| Id| Name | Condition | Action | Priority |
Enabled | Version |
++---+--+---+--+--+-+-+
+| 41057 | test_cancel_3s_query | query_time > 3000 | cancel_query | 0|
true| 0 |
++---+--+---+--+--+-+-+
+1 row in set (0.00 sec)
+```
+
+### 效果测试
+ 1 session变量修改测试
+尝试修改admin账户的session变量中的并发相关的参数
+```
+// 登录 admin账户查看并发参数
+mysql [(none)]>show variables like '%parallel_fragment_exec_instance_num%';
++-+---+---+-+
+| Variable_name | Value | Default_Value | Changed |
++-+---+---+-+
+| parallel_fragment_exec_instance_num | 8 | 8 | 0 |
++-+---+---+-+
+1 row in set (0.00 sec)
+
+// 创建修改admin账户并发参数的policy
+create workload schedule policy test_set_var_policy
+conditions(username='admin')
+actions(set_session_variable 'parallel_fragment_exec_instance_num=1')
+
+// 过段时间后再次查看admin账户的参数
+mysql [(none)]>show variables like '%parallel_fragment_exec_instance_num%';
++-+---+---+-+
+| Variable_name | Value | Default_Value | Changed |
++-+---+---+-+
+| parallel_fragment_exec_instance_num | 1 | 8 | 1 |
++-+---+--
Re: [PR] [Feature] Support CREATE DB COMMENT (#16678) [doris-website]
xiabaike commented on PR #619: URL: https://github.com/apache/doris-website/pull/619#issuecomment-2097295361 doris's pull: https://github.com/apache/doris/pull/34455 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] Add blog-SQL convertor [doris-website]
httpshirley commented on PR #615: URL: https://github.com/apache/doris-website/pull/615#issuecomment-2097371233 buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [feature]Support debezium table schema changes [doris-kafka-connector]
JNSimba commented on PR #14: URL: https://github.com/apache/doris-kafka-connector/pull/14#issuecomment-2098489998 build failed, PTAL @DongLiang-0 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
[I] Sequence Column page could not be found [doris-website]
iszhangsc opened a new issue, #621: URL: https://github.com/apache/doris-website/issues/621 doris 2.1 Sequence Column page could not be found -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Load-balance]Added Haproxy proxy usage guide [doris-website]
DongLiang-0 commented on PR #633: URL: https://github.com/apache/doris-website/pull/633#issuecomment-2102462029 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [dosc]add workload schedule policy document [doris-website]
morningman commented on code in PR #614:
URL: https://github.com/apache/doris-website/pull/614#discussion_r1595694417
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-policy.md:
##
@@ -0,0 +1,193 @@
+---
+{
+"title": "Workload Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Policy的功能，支持查询负载管理的自动化，比如实现自动取消运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Policy的语法
+```
+create workload policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+*
actions，当policy被触发时所采取的动作，比如可以取消查询，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_cancel_policy的policy，它会取消掉集群中运行时间超过1s的查询，当前状态为启用。
Review Comment:
```suggestion
上面例子中policy的含义是，创建一个名为 `test_cancel_policy`
的policy，它会取消掉集群中运行时间超过1s的查询，当前状态为启用。
```
建议这种带下划线的单词或变量，用反引号包裹，不然可能被识别为 markdown 的斜体
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-policy.md:
##
@@ -0,0 +1,193 @@
+---
+{
+"title": "Workload Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Policy的功能，支持查询负载管理的自动化，比如实现自动取消运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Policy的语法
+```
+create workload policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+*
actions，当policy被触发时所采取的动作，比如可以取消查询，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_cancel_policy的policy，它会取消掉集群中运行时间超过1s的查询，当前状态为启用。
+
+### 基本用法
+由于action的行为有的只能在FE生效，有的只能在BE生效，因此policy本身也有FE和BE的区别。
+
+ 适用于FE的policy
+1. Condition
+* username，当一个查询的username为某个值时，就会触发相应的action
+2. Action
+* set_session_variable，这个action可以执行一条set session
variable的语句。同一个policy可以有多个set_session_variable，也就是说一个policy可以执行多个修改session变量的语句。
+
+适用于FE的policy主要是用于修改某个user的session变量，目前不支持set global的用法。
+
+ 适用于BE的policy
+1. Condition
+* be_scan_rows，一个sql在单个BE进程内scan的行数，如果有多个并发那就是多个并发的累加值。
+* be_scan_bytes，一个sql在单个BE进程内scan的字节数，如果有多个并发那么就是多个并发的累加值。
+* query_time，一个sql在单个BE进程上的运行时间，时间单位是毫秒。
+
+2. Action
+* cancel_query，取消查询。
+
+目前BE的policy主要是用于BE负载的管理，比如当某个query的scan数据量过大或者查询时间过长，就取消这个query。
+
+ 属性
+* enabled，取值为true或false，默认值为true，表示当前policy处于启用状态，false表示当前policy处于禁用状态。
+*
priority，取值范围为0到100的正整数，默认值为0，代表policy的优先级，该值越大，优先级越高。这个属性的主要作用是，当匹配到多个policy时，选择优先级最高的policy。
+* workload_group，目前一个policy可以绑定一个workload group，代表这个policy只对某个workload
group生效。默认为空，代表对所有查询生效。
+
+ 注意事项
+*
同一个policy的condition和action要么都是FE的，要么都是BE的，比如set_session_variable和cancel_query无法配置到同一个policy中。condition
be_scan_rows和condition username无法配置到同一个policy中。
+
+*
由于目前的policy是异步线程以固定时间间隔执行的，因此策略的生效存在一定的滞后性。比如用户配置了scan行数大于100万就取消查询的策略，如果此时集群资源比较空闲，那么有可能在取消策略生效之前查询就已经结束了。目前这个时间间隔为500ms，这意味着运行时间过短的查询可能会绕过策略的检查。
+
+* 当前支持的负载类型包括select/insert select/stream load/broker load/routine load。
+
+* 一个查询可能匹配到多个policy，但是只有优先级最高的policy会生效。
+
+* 目前不支持action和condition的修改，只能通过删除新建的方式修改。
+
+### 常见用法
+1 将用户名为admin的所有session变量中的workload group修改为normal
Review Comment:
为啥不使用 `1. ` 这样的序号？
同时，记得缩进
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-policy.md:
##
@@ -0,0 +1,193 @@
+---
+{
+"title": "Workload Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD POLICY
Review Comment:
这里直接开始 `## 功能背景`
不需要单独的二级标题了，把 `### 功能背景` 提到二级标题
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-policy.md:
##
@@ -0,0 +1,193 @@
+---
+{
+"title": "Workload Policy",
+"language": "zh-CN"
+}
+---
+
+
+
+## WORKLOAD POLICY
+
+### 功能背景
+Workload Group功能解决了不同负载间的隔离问题，但无法解决同一个Group内的大查询熔断的问题， 用户遇到大查询影响集群稳定性时只能手动处理。
+
+因此Doris实现了Workload Policy的功能，支持查询负载管理的自动化，比如实现自动取消运行时间超过5s的查询这样的功能。
+
+### 基础概念
+给出一个创建Workload Policy的语法
+```
+create workload policy test_cancel_policy
+conditions(query_time > 1000)
+actions(cancel_query)
+properties('enabled'='true');
+```
+Workload Policy主要包含以下几个概念：
+* policy，代表了用户定义的策略，包含触发策略的条件(conditions)和触发策略后的动作(actions)。
+*
conditions，代表了策略的触发条件，比如当查询时间大于3s，就触发当前policy的action。一个policy可以有多个condition，多个condition之间是“与”的关系。
+*
actions，当policy被触发时所采取的动作，比如可以取消查询，目前一个policy只能定义一个action(除了set_session_variable)。
+* properties，定义了当前policy的属性，包括是否启用和优先级。
+
+上面例子中policy的含义是，创建一个名为test_ca
[I] logstash导入数据到doris中，format不支持 [doris-website]
Volcano139 opened a new issue, #638:
URL: https://github.com/apache/doris-website/issues/638
我在使用logstash导入kafka中的数据到doris中，数据格式为json，但是配置无法识别
output {
doris {
http_hosts => [ "xxx" ]
user => root
password => ""
db => "log"
table => "k8s_log"
format => "json"
}
}
报错
[2024-05-12T00:37:09,755][ERROR][logstash.outputs.doris ] Unknown setting
'format' for doris
logstash版本为8.13.4
配置了./bin/logstash-plugin install logstash-output-doris-1.0.0.gem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Feature] Support CREATE DB COMMENT (#16678) [doris-website]
luzhijing commented on PR #619: URL: https://github.com/apache/doris-website/pull/619#issuecomment-2106053926 New pull request: https://github.com/apache/doris/pull/34625 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] Sequence Column page could not be found [doris-website]
luzhijing commented on issue #621: URL: https://github.com/apache/doris-website/issues/621#issuecomment-2106055466 https://doris.apache.org/docs/data-operate/update/unique-update-transaction#sequence-column -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] Sequence Column page could not be found [doris-website]
luzhijing commented on issue #621: URL: https://github.com/apache/doris-website/issues/621#issuecomment-2106055939 Thank you for your issue. The document refactoring work is currently underway. If any internal links in the document are found to be invalid, please provide the URL of the document page. Thank you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] logstash导入数据到doris中，format不支持 [doris-website]
luzhijing commented on issue #638: URL: https://github.com/apache/doris-website/issues/638#issuecomment-2106058775 https://doris.apache.org/zh-CN/docs/data-operate/import/load-json-format Currently, only the following import methods support data import in JSON format: Through [S3 table function](https://doris.apache.org/sql-manual/sql-functions/table-functions/s3.md) import statement: insert into table select * from S3(); Import the local JSON format file through [STREAM LOAD](https://doris.apache.org/sql-manual/sql-reference/Data-Manipulation-Statements/Load/STREAM-LOAD.md). Subscribe and consume JSON format in Kafka via [ROUTINE LOAD](https://doris.apache.org/sql-manual/sql-reference/Data-Manipulation-Statements/Load/CREATE-ROUTINE-LOAD.md) information. Other ways of importing data in JSON format are not currently supported. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] logstash导入数据到doris中，format不支持 [doris-website]
luzhijing closed issue #638: logstash导入数据到doris中，format不支持 URL: https://github.com/apache/doris-website/issues/638 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [I] doris-1.2 CREATE-EXTERNAL-TABLE page could not be found [doris-website]
luzhijing closed issue #557: doris-1.2 CREATE-EXTERNAL-TABLE page could not be found URL: https://github.com/apache/doris-website/issues/557 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [docs]Add workload system table [doris-website]
morningman commented on code in PR #639:
URL: https://github.com/apache/doris-website/pull/639#discussion_r1597540457
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-system-table.md:
##
@@ -0,0 +1,230 @@
+---
+{
+"title": "Workload System Table",
Review Comment:
用中文标题
##
i18n/zh-CN/docusaurus-plugin-content-docs/current/admin-manual/resource-admin/workload-system-table.md:
##
@@ -0,0 +1,230 @@
+---
+{
+"title": "Workload System Table",
+"language": "zh-CN"
+}
+---
+
+
+
+## 背景
+Doris支持通过Workload系统表对运行中的工作负载的资源使用情况进行分析，常用于以下场景：
+
+1. 查看集群中Workload Group的资源用量，包括CPU和内存。
+2. 查看目前集群中目前资源用量最大的N个sql。
+3. 查看集群中Workload Group的排队情况
+
+用户可以通过提交sql的方式查询这些信息，找出目前系统中资源占用比较高的Workload Group或者sql，并进行相应的处理。
+
+## Workload系统表介绍
+目前系统表主要在```information_schema```库里。
+### active_queries
+```active_queries```表记录了当前在FE上查询的执行信息，字段的详细信息如下：
+* query_id，查询的id
+* query_start_time，查询开始执行的时间；如果查询有排队的话，那么就代表排队结束之后开始执行的时间
+* query_time_ms，查询的耗时，单位是毫秒
+* workload_group_id，查询使用的workload group的id
+* database，查询中的sql使用的database
+* frontend_instance，查询所在FE的节点名称
+* queue_start_time，如果查询到来时进入了排队了逻辑，那么代表查询排队开始的时间点
+* queue_end_time，如果查询到来时进入了排队的逻辑，那么代表查询排队结束的时间点
+*
query_status，查询目前的状态，目前主要有两个取值RUNNING和QUEUED，RUNNIG代表查询处于运行状态；QUEUED代表当前查询正在排队
+* sql，查询的sql文本
+
+### backend_active_tasks
+一个查询通常会被分成多个fragment在多个BE上执行，```backend_active_tasks```就代表了一个查询在单个BE上使用的CPU和内存资源的总量。如果这个查询在单BE上有多个并发和多个fragment，那么也会汇总成一行数据。
+字段详细信息如下：
+* be_id，be的id
+* fe_host，代表了这个查询是从哪个FE提交的
+* query_id，查询的id
+* task_time_ms，查询在当前be上的执行时间，单位是毫秒
+* task_cpu_time_ms，查询在be上执行时的cpu时间，单位是毫秒
+* scan_rows，查询在当前be上扫描的行数，如果扫描了多个表，那么就是多个表的累加值
+* scan_bytes，查询在当前be上扫描的字节数，如果扫描了多个表，那么就是多个表的累加值
+* be_peak_memory_bytes，查询在当前be上使用的内存的峰值，单位是字节
+* current_used_memory_bytes，查询在当前be上使用中的内存量，单位是字节
+* shuffle_send_bytes，查询在当前节点作为shuffle客户端发送的字节数
+* shuffle_send_rows，查询在当前节点作为shuffle客户端发送的行数
+
+## 基本用法
+1. 查看资源用量topN的sql
+```
+select
Review Comment:
序号标题后面的内容要缩进一级
下同
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
-
To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org
For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [fix](asf) try change notification to not send mail to dev@doris [doris-website]
luzhijing commented on PR #631: URL: https://github.com/apache/doris-website/pull/631#issuecomment-2107293076 This branch has conflicts that must be resolved -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](fix)delete the description of array_agg on 2.0 [doris-website]
echo-hhj commented on PR #572: URL: https://github.com/apache/doris-website/pull/572#issuecomment-2107470346 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [Fix](index writer) fix docWriter is null, when reenter close [doris-thirdparty]
airborne12 commented on PR #214: URL: https://github.com/apache/doris-thirdparty/pull/214#issuecomment-2109539207 run buildall -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](udf) add some doc about java-udf handle static load [doris-website]
zhangstar333 commented on code in PR #583: URL: https://github.com/apache/doris-website/pull/583#discussion_r1600936639 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/query/udf/java-user-defined-function.md: ## @@ -24,33 +24,74 @@ specific language governing permissions and limitations under the License. --> - - - :::tip Java UDF 功能自 Doris 1.2 版本开始支持 ::: ## Java UDF 介绍 -Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。相比于 Native 的 UDF 实现，Java UDF 有如下优势和限制： -**1. 优势** +Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。 + +Doris 支持使用 JAVA 编写 UDF、UDAF 和 UDTF。下文如无特殊说明，使用 UDF 统称所有用户自定义函数。 + +## 创建 UDF + +实现的 jar 包可以放在本地也可以存放在远程服务端通过 HTTP 下载，但必须让每个 BE 节点都能获取到 jar 包。 + +否则将会返回错误状态信息 `Couldn't open file ..`。 + +更多语法帮助可参阅 [CREATE FUNCTION](../sql-manual/sql-statements/Data-Definition-Statements/Create/CREATE-FUNCTION.md). + +### UDF + +```sql +CREATE FUNCTION java_udf_add_one(int) RETURNS int PROPERTIES ( +"file"="file:///path/to/java-udf-demo-jar-with-dependencies.jar", +"symbol"="org.apache.doris.udf.AddOne", +"always_nullable"="true", +"type"="JAVA_UDF" +); +``` + +### UDAF + +```sql +CREATE AGGREGATE FUNCTION middle_quantiles(DOUBLE,INT) RETURNS DOUBLE PROPERTIES ( +"file"="file:///pathTo/java-udaf.jar", +"symbol"="org.apache.doris.udf.demo.MiddleNumberUDAF", +"always_nullable"="true", +"type"="JAVA_UDF" +); +``` + +### UDTF -* 兼容性：使用 Java UDF 可以兼容不同的 Doris 版本，所以在进行 Doris 版本升级时，Java UDF 不需要进行额外的迁移操作。与此同时，Java UDF 同样遵循了和 Hive/Spark 等引擎同样的编程规范，使得用户可以直接将 Hive/Spark 的 UDF jar 包迁移至 Doris 使用。 +:::tip +UDTF 自 Doris 2.1.3 版本开始支持 Review Comment: PR not pick to 2.1.3 as have change the fe meta info. so maybe release at a big version eg:4.0 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/query/udf/java-user-defined-function.md: ## @@ -24,33 +24,74 @@ specific language governing permissions and limitations under the License. --> - - - :::tip Java UDF 功能自 Doris 1.2 版本开始支持 ::: ## Java UDF 介绍 -Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。相比于 Native 的 UDF 实现，Java UDF 有如下优势和限制： -**1. 优势** +Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。 + +Doris 支持使用 JAVA 编写 UDF、UDAF 和 UDTF。下文如无特殊说明，使用 UDF 统称所有用户自定义函数。 + +## 创建 UDF + +实现的 jar 包可以放在本地也可以存放在远程服务端通过 HTTP 下载，但必须让每个 BE 节点都能获取到 jar 包。 Review Comment: FE also need jar. * 如果你是**本地路径**方式，这里数据库驱动依赖的 jar 包，**FE、BE 节点都要放置** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](udf) add some doc about java-udf handle static load [doris-website]
zhangstar333 commented on code in PR #583: URL: https://github.com/apache/doris-website/pull/583#discussion_r1600939933 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/query/udf/java-user-defined-function.md: ## @@ -24,33 +24,74 @@ specific language governing permissions and limitations under the License. --> - - - :::tip Java UDF 功能自 Doris 1.2 版本开始支持 ::: ## Java UDF 介绍 -Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。相比于 Native 的 UDF 实现，Java UDF 有如下优势和限制： -**1. 优势** +Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。 + +Doris 支持使用 JAVA 编写 UDF、UDAF 和 UDTF。下文如无特殊说明，使用 UDF 统称所有用户自定义函数。 + +## 创建 UDF + +实现的 jar 包可以放在本地也可以存放在远程服务端通过 HTTP 下载，但必须让每个 BE 节点都能获取到 jar 包。 Review Comment: FE also need jar. * 如果你是**本地路径**方式，这里依赖的 jar 包，**FE、BE 节点都要放置** -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
Re: [PR] [doc](udf) add some doc about java-udf handle static load [doris-website]
morningman commented on code in PR #583: URL: https://github.com/apache/doris-website/pull/583#discussion_r1601230546 ## i18n/zh-CN/docusaurus-plugin-content-docs/current/query/udf/java-user-defined-function.md: ## @@ -24,33 +24,74 @@ specific language governing permissions and limitations under the License. --> - - - :::tip Java UDF 功能自 Doris 1.2 版本开始支持 ::: ## Java UDF 介绍 -Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。相比于 Native 的 UDF 实现，Java UDF 有如下优势和限制： -**1. 优势** +Java UDF 为用户提供 UDF 编写的 Java 接口，以方便用户使用 Java 语言进行自定义函数的执行。 + +Doris 支持使用 JAVA 编写 UDF、UDAF 和 UDTF。下文如无特殊说明，使用 UDF 统称所有用户自定义函数。 + +## 创建 UDF + +实现的 jar 包可以放在本地也可以存放在远程服务端通过 HTTP 下载，但必须让每个 BE 节点都能获取到 jar 包。 Review Comment: done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org - To unsubscribe, e-mail: dev-unsubscr...@doris.apache.org For additional commands, e-mail: dev-h...@doris.apache.org
