This is an automated email from the ASF dual-hosted git repository. morningman pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/doris-website.git
The following commit(s) were added to refs/heads/master by this push: new 5eb5915253 [improvement](jdbc catalog) add jdbc catalog connection pool docs (#911) 5eb5915253 is described below commit 5eb5915253f99c2b0bdf11328ae997cc933468f5 Author: zy-kkk <zhongy...@gmail.com> AuthorDate: Wed Jul 24 16:44:34 2024 +0800 [improvement](jdbc catalog) add jdbc catalog connection pool docs (#911) --- docs/lakehouse/database/jdbc.md | 14 ++++++++++++++ .../current/lakehouse/database/jdbc.md | 16 ++++++++++++++++ .../version-2.0/lakehouse/database/jdbc.md | 14 ++++++++++++++ .../version-2.1/lakehouse/database/jdbc.md | 14 ++++++++++++++ .../version-3.0/lakehouse/database/jdbc.md | 14 ++++++++++++++ .../version-3.0/lakehouse/database/oracle.md | 2 +- versioned_docs/version-2.0/lakehouse/database/jdbc.md | 14 ++++++++++++++ versioned_docs/version-2.1/lakehouse/database/jdbc.md | 14 ++++++++++++++ versioned_docs/version-2.1/lakehouse/database/oracle.md | 2 +- versioned_docs/version-3.0/lakehouse/database/jdbc.md | 14 ++++++++++++++ versioned_docs/version-3.0/lakehouse/database/oracle.md | 2 +- 11 files changed, 117 insertions(+), 3 deletions(-) diff --git a/docs/lakehouse/database/jdbc.md b/docs/lakehouse/database/jdbc.md index ad01e6c1c9..6adf0d1758 100644 --- a/docs/lakehouse/database/jdbc.md +++ b/docs/lakehouse/database/jdbc.md @@ -205,6 +205,20 @@ The connection pool size can be adjusted to better suit your workload. Typically At the same time, in order to avoid accumulating too many unused connection pool caches on BE, you can specify the time interval for clearing the cache by setting the `jdbc_connection_pool_cache_clear_time_sec` parameter of BE. The default value is 28800 seconds (8 hours). After this interval, BE will forcefully clear all connection pool caches that have not been used for more than this time. +:::warning +When using Doris JDBC Catalog to connect to external data sources, you need to be careful when updating database credentials. +Doris maintains active connections through a connection pool to respond to queries quickly. However, after the credentials are changed, the connection pool may continue to use the old credentials to try to establish new connections and fail. Such erroneous attempts are repeated as the system attempts to maintain a certain number of active connections, and in some database systems, frequent failures may result in account lockout. +It is recommended that when credentials must be changed, the Doris JDBC Catalog configuration is updated synchronously and the Doris cluster is restarted to ensure that all nodes use the latest credentials to prevent connection failures and potential account lockouts. + +Account lockouts you may encounter are as follows: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert transaction Doris' data is written to the JDBC Catalog in a batch manner. If the import is interrupted midway, the previously written data may need to be rolled back. Therefore, JDBC Catalog supports transactions when data is written. Transaction support needs to be set by setting session variable: `enable_odbc_transcation`. diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/database/jdbc.md b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/database/jdbc.md index 0a8b6fb4fe..7a33b29a37 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/database/jdbc.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/current/lakehouse/database/jdbc.md @@ -205,6 +205,22 @@ Doris 显示的小写名称去查询。 同时为了避免在 BE 上累积过多的未使用的连接池缓存,可以通过设置 BE 的 `jdbc_connection_pool_cache_clear_time_sec` 参数来指定清理缓存的时间间隔。默认值为 28800 秒(8小时),此间隔过后,BE 将强制清理所有超过该时间未使用的连接池缓存。 +:::warning +使用 Doris JDBC Catalog 连接外部数据源时,需谨慎更新数据库凭证。 + +Doris 通过连接池维持活跃连接以快速响应查询。但凭证变更后,连接池可能会继续使用旧凭证尝试建立新连接并失败。由于系统试图保持一定数量的活跃连接,这种错误尝试会重复执行,且在某些数据库系统中,频繁的失败可能导致账户被锁定。 + +建议在必须更改凭证时,同步更新 Doris JDBC Catalog 配置,并重启 Doris 集群,以确保所有节点使用最新凭证,防止连接失败和潜在的账户锁定。 + +可能遇到的账户锁定如下: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert 事务 Doris 的数据是由一组 batch 的方式写入 JDBC Catalog 的,如果中途导入中断,之前写入数据可能需要回滚。所以 JDBC Catalog 支持数据写入时的事务,事务的支持需要通过设置 session variable: `enable_odbc_transcation `。 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/database/jdbc.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/database/jdbc.md index 39245096f4..86719927dd 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/database/jdbc.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.0/lakehouse/database/jdbc.md @@ -154,6 +154,20 @@ Doris JDBC Catalog 支持连接以下数据库: 同时为了避免在 BE 上累积过多的未使用的连接池缓存,可以通过设置 BE 的 `jdbc_connection_pool_cache_clear_time_sec` 参数来指定清理缓存的时间间隔。默认值为 28800 秒(8小时),此间隔过后,BE 将强制清理所有超过该时间未使用的连接池缓存。 +:::warning +使用 Doris JDBC Catalog 连接外部数据源时,需谨慎更新数据库凭证。 +Doris 通过连接池维持活跃连接以快速响应查询。但凭证变更后,连接池可能会继续使用旧凭证尝试建立新连接并失败。由于系统试图保持一定数量的活跃连接,这种错误尝试会重复执行,且在某些数据库系统中,频繁的失败可能导致账户被锁定。 +建议在必须更改凭证时,同步更新 Doris JDBC Catalog 配置,并重启 Doris 集群,以确保所有节点使用最新凭证,防止连接失败和潜在的账户锁定。 + +可能遇到的账户锁定如下: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert 事务 Doris 的数据是由一组 batch 的方式写入 JDBC Catalog 的,如果中途导入中断,之前写入数据可能需要回滚。所以 JDBC Catalog 支持数据写入时的事务,事务的支持需要通过设置 session variable: `enable_odbc_transcation `。 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/database/jdbc.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/database/jdbc.md index 0a8b6fb4fe..e39b8595f4 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/database/jdbc.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-2.1/lakehouse/database/jdbc.md @@ -205,6 +205,20 @@ Doris 显示的小写名称去查询。 同时为了避免在 BE 上累积过多的未使用的连接池缓存,可以通过设置 BE 的 `jdbc_connection_pool_cache_clear_time_sec` 参数来指定清理缓存的时间间隔。默认值为 28800 秒(8小时),此间隔过后,BE 将强制清理所有超过该时间未使用的连接池缓存。 +:::warning +使用 Doris JDBC Catalog 连接外部数据源时,需谨慎更新数据库凭证。 +Doris 通过连接池维持活跃连接以快速响应查询。但凭证变更后,连接池可能会继续使用旧凭证尝试建立新连接并失败。由于系统试图保持一定数量的活跃连接,这种错误尝试会重复执行,且在某些数据库系统中,频繁的失败可能导致账户被锁定。 +建议在必须更改凭证时,同步更新 Doris JDBC Catalog 配置,并重启 Doris 集群,以确保所有节点使用最新凭证,防止连接失败和潜在的账户锁定。 + +可能遇到的账户锁定如下: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert 事务 Doris 的数据是由一组 batch 的方式写入 JDBC Catalog 的,如果中途导入中断,之前写入数据可能需要回滚。所以 JDBC Catalog 支持数据写入时的事务,事务的支持需要通过设置 session variable: `enable_odbc_transcation `。 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/jdbc.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/jdbc.md index 0a8b6fb4fe..e39b8595f4 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/jdbc.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/jdbc.md @@ -205,6 +205,20 @@ Doris 显示的小写名称去查询。 同时为了避免在 BE 上累积过多的未使用的连接池缓存,可以通过设置 BE 的 `jdbc_connection_pool_cache_clear_time_sec` 参数来指定清理缓存的时间间隔。默认值为 28800 秒(8小时),此间隔过后,BE 将强制清理所有超过该时间未使用的连接池缓存。 +:::warning +使用 Doris JDBC Catalog 连接外部数据源时,需谨慎更新数据库凭证。 +Doris 通过连接池维持活跃连接以快速响应查询。但凭证变更后,连接池可能会继续使用旧凭证尝试建立新连接并失败。由于系统试图保持一定数量的活跃连接,这种错误尝试会重复执行,且在某些数据库系统中,频繁的失败可能导致账户被锁定。 +建议在必须更改凭证时,同步更新 Doris JDBC Catalog 配置,并重启 Doris 集群,以确保所有节点使用最新凭证,防止连接失败和潜在的账户锁定。 + +可能遇到的账户锁定如下: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert 事务 Doris 的数据是由一组 batch 的方式写入 JDBC Catalog 的,如果中途导入中断,之前写入数据可能需要回滚。所以 JDBC Catalog 支持数据写入时的事务,事务的支持需要通过设置 session variable: `enable_odbc_transcation `。 diff --git a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/oracle.md b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/oracle.md index 0255b23c45..5b57b349fd 100644 --- a/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/oracle.md +++ b/i18n/zh-CN/docusaurus-plugin-content-docs/version-3.0/lakehouse/database/oracle.md @@ -123,4 +123,4 @@ Apache Doris 会在下发到 Oracle 的查询语句中,自动在字段名与 2. 创建或查询 Oracle Catalog 时出现 `Non supported character set (add orai18n.jar in your classpath): ZHS16GBK` 异常 - 下载 [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) 并放到 每个 FE 和 BE 的目录下的 `custom_lib/` 目录下(如不存在,手动创建即可)。 + 下载 [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) 并放到 每个 FE 和 BE 的目录下的 `custom_lib/` 目录下(如不存在,手动创建即可)并重启每个 FE 和 BE。 diff --git a/versioned_docs/version-2.0/lakehouse/database/jdbc.md b/versioned_docs/version-2.0/lakehouse/database/jdbc.md index 9be25b85d7..eaa24ac4bc 100644 --- a/versioned_docs/version-2.0/lakehouse/database/jdbc.md +++ b/versioned_docs/version-2.0/lakehouse/database/jdbc.md @@ -154,6 +154,20 @@ The connection pool size can be adjusted to better suit your workload. Typically At the same time, in order to avoid accumulating too many unused connection pool caches on BE, you can specify the time interval for clearing the cache by setting the `jdbc_connection_pool_cache_clear_time_sec` parameter of BE. The default value is 28800 seconds (8 hours). After this interval, BE will forcefully clear all connection pool caches that have not been used for more than this time. +:::warning +When using Doris JDBC Catalog to connect to external data sources, you need to be careful when updating database credentials. +Doris maintains active connections through a connection pool to respond to queries quickly. However, after the credentials are changed, the connection pool may continue to use the old credentials to try to establish new connections and fail. Such erroneous attempts are repeated as the system attempts to maintain a certain number of active connections, and in some database systems, frequent failures may result in account lockout. +It is recommended that when credentials must be changed, the Doris JDBC Catalog configuration is updated synchronously and the Doris cluster is restarted to ensure that all nodes use the latest credentials to prevent connection failures and potential account lockouts. + +Account lockouts you may encounter are as follows: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert transaction Doris' data is written to the JDBC Catalog in a batch manner. If the import is interrupted midway, the previously written data may need to be rolled back. Therefore, JDBC Catalog supports transactions when data is written. Transaction support needs to be set by setting session variable: `enable_odbc_transcation`. diff --git a/versioned_docs/version-2.1/lakehouse/database/jdbc.md b/versioned_docs/version-2.1/lakehouse/database/jdbc.md index ad01e6c1c9..6adf0d1758 100644 --- a/versioned_docs/version-2.1/lakehouse/database/jdbc.md +++ b/versioned_docs/version-2.1/lakehouse/database/jdbc.md @@ -205,6 +205,20 @@ The connection pool size can be adjusted to better suit your workload. Typically At the same time, in order to avoid accumulating too many unused connection pool caches on BE, you can specify the time interval for clearing the cache by setting the `jdbc_connection_pool_cache_clear_time_sec` parameter of BE. The default value is 28800 seconds (8 hours). After this interval, BE will forcefully clear all connection pool caches that have not been used for more than this time. +:::warning +When using Doris JDBC Catalog to connect to external data sources, you need to be careful when updating database credentials. +Doris maintains active connections through a connection pool to respond to queries quickly. However, after the credentials are changed, the connection pool may continue to use the old credentials to try to establish new connections and fail. Such erroneous attempts are repeated as the system attempts to maintain a certain number of active connections, and in some database systems, frequent failures may result in account lockout. +It is recommended that when credentials must be changed, the Doris JDBC Catalog configuration is updated synchronously and the Doris cluster is restarted to ensure that all nodes use the latest credentials to prevent connection failures and potential account lockouts. + +Account lockouts you may encounter are as follows: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert transaction Doris' data is written to the JDBC Catalog in a batch manner. If the import is interrupted midway, the previously written data may need to be rolled back. Therefore, JDBC Catalog supports transactions when data is written. Transaction support needs to be set by setting session variable: `enable_odbc_transcation`. diff --git a/versioned_docs/version-2.1/lakehouse/database/oracle.md b/versioned_docs/version-2.1/lakehouse/database/oracle.md index 1ef211b304..1209c03e8a 100644 --- a/versioned_docs/version-2.1/lakehouse/database/oracle.md +++ b/versioned_docs/version-2.1/lakehouse/database/oracle.md @@ -124,4 +124,4 @@ Doris will automatically add the escape character ("") to the field names and ta 2. `Non supported character set (add orai18n.jar in your classpath): ZHS16GBK` exception occurs when creating or querying Oracle Catalog - Download [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) and put it in the `custom_lib/` directory under each FE and BE directory (if not exists, just create it manually) and restart each FE and BE. \ No newline at end of file + Download [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) and put it in the `custom_lib/` directory under each FE and BE directory (if not exists, just create it manually) and restart each FE and BE. diff --git a/versioned_docs/version-3.0/lakehouse/database/jdbc.md b/versioned_docs/version-3.0/lakehouse/database/jdbc.md index ad01e6c1c9..6adf0d1758 100644 --- a/versioned_docs/version-3.0/lakehouse/database/jdbc.md +++ b/versioned_docs/version-3.0/lakehouse/database/jdbc.md @@ -205,6 +205,20 @@ The connection pool size can be adjusted to better suit your workload. Typically At the same time, in order to avoid accumulating too many unused connection pool caches on BE, you can specify the time interval for clearing the cache by setting the `jdbc_connection_pool_cache_clear_time_sec` parameter of BE. The default value is 28800 seconds (8 hours). After this interval, BE will forcefully clear all connection pool caches that have not been used for more than this time. +:::warning +When using Doris JDBC Catalog to connect to external data sources, you need to be careful when updating database credentials. +Doris maintains active connections through a connection pool to respond to queries quickly. However, after the credentials are changed, the connection pool may continue to use the old credentials to try to establish new connections and fail. Such erroneous attempts are repeated as the system attempts to maintain a certain number of active connections, and in some database systems, frequent failures may result in account lockout. +It is recommended that when credentials must be changed, the Doris JDBC Catalog configuration is updated synchronously and the Doris cluster is restarted to ensure that all nodes use the latest credentials to prevent connection failures and potential account lockouts. + +Account lockouts you may encounter are as follows: + +MySQL: account is locked + +Oracle: ORA-28000: the account is locked + +SQL Server: Login is locked out +::: + ### Insert transaction Doris' data is written to the JDBC Catalog in a batch manner. If the import is interrupted midway, the previously written data may need to be rolled back. Therefore, JDBC Catalog supports transactions when data is written. Transaction support needs to be set by setting session variable: `enable_odbc_transcation`. diff --git a/versioned_docs/version-3.0/lakehouse/database/oracle.md b/versioned_docs/version-3.0/lakehouse/database/oracle.md index 533f303034..612574ce33 100644 --- a/versioned_docs/version-3.0/lakehouse/database/oracle.md +++ b/versioned_docs/version-3.0/lakehouse/database/oracle.md @@ -124,4 +124,4 @@ Doris will automatically add the escape character ("") to the field names and ta 2. `Non supported character set (add orai18n.jar in your classpath): ZHS16GBK` exception occurs when creating or querying Oracle Catalog - Download [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) and put it in the `custom_lib/` directory under each FE and BE directory (if not exists, just create it manually). + Download [orai18n.jar](https://www.oracle.com/database/technologies/appdev/jdbc-downloads.html) and put it in the `custom_lib/` directory under each FE and BE directory (if not exists, just create it manually) and restart each FE and BE. --------------------------------------------------------------------- To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org For additional commands, e-mail: commits-h...@doris.apache.org