This is an automated email from the ASF dual-hosted git repository.
morningman pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
The following commit(s) were added to refs/heads/master by this push:
new e53f6a1a69b [enchement](mc)opt maxcompute read arrow skip repeated
check of isNull (#45989)
e53f6a1a69b is described below
commit e53f6a1a69b8f48817770fc6a07caf8e4e4eb2a0
Author: daidai <changyu...@selectdb.com>
AuthorDate: Thu Dec 26 15:51:10 2024 +0800
[enchement](mc)opt maxcompute read arrow skip repeated check of isNull
(#45989)
### What problem does this PR solve?
Problem Summary:
Set MaxCompute Arrow `NullCheckingForGet.NULL_CHECKING_ENABLED` false.We
will call isNull() before calling getXXX(), so we can set this parameter
to skip the repeated check of isNull().
---
.../java/org/apache/doris/maxcompute/MaxComputeJniScanner.java | 8 +++++++-
1 file changed, 7 insertions(+), 1 deletion(-)
diff --git
a/fe/be-java-extensions/max-compute-scanner/src/main/java/org/apache/doris/maxcompute/MaxComputeJniScanner.java
b/fe/be-java-extensions/max-compute-scanner/src/main/java/org/apache/doris/maxcompute/MaxComputeJniScanner.java
index d6325bdae46..30376792546 100644
---
a/fe/be-java-extensions/max-compute-scanner/src/main/java/org/apache/doris/maxcompute/MaxComputeJniScanner.java
+++
b/fe/be-java-extensions/max-compute-scanner/src/main/java/org/apache/doris/maxcompute/MaxComputeJniScanner.java
@@ -52,8 +52,14 @@ import java.util.Objects;
* MaxComputeJ JniScanner. BE will read data from the scanner object.
*/
public class MaxComputeJniScanner extends JniScanner {
- private static final Logger LOG =
Logger.getLogger(MaxComputeJniScanner.class);
+ static {
+ //Set `NullCheckingForGet.NULL_CHECKING_ENABLED` false.
+ //We will call isNull() before calling getXXX(), so we can set this
parameter
+ // to skip the repeated check of isNull().
+ System.setProperty("arrow.enable_null_check_for_get", "false");
+ }
+ private static final Logger LOG =
Logger.getLogger(MaxComputeJniScanner.class);
private static final String ACCESS_KEY = "access_key";
private static final String SECRET_KEY = "secret_key";
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org
