[doris] branch master updated: [Bug](Datax)Fix bug that the dataxwriter will drop column when convert map to json (#13042)

[jiafengzheng]

This is an automated email from the ASF dual-hosted git repository.

jiafengzheng pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git


The following commit(s) were added to refs/heads/master by this push:
     new 29fc167548 [Bug](Datax)Fix bug that the dataxwriter will drop column 
when convert map to json (#13042)
29fc167548 is described below

commit 29fc167548718c96d59e0a67ec06d32db763bad2
Author: Wilson-β <40427110+wilson...@users.noreply.github.com>
AuthorDate: Thu Sep 29 11:37:10 2022 +0800

    [Bug](Datax)Fix bug that the dataxwriter will drop column when convert map 
to json (#13042)
    
    * fix bug that when value is null，toJSONString will drop this key value.
---
 docs/zh-CN/docs/ecosystem/datax.md                                     | 2 ++
 .../com/alibaba/datax/plugin/writer/doriswriter/DorisJsonCodec.java    | 3 ++-
 2 files changed, 4 insertions(+), 1 deletion(-)

diff --git a/docs/zh-CN/docs/ecosystem/datax.md 
b/docs/zh-CN/docs/ecosystem/datax.md
index feb8429d3f..46006122b8 100644
--- a/docs/zh-CN/docs/ecosystem/datax.md
+++ b/docs/zh-CN/docs/ecosystem/datax.md
@@ -180,6 +180,7 @@ PROPERTIES (
                         "password": "xxx",
                         "postSql": [],
                         "preSql": [],
+                        "format":"csv|json",
                         "loadProps": {
                         },
                         "maxBatchRows" : 300000,
@@ -191,5 +192,6 @@ PROPERTIES (
     }
 }
 ```
+> 注意：```format``` 参数默认值：```csv```，如果想要使用```json```格式，需要在配置中指定```format``` 
为```json```.
 
 4.执行datax任务，具体参考 
[datax官网](https://github.com/alibaba/DataX/blob/master/userGuid.md)
diff --git 
a/extension/DataX/doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/DorisJsonCodec.java
 
b/extension/DataX/doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/DorisJsonCodec.java
index 664b9d3629..063503bbb3 100644
--- 
a/extension/DataX/doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/DorisJsonCodec.java
+++ 
b/extension/DataX/doriswriter/src/main/java/com/alibaba/datax/plugin/writer/doriswriter/DorisJsonCodec.java
@@ -19,6 +19,7 @@ package com.alibaba.datax.plugin.writer.doriswriter;
 
 import com.alibaba.datax.common.element.Record;
 import com.alibaba.fastjson.JSON;
+import com.alibaba.fastjson.serializer.SerializerFeature;
 
 import java.util.HashMap;
 import java.util.List;
@@ -45,6 +46,6 @@ public class DorisJsonCodec extends DorisCodec {
             rowMap.put(fieldName, this.convertColumn(row.getColumn(idx)));
             ++idx;
         }
-        return JSON.toJSONString(rowMap);
+        return JSON.toJSONString(rowMap, SerializerFeature.WriteMapNullValue);
     }
 }


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org