alanredsheep opened a new issue, #22339:
URL: https://github.com/apache/doris/issues/22339

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Description
   
   Doris ver: 1.2.6-rc03
   Hive ver: 1.1.0
   
   DataX hdfs-writer only support gzip/bzip2 for textfile table compression.
   Here is docs. 
https://github.com/alibaba/DataX/blob/master/hdfswriter/doc/hdfswriter.md
   
   But doris cannot read hive textfile table compressed by gzip. Here is the 
error message.
   ```
   ERROR 1105 (HY000): errCode = 2, detailMessage = 
(xx.xx.xx.xx)[INTERNAL_ERROR]Only support csv data in utf8 codec
   ```
   
   I used datax to collect data from mysql to hive, so there are so many 
textfile table compressed by gzip in Hive.
   So I really need Hive catalog support gzip/bzip2 compression.
   
   
   ### Solution
   
   This question is similar to another issus in 
https://github.com/apache/doris/pull/19387.
   This solution may to similar too. 
   
   
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to