cgerx commented on issue #42863:
URL: https://github.com/apache/doris/issues/42863#issuecomment-2445636105

   The problem has resolved. I found another issue in be.INFO, which led to the 
problem I mentioned earlier.
   ```shell
   I20241029 17:50:44.121132 27945 pipeline_fragment_context.cpp:259] 
PipelineFragmentContext::prepare|query_id=27fd0b61a25048c1-964280001c1d0e50|fragment
   _id=0|pthread_id=540549818400
   W20241029 17:50:44.215984 28732 jni-util.cpp:312] java.lang.InternalError
           at org.apache.hadoop.io.compress.zlib.ZlibDecompressor.init(Native 
Method)
           at 
org.apache.hadoop.io.compress.zlib.ZlibDecompressor.<init>(ZlibDecompressor.java:114)
           at 
org.apache.hadoop.io.compress.GzipCodec$GzipZlibDecompressor.<init>(GzipCodec.java:229)
           at 
org.apache.hadoop.io.compress.GzipCodec.createDecompressor(GzipCodec.java:188)
           at 
org.apache.hadoop.io.compress.CodecPool.getDecompressor(CodecPool.java:183)
           at 
org.apache.spark.sql.execution.datasources.parquet.ParquetCodecFactory$HeapBytesDecompressor.<init>(ParquetCodecFactory.java:58)
           at 
org.apache.spark.sql.execution.datasources.parquet.ParquetCodecFactory.createDecompressor(ParquetCodecFactory.java:110)
           at 
org.apache.parquet.hadoop.CodecFactory.getDecompressor(CodecFactory.java:212)
           at 
org.apache.parquet.hadoop.CodecFactory.getDecompressor(CodecFactory.java:43)
           at 
org.apache.parquet.hadoop.ParquetFileReader$Chunk.readAllPages(ParquetFileReader.java:1664)
           at 
org.apache.parquet.hadoop.ParquetFileReader$Chunk.readAllPages(ParquetFileReader.java:1547)
           at 
org.apache.parquet.hadoop.ParquetFileReader.readChunkPages(ParquetFileReader.java:1157)
           at 
org.apache.parquet.hadoop.ParquetFileReader.internalReadRowGroup(ParquetFileReader.java:993)
           at 
org.apache.parquet.hadoop.ParquetFileReader.readNextRowGroup(ParquetFileReader.java:940)
           at 
org.apache.parquet.hadoop.ParquetFileReader.readNextFilteredRowGroup(ParquetFileReader.java:1082)
           at 
org.apache.spark.sql.execution.datasources.parquet.SpecificParquetRecordReaderBase$ParquetRowGroupReaderImpl.readNextRowGroup(SpecificParquetRecordReaderBase.java:274)
   
   ```
   
   According to: https://doris.apache.org/docs/3.0/faq/lakehouse-faq/
   <img width="995" alt="image" 
src="https://github.com/user-attachments/assets/7771c48d-a990-4633-95fd-794e0118cfe0";>
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to