Hanchers opened a new issue, #47684:
URL: https://github.com/apache/doris/issues/47684

   ### Search before asking
   
   - [x] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   doris2.1.0
   
   ### What's Wrong?
   
   使用官方的datax, 从clickhouse里采集数据到doris里, 每次执行都会导致doris崩溃。
   Use the official datax to collect data from clickhouse into doris. Each 
execution will cause doris to crash.
   
   因为数据的原因,不能提供完整的表结构和实际数据,但是可以出问题的相关数据。
   Due to data limitations, it is not possible to provide a complete table 
structure and actual data, but there may be issues with the relevant data.
   
   以下是我的部分建表语句:
   Here are some of my table building statements:
   
   `
   
   CREATE TABLE `ods_test` (
     `syslogid` VARCHAR(0) NOT NULL,  -- this is the key column
     `remark` VARCHAR(0) NOT NULL,
     `user_name` VARCHAR(0) NULL,
     `user_id` VARCHAR(0) NULL,
     `update_time` VARCHAR(116) NOT NULL
   ) ENGINE=OLAP
   DUPLICATE KEY(`__id`)
   COMMENT 'OLAP'
   DISTRIBUTED BY RANDOM BUCKETS AUTO
   PROPERTIES (
   "replication_allocation" = "tag.location.default: 2",
   "min_load_replica_num" = "-1",
   "is_being_synced" = "false",
   "storage_medium" = "hdd",
   "storage_format" = "V2",
   "light_schema_change" = "true",
   "disable_auto_compaction" = "false",
   "enable_single_replica_compaction" = "false",
   "group_commit_interval_ms" = "10000",
   "group_commit_data_bytes" = "134217728"
   );
   `
   
   部分数据
   Part of the data
   `
   6f336347a90549789092b11d31b2197a,1,超级管理员,1,2025-01-12 21:45:39
   `
   6f336347a90549789092b11d31b2197a 会导致be崩溃
   6f336347a90549789092b11d31b2197a will cause be crash
   
   当我将syslogid扩充到50个字符时,问题解决
   When I expanded syslogid to 50 characters, the problem was solved
   
   下面是be.out的报错:
   `
   
   *** Query id: 5a4698a1afd40053-50e26699312ee9a5 ***
   *** tablet id: 0 ***
   *** Aborted at 1739168366 (unix time) try "date -d @1739168366" if you are 
using GNU date ***
   *** Current BE git commitID: 91efb6a43d ***
   *** SIGSEGV unknown detail explain (@0x0) received by PID 25235 (TID 26356 
OR 0x7fbaf0c76700) from PID 0; stack trace: ***
    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, 
siginfo_t*, void*) at 
/home/zcp/repo_center/doris_release/doris/be/src/common/signal_handler.h:417
    1# os::Linux::chained_handler(int, siginfo*, void*) in 
/root/java/jdk1.8.0_221/jre/lib/amd64/server/libjvm.so
    2# JVM_handle_linux_signal in 
/root/java/jdk1.8.0_221/jre/lib/amd64/server/libjvm.so
    3# signalHandler(int, siginfo*, void*) in 
/root/java/jdk1.8.0_221/jre/lib/amd64/server/libjvm.so
    4# 0x00007FBE7F8FA400 in /lib64/libc.so.6
    5# __memcmp_sse4_1 in /lib64/libc.so.6
    6# doris::FieldTypeTraits<(doris::FieldType)13>::cmp(void const*, void 
const*) at /home/zcp/repo_center/doris_release/doris/be/src/olap/types.h:1349
    7# 
doris::segment_v2::TypedZoneMapIndexWriter<(doris::PrimitiveType)10>::flush() 
at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/zone_map_index.cpp:90
    8# doris::segment_v2::ScalarColumnWriter::finish_current_page() at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:683
    9# doris::segment_v2::ScalarColumnWriter::finish() at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/column_writer.cpp:593
   10# doris::segment_v2::VerticalSegmentWriter::write_batch() at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_v2/vertical_segment_writer.cpp:719
   11# 
doris::SegmentFlusher::_add_rows(std::unique_ptr<doris::segment_v2::VerticalSegmentWriter,
 std::default_delete<doris::segment_v2::VerticalSegmentWriter> >&, 
doris::vectorized::Block const*, unsigned long, unsigned long) at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_creator.cpp:183
   12# doris::SegmentFlusher::flush_single_block(doris::vectorized::Block 
const*, int, long*) at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_creator.cpp:76
   13# doris::SegmentCreator::flush_single_block(doris::vectorized::Block 
const*, int, long*) at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/segment_creator.cpp:422
   14# doris::BaseBetaRowsetWriter::flush_memtable(doris::vectorized::Block*, 
int, long*) at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/rowset/beta_rowset_writer.cpp:489
   15# doris::FlushToken::_do_flush_memtable(doris::MemTable*, int, long*) at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/memtable_flush_executor.cpp:144
   16# doris::FlushToken::_flush_memtable(std::unique_ptr<doris::MemTable, 
std::default_delete<doris::MemTable> >, int, long) in 
/opt/module/doris/be/lib/doris_be
   17# doris::MemtableFlushTask::run() at 
/home/zcp/repo_center/doris_release/doris/be/src/olap/memtable_flush_executor.cpp:59
   18# doris::ThreadPool::dispatch_thread() in /opt/module/doris/be/lib/doris_be
   19# doris::Thread::supervise_thread(void*) at 
/home/zcp/repo_center/doris_release/doris/be/src/util/thread.cpp:499
   20# start_thread in /lib64/libpthread.so.0
   21# clone in /lib64/libc.so.6
   `
   
   
   ### What You Expected?
   
   尽管我们的使用方式也是有问题的,但还是希望doris 能修复这个问题
   Although we have problems with how we use it, I still hope that doris can 
fix this problem
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [x] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to