ranryl opened a new issue, #25178:
URL: https://github.com/apache/doris/issues/25178

   ### Search before asking
   
   - [X] I had searched in the 
[issues](https://github.com/apache/doris/issues?q=is%3Aissue) and found no 
similar issues.
   
   
   ### Version
   
   2.0.1
   
   ### What's Wrong?
   
   I1009 03:15:30.523063  1155 parse2column.cpp:207] failed to parse 
{"cluster":"idc-cal","container":"promtail","file":"/var/log/pods/loki_promtail-962m7_049a026c-2a0c-451a-a9f8-8a40b1c0b1bd/promtail/0.log","message":"level=info
 ts=2023-10-08T15:41:20.13224675Z caller=tailer.go:202 component=tailer 
msg=\"skipping update of position for a file which does not currently exist\" 
path=/var/log/pods/argo_flow-lwinebqn-exec-1ac69x8mmsh5vvng3l1dzlxlh-2282225908_09e197b8-ec56-48d3-81cc-3579c13ab6f5/main/0.log","namespace":"loki","node_name":"idc-k8s-cal-node-cicd-03","pod":"promtail-962m7","pod_ip":"172.19.88.199","source_type":"kubernetes_logs","stream":"stderr","timestamp":"2023-10-08T15:41:20.208653319Z","timestamp_end":"2023-10-08T15:41:20.208653319Z",
 length= 688
   failed to parse 
{"cluster":"idc-cal","container":"adviz-test20230508","file":"/var/log/pods/adviz_adviz-test20230508-1696778690949521152-8g97t_34118bb7-1164-489c-aec5-c1125b867f99/adviz-test20230508/0.log","message":"","namespace":"adviz","node_name":"p-hfidc-3f-73","pod":"adviz-test20230508-1696778690949521152-8g97t","pod_ip":"172.18.21.166","source_type":"kubernetes_logs","stream":"stderr","timestamp":"2023-10-08T15:25:16.194382777Z","timestamp_end":"2023-10-08T15:25:16.194382777Z",
 length= 472
   
    0# doris::signal::(anonymous namespace)::FailureSignalHandler(int, 
siginfo_t*, void*) at /root/src/doris-2.0/be/src/common/signal_handler.h:413
    1# os::Linux::chained_handler(int, siginfo_t*, void*) in 
/usr/lib/jvm/java-1.8.0/jre/lib/amd64/server/libjvm.so
    2# JVM_handle_linux_signal in 
/usr/lib/jvm/java-1.8.0/jre/lib/amd64/server/libjvm.so
    3# signalHandler(int, siginfo_t*, void*) in 
/usr/lib/jvm/java-1.8.0/jre/lib/amd64/server/libjvm.so
    4# 0x00007F751B2C0400 in /lib64/libc.so.6
    5# 
doris::vectorized::NewJsonReader::_parse_dynamic_json(doris::RuntimeState*, 
bool*, bool*, doris::vectorized::Block&, std::vector<doris::SlotDescriptor*, 
std::allocator<doris::SlotDescriptor*> > const&) at 
/root/src/doris-2.0/be/src/vec/exec/format/json/new_json_reader.cpp:469
    6# 
doris::vectorized::NewJsonReader::_vhandle_dynamic_json(doris::RuntimeState*, 
doris::vectorized::Block&, std::vector<doris::SlotDescriptor*, 
std::allocator<doris::SlotDescriptor*> > const&, bool*, bool*) in 
/opt/apache-doris/be/lib/doris_be
    7# 
doris::vectorized::NewJsonReader::get_next_block(doris::vectorized::Block*, 
unsigned long*, bool*) at 
/root/src/doris-2.0/be/src/vec/exec/format/json/new_json_reader.cpp:218
    8# doris::vectorized::VFileScanner::_get_block_impl(doris::RuntimeState*, 
doris::vectorized::Block*, bool*) at 
/root/src/doris-2.0/be/src/vec/exec/scan/vfile_scanner.cpp:258
    9# doris::vectorized::VScanner::get_block(doris::RuntimeState*, 
doris::vectorized::Block*, bool*) in /opt/apache-doris/be/lib/doris_be
   10# 
doris::vectorized::ScannerScheduler::_scanner_scan(doris::vectorized::ScannerScheduler*,
 doris::vectorized::ScannerContext*, 
std::shared_ptr<doris::vectorized::VScanner>) at 
/root/src/doris-2.0/be/src/vec/exec/scan/scanner_scheduler.cpp:339
   11# std::_Function_handler<void (), 
doris::vectorized::ScannerScheduler::_schedule_scanners(doris::vectorized::ScannerContext*)::$_1::operator()()
 const::{lambda()#3}>::_M_invoke(std::_Any_data const&) at 
/var/local/ldb-toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/std_function.h:291
   12# doris::ThreadPool::dispatch_thread() in /opt/apache-doris/be/lib/doris_be
   13# doris::Thread::supervise_thread(void*) at 
/root/src/doris-2.0/be/src/util/thread.cpp:466
   14# start_thread in /lib64/libpthread.so.0
   15# clone in /lib64/libc.so.6
   
   /opt/apache-doris/be/bin/start_be.sh: line 330:   574 Segmentation fault     
 (core dumped) ${LIMIT:+${LIMIT}} "${DORIS_HOME}/lib/doris_be" "$@" 2>&1 < 
/dev/null
   
   
   ### What You Expected?
   
   doris部署到k8s环境中
   从kafka routine load 日志数据,部分数据报failed to 
parse,提示json解析错误,从字符串长度来看,刚好缺少最后一个字符},只要报failed to parse的行都是这样,很奇怪。一段时间后be进程会退出
   
   
   ### How to Reproduce?
   
   _No response_
   
   ### Anything Else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscr...@doris.apache.org
For additional commands, e-mail: commits-h...@doris.apache.org

Reply via email to