BaoHuaWang opened a new issue, #61053:
URL: https://github.com/apache/doris/issues/61053
2026-03-05 10:31:54
java.lang.Exception: Could not perform checkpoint 10 for operator Source:
ds_security_log_source[1] -> Calc[2] -> p_security_log3[3]: Writer ->
p_security_log3[3]: Committer (3/3)#9.
at
org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1184)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$triggerCheckpointAsync$13(StreamTask.java:1131)
at
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at
org.apache.flink.streaming.runtime.tasks.mailbox.Mail.run(Mail.java:90)
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMail(MailboxProcessor.java:398)
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMailsNonBlocking(MailboxProcessor.java:383)
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.processMail(MailboxProcessor.java:345)
at
org.apache.flink.streaming.runtime.tasks.mailbox.MailboxProcessor.runMailboxLoop(MailboxProcessor.java:229)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.runMailboxLoop(StreamTask.java:839)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:788)
at
org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:952)
at
org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:931)
at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:745)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:562)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.doris.flink.exception.DorisRuntimeException: table
rj_security.ds_security_log stream load error: [MEM_LIMIT_EXCEEDED]PreCatch
error code:11, [E11] Allocator sys memory check failed: Cannot alloc:128.00 KB,
consuming tracker:<StreamLoadPipe>, peak used 0, current used 0, reserved 0,
exec node:<>, sys physical memory 31.19 GB. process memory used 1.21 GB(= 1.21
GB[vm/rss] + 0[reserved] + 0B[waiting_refresh]), limit -1.00 B, soft limit 0.
sys available memory 8.98 GB(= 8.98 GB[proc/available] - 0[reserved] -
0B[waiting_refresh]), low water mark 1.56 GB, warning water mark 3.12 GB.
0# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> > const&, bool) at
/home/zcp/repo_center/doris_release/doris/be/src/common/exception.cpp:0
1# doris::Exception::Exception(int, std::basic_string_view<char,
std::char_traits<char> > const&) at
/usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/basic_string.h:239
2# doris::Allocator<false, false, false,
doris::DefaultMemoryAllocator, true>::sys_memory_check(unsigned long) const at
/home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:179
3# doris::Allocator<false, false, false,
doris::DefaultMemoryAllocator, true>::alloc(unsigned long, unsigned long) at
/home/zcp/repo_center/doris_release/doris/be/src/vec/common/allocator.cpp:247
4# doris::ByteBuffer::ByteBuffer(unsigned long) at
/home/zcp/repo_center/doris_release/doris/be/src/util/byte_buffer.h:78
5# doris::ByteBuffer::allocate(unsigned long,
std::shared_ptr<doris::ByteBuffer>*) at
/usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:914
6# doris::StreamLoadAction::on_chunk_data(doris::HttpRequest*) at
/home/zcp/repo_center/doris_release/doris/be/src/common/status.h:525
7# ?
8# bufferevent_run_readcb_
9# bufferevent_readcb
10# event_process_active_single_queue
11# event_base_loop
12# std::_Function_handler<void (),
doris::EvHttpServer::start()::$_0>::_M_invoke(std::_Any_data const&) at
/usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:336
13# doris::ThreadPool::dispatch_thread() at
/usr/local/ldb-toolchain-v0.26/bin/../lib/gcc/x86_64-pc-linux-gnu/15/include/g++-v15/bits/shared_ptr_base.h:1097
14# doris::Thread::supervise_thread(void*) at
/usr/local/ldb-toolchain-v0.26/bin/../usr/include/pthread.h:562
15# start_thread at /data/qwit/glibc-2.18/nptl/pthread_create.c:309
16# clone at
/data/qwit/glibc-2.18/misc/../sysdeps/unix/sysv/linux/x86_64/clone.S:113
,
__FILE__:/home/zcp/repo_center/doris_release/doris/be/src/util/byte_buffer.h,
__LINE__:38, __FUNCTION__:static Status doris::ByteBuffer::allocate(const
size_t, ByteBufferPtr *), see more in null
at
org.apache.doris.flink.sink.writer.DorisWriter.prepareCommit(DorisWriter.java:200)
at
org.apache.flink.streaming.api.transformations.SinkV1Adapter$SinkWriterV1Adapter.prepareCommit(SinkV1Adapter.java:151)
at
org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.emitCommittables(SinkWriterOperator.java:196)
at
org.apache.flink.streaming.runtime.operators.sink.SinkWriterOperator.prepareSnapshotPreBarrier(SinkWriterOperator.java:166)
at
org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.prepareSnapshotPreBarrier(RegularOperatorChain.java:89)
at
org.apache.flink.streaming.runtime.tasks.SubtaskCheckpointCoordinatorImpl.checkpointState(SubtaskCheckpointCoordinatorImpl.java:321)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.lambda$performCheckpoint$14(StreamTask.java:1299)
at
org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$1.runThrowing(StreamTaskActionExecutor.java:50)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.performCheckpoint(StreamTask.java:1287)
at
org.apache.flink.streaming.runtime.tasks.StreamTask.triggerCheckpointAsyncInMailbox(StreamTask.java:1172)
... 14 more
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
