alinaliBQ opened a new issue, #49818: URL: https://github.com/apache/arrow/issues/49818
### Describe the enhancement requested After gRPC version bump https://github.com/apache/arrow/issues/46016 , we are seeing `GRPC_CALL_ERROR_TOO_MANY_OPERATIONS` in the ODBC **Linux** workflow. This error is flakey and I have not seen it locally. The newer gRPC version `v1.76.0` cannot handle the amount of new connections being made in the ODBC test suite. - This issue is different from https://github.com/apache/arrow/issues/49207 which documents the `GRPC_CALL_ERROR_TOO_MANY_OPERATIONS` error on **macOS**. ``` [----------] 5 tests from ConnectionHandleTest/0, where TypeParam = arrow::flight::sql::odbc::FlightSQLOdbcEnvConnHandleMockTestBase [ RUN ] ConnectionHandleTest/0.TestSQLDriverConnect WARNING: All log messages before absl::InitializeLog() is called are written to STDERR E0000 00:00:1776469248.640861 33119 call_op_set.h:979] API misuse of type GRPC_CALL_ERROR_TOO_MANY_OPERATIONS observed F0000 00:00:1776469248.640962 33119 call_op_set.h:981] Check failed: false *** Check failure stack trace: *** @ 0x7f8633abb94d absl::lts_20250127::log_internal::LogMessage::PrepareToDie() @ 0x7f8633abb9c5 absl::lts_20250127::log_internal::LogMessage::SendToLog() @ 0x7f8633abb3e1 absl::lts_20250127::log_internal::LogMessage::Flush() @ 0x7f8633abbce2 absl::lts_20250127::log_internal::LogMessageFatal::~LogMessageFatal() @ 0x7f86301a30d0 grpc::internal::CallOpSet<>::ContinueFillOpsAfterInterception() @ 0x7f863018357f grpc::internal::InterceptorBatchMethodsImpl::ProceedClient() @ 0x7f8630182266 grpc::internal::InterceptorBatchMethodsImpl::Proceed() @ 0x7f863016f78e arrow::flight::transport::grpc::(anonymous namespace)::GrpcClientInterceptorAdapter::Intercept() @ 0x7f86301817d7 grpc::experimental::ClientRpcInfo::RunInterceptor() @ 0x7f863018337a grpc::internal::InterceptorBatchMethodsImpl::RunClientInterceptors() @ 0x7f8630183226 grpc::internal::InterceptorBatchMethodsImpl::RunInterceptors() @ 0x7f86301a6d52 grpc::internal::CallOpSet<>::RunInterceptors() @ 0x7f86301a2d6a grpc::internal::CallOpSet<>::FillOps() @ 0x7f8630223f38 grpc::Channel::PerformOpsOnCall() @ 0x7f8630180c3b grpc::internal::Call::PerformOps() @ 0x7f863018809e grpc::ClientReaderWriter<>::Finish() @ 0x7f8630175c69 arrow::flight::transport::grpc::(anonymous namespace)::GrpcClientImpl::AuthenticateInternal() @ 0x7f8630172fe4 arrow::flight::transport::grpc::(anonymous namespace)::GrpcClientImpl::Authenticate() @ 0x7f8630129ece arrow::flight::FlightClient::Authenticate() @ 0x7f862ffbeaf3 arrow::flight::sql::odbc::(anonymous namespace)::TokenAuthMethod::Authenticate() @ 0x7f862ffc37d2 arrow::flight::sql::odbc::FlightSqlConnection::Connect() @ 0x7f863004d29c ODBC::ODBCConnection::Connect() @ 0x7f862ff7c002 arrow::flight::sql::odbc::SQLDriverConnectW()::{lambda()#1}::operator()() @ 0x7f862ff8662b ODBC::ODBCHandle<>::Execute<>() @ 0x7f862ff8657b ODBC::ODBCHandle<>::ExecuteWithLock<>() @ 0x7f862ff80a94 ODBC::ODBCHandle<>::ExecuteWithDiagnostics<>() @ 0x7f862ff7c418 arrow::flight::sql::odbc::SQLDriverConnectW() @ 0x7f862ff7444d SQLDriverConnectW @ 0x7f8664e8b6d7 SQLDriverConnectW @ 0x5563c61b58e8 arrow::flight::sql::odbc::ConnectionHandleTest_TestSQLDriverConnect_Test<>::TestBody() @ 0x7f8664cc1347 testing::internal::HandleSehExceptionsInMethodIfSupported<>() @ 0x7f8664cb705f testing::internal::HandleExceptionsInMethodIfSupported<>() @ 0x7f8664c8bbdc testing::Test::Run() @ 0x7f8664c8c69a testing::TestInfo::Run() @ 0x7f8664c8d071 testing::TestSuite::Run() @ 0x7f8664c9d669 testing::internal::UnitTestImpl::RunAllTests() @ 0x7f8664cc2a5e testing::internal::HandleSehExceptionsInMethodIfSupported<>() @ 0x7f8664cb8521 testing::internal::HandleExceptionsInMethodIfSupported<>() @ 0x7f8664c9b670 testing::UnitTest::Run() @ 0x7f8664ce7a25 RUN_ALL_TESTS() @ 0x7f8664ce7a0d main @ 0x7f86645701ca (unknown) @ 0x7f866457028b __libc_start_main @ 0x5563c6058025 _start !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Running '/arrow/build/cpp/debug/arrow-flight-sql-odbc-test' produced core dump at '/tmp/core.arrow-flight-sq.33119', printing backtrace: [New LWP 33119] [New LWP 33120] [New LWP 33151] [New LWP 33127] [New LWP 33123] [New LWP 33155] [New LWP 33125] [New LWP 33121] [New LWP 33148] [New LWP 33153] [New LWP 33150] [New LWP 33149] [New LWP 33243] [New LWP 33147] [New LWP 33154] [New LWP 33141] [New LWP 33124] [New LWP 33122] [New LWP 33157] [New LWP 33280] [New LWP 33152] [New LWP 33126] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/arrow/build/cpp/debug/arrow-flight-sql-odbc-test'. Program terminated with signal SIGABRT, Aborted. #0 0x00007f86645e4b2c in pthread_kill () from /lib/x86_64-linux-gnu/libc.so.6 [Current thread is 1 (Thread 0x7f8663485980 (LWP 33119))] Thread 22 (Thread 0x7f8652ffe6c0 (LWP 33126)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c79270b5 in grpc_core::Notification::WaitForNotificationWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/util/notification.h:47 #10 0x00005563c802c20c in grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::Lifeguard::LifeguardMain () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:409 #11 0x00005563c802bed0 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:385 #12 0x00005563c802bef4 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:386 #13 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #14 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #15 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 21 (Thread 0x7f861ffff6c0 (LWP 33152)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8633b347a1 in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00007f8633b34336 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00007f8633b344a9 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00007f8633b34bd0 in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00007f8633b3dcf6 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00007f8633b35bfd in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00007f8633b3ced7 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00007f8630379901 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00007f863037b3f5 in grpc_core::Notification::WaitForNotificationWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/util/notification.h:47 #10 0x00007f8630a78abc in grpc_event_engine::experimental::WorkStealingThreadPool::WorkStealingThreadPoolImpl::Lifeguard::LifeguardMain () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:409 #11 0x00007f8630a78780 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:385 #12 0x00007f8630a787a4 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:386 #13 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #14 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #15 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 20 (Thread 0x7f85c3fef6c0 (LWP 33280)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f86301766ef in wait<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()>::<lambda()> >(void) () at /usr/include/c++/13/condition_variable:105 #3 0x00007f8630171c64 in operator() () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:594 #4 0x00007f863017cc55 in __invoke_impl<void, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:61 #5 0x00007f863017cc18 in __invoke<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:96 #6 0x00007f863017cb50 in _M_invoke<0> () at /usr/include/c++/13/bits/std_thread.h:292 #7 0x00007f863017c926 in operator() () at /usr/include/c++/13/bits/std_thread.h:299 #8 0x00007f863017b148 in _M_run () at /usr/include/c++/13/bits/std_thread.h:244 #9 0x00007f866495bdb4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #10 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #11 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 19 (Thread 0x7f860dffd6c0 (LWP 33157)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f86301766ef in wait<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()>::<lambda()> >(void) () at /usr/include/c++/13/condition_variable:105 #3 0x00007f8630171c64 in operator() () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:594 #4 0x00007f863017cc55 in __invoke_impl<void, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:61 #5 0x00007f863017cc18 in __invoke<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:96 #6 0x00007f863017cb50 in _M_invoke<0> () at /usr/include/c++/13/bits/std_thread.h:292 #7 0x00007f863017c926 in operator() () at /usr/include/c++/13/bits/std_thread.h:299 #8 0x00007f863017b148 in _M_run () at /usr/include/c++/13/bits/std_thread.h:244 #9 0x00007f866495bdb4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #10 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #11 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 18 (Thread 0x7f865bfff6c0 (LWP 33122)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c801b15a in grpc_event_engine::experimental::TimerManager::WaitUntil () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/timer_manager.cc:56 #10 0x00005563c801b20d in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/timer_manager.cc:75 #11 0x00005563c801cabf in __invoke_impl<void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:61 #12 0x00005563c801ca56 in __invoke<grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:96 #13 0x00005563c801c9b5 in invoke<grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/functional:113 #14 0x00005563c801c8fa in InvokeR<void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:132 #15 0x00005563c801c83f in RemoteInvoker<false, void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:368 #16 0x00005563c78a8bbc in absl::lts_20250127::internal_any_invocable::Impl<void()>::operator() () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:868 #17 0x00005563c802deb6 in grpc_event_engine::experimental::SelfDeletingClosure::Run () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/common_closures.h:54 #18 0x00005563c802cf15 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:534 #19 0x00005563c802cae1 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #20 0x00005563c802b04b in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #21 0x00005563c802b091 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #22 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #23 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #24 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #25 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 17 (Thread 0x7f8659ffd6c0 (LWP 33124)): #0 0x00007f8664670072 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c7fb93b9 in grpc_event_engine::experimental::Epoll1Poller::DoEpollWait () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/ev_epoll1_linux.cc:366 #2 0x00005563c7fb97b0 in grpc_event_engine::experimental::Epoll1Poller::Work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/ev_epoll1_linux.cc:424 #3 0x00005563c7fe0a3a in grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/posix_engine.cc:236 #4 0x00005563c7fe08c9 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/posix_engine.cc:243 #5 0x00005563c7fe9020 in __invoke_impl<void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:61 #6 0x00005563c7fe8d97 in __invoke<grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:96 #7 0x00005563c7fe8a3c in invoke<grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/functional:113 #8 0x00005563c7fe83d9 in InvokeR<void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:132 #9 0x00005563c7fe7b54 in LocalInvoker<false, void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:310 #10 0x00005563c78a8bbc in absl::lts_20250127::internal_any_invocable::Impl<void()>::operator() () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:868 #11 0x00005563c802deb6 in grpc_event_engine::experimental::SelfDeletingClosure::Run () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/common_closures.h:54 #12 0x00005563c802cf15 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:534 #13 0x00005563c802cae1 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #14 0x00005563c802b04b in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #15 0x00005563c802b091 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #16 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #17 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #18 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #19 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 16 (Thread 0x7f863bfff6c0 (LWP 33141)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f8632f266eb in background_thread_sleep (tsdn=0x7f8634000b88, info=0x7f8660417480, interval=18446744073709551615) at src/background_thread.c:137 #3 0x00007f8632f26ba0 in background_work_sleep_once (tsdn=0x7f8634000b88, info=0x7f8660417480, ind=0) at src/background_thread.c:229 #4 0x00007f8632f2720a in background_thread0_work (tsd=0x7f8634000b88) at src/background_thread.c:374 #5 0x00007f8632f2750e in background_work (tsd=0x7f8634000b88, ind=0) at src/background_thread.c:412 #6 0x00007f8632f276b9 in background_thread_entry (ind_arg=0x0) at src/background_thread.c:444 #7 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #8 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 15 (Thread 0x7f861dffd6c0 (LWP 33154)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f86301766ef in wait<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()>::<lambda()> >(void) () at /usr/include/c++/13/condition_variable:105 #3 0x00007f8630171c64 in operator() () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:594 #4 0x00007f863017cc55 in __invoke_impl<void, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:61 #5 0x00007f863017cc18 in __invoke<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:96 #6 0x00007f863017cb50 in _M_invoke<0> () at /usr/include/c++/13/bits/std_thread.h:292 #7 0x00007f863017c926 in operator() () at /usr/include/c++/13/bits/std_thread.h:299 #8 0x00007f863017b148 in _M_run () at /usr/include/c++/13/bits/std_thread.h:244 #9 0x00007f866495bdb4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #10 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #11 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 14 (Thread 0x7f863affe6c0 (LWP 33147)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8633b347a1 in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00007f8633b34336 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00007f8633b344a9 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00007f8633b34bd0 in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00007f8633b3dcf6 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00007f8633b35bfd in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00007f8633b3ced7 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00007f8630379901 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00007f8631099acc in gpr_cv_wait () at /arrow/build/cpp/_deps/grpc-src/src/core/util/sync_abseil.cc:84 #10 0x00007f8630ae58a3 in wait_until () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:186 #11 0x00007f8630ae5b8c in timer_main_loop () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:238 #12 0x00007f8630ae5d91 in timer_thread () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:265 #13 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #14 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #15 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 13 (Thread 0x7f860effe6c0 (LWP 33243)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c8640584 in gpr_cv_wait () at /arrow/build/cpp/_deps/grpc-src/src/core/util/sync_abseil.cc:84 #10 0x00005563c804960b in begin_worker () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_epoll1_linux.cc:837 #11 0x00005563c804a78f in pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_epoll1_linux.cc:1012 #12 0x00005563c80542cb in pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_posix.cc:242 #13 0x00005563c8061625 in grpc_pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/pollset.cc:48 #14 0x00005563c8127ee9 in maybe_event_engine_pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:220 #15 0x00005563c812b5d2 in cq_next () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:1076 #16 0x00005563c812bf96 in grpc_completion_queue_next () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:1153 #17 0x00005563c77ad6ce in grpc::CompletionQueue::AsyncNextInternal () at /arrow/build/cpp/_deps/grpc-src/src/cpp/common/completion_queue_cc.cc:147 #18 0x00005563c77fe7ad in grpc::CompletionQueue::AsyncNext<gpr_timespec> () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/completion_queue.h:201 #19 0x00005563c77fcb60 in grpc::Server::SyncRequestThreadManager::PollForWork () at /arrow/build/cpp/_deps/grpc-src/src/cpp/server/server_cc.cc:825 #20 0x00005563c7810e1b in grpc::ThreadManager::MainWorkLoop () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:153 #21 0x00005563c7810357 in grpc::ThreadManager::WorkerThread::Run () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:47 #22 0x00005563c781017e in operator() () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:39 #23 0x00005563c78101a2 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:39 #24 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #25 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #26 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #27 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 12 (Thread 0x7f8627fff6c0 (LWP 33149)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8633b347a1 in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00007f8633b34336 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00007f8633b344a9 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00007f8633b34bd0 in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00007f8633b3dcf6 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00007f8633b35bfd in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00007f8633b3ced7 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00007f8630379901 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00007f8630a677ae in grpc_event_engine::experimental::TimerManager::WaitUntil () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/timer_manager.cc:56 #10 0x00007f8630a67861 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/timer_manager.cc:75 #11 0x00007f8630a69113 in __invoke_impl<void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:61 #12 0x00007f8630a690aa in __invoke<grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:96 #13 0x00007f8630a69009 in invoke<grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /usr/include/c++/13/functional:113 #14 0x00007f8630a68f4e in InvokeR<void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:132 #15 0x00007f8630a68e93 in RemoteInvoker<false, void, grpc_event_engine::experimental::TimerManager::MainLoop()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:368 #16 0x00007f86302f37b2 in absl::lts_20250127::internal_any_invocable::Impl<void()>::operator() () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:868 #17 0x00007f8630a7a766 in grpc_event_engine::experimental::SelfDeletingClosure::Run () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/common_closures.h:54 #18 0x00007f8630a797c5 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:534 #19 0x00007f8630a79391 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #20 0x00007f8630a778fb in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #21 0x00007f8630a77941 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #22 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #23 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #24 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #25 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 11 (Thread 0x7f8626ffe6c0 (LWP 33150)): #0 0x00007f8664670072 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8630a0482d in grpc_event_engine::experimental::Epoll1Poller::DoEpollWait () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/ev_epoll1_linux.cc:366 #2 0x00007f8630a04c24 in grpc_event_engine::experimental::Epoll1Poller::Work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/ev_epoll1_linux.cc:424 #3 0x00007f8630a2c652 in grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/posix_engine.cc:236 #4 0x00007f8630a2c4e1 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/posix_engine/posix_engine.cc:243 #5 0x00007f8630a34c38 in __invoke_impl<void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:61 #6 0x00007f8630a349af in __invoke<grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/bits/invoke.h:96 #7 0x00007f8630a34654 in invoke<grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /usr/include/c++/13/functional:113 #8 0x00007f8630a33ff1 in InvokeR<void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:132 #9 0x00007f8630a3376c in LocalInvoker<false, void, grpc_event_engine::experimental::PosixEventEngine::PollingCycle::PollerWorkInternal()::<lambda()>&>(void) () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:310 #10 0x00007f86302f37b2 in absl::lts_20250127::internal_any_invocable::Impl<void()>::operator() () at /arrow/build/cpp/_deps/absl-src/absl/functional/internal/any_invocable.h:868 #11 0x00007f8630a7a766 in grpc_event_engine::experimental::SelfDeletingClosure::Run () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/common_closures.h:54 #12 0x00007f8630a797c5 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:534 #13 0x00007f8630a79391 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #14 0x00007f8630a778fb in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #15 0x00007f8630a77941 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #16 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #17 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #18 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #19 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 10 (Thread 0x7f861effe6c0 (LWP 33153)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f86301766ef in wait<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()>::<lambda()> >(void) () at /usr/include/c++/13/condition_variable:105 #3 0x00007f8630171c64 in operator() () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:594 #4 0x00007f863017cc55 in __invoke_impl<void, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:61 #5 0x00007f863017cc18 in __invoke<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:96 #6 0x00007f863017cb50 in _M_invoke<0> () at /usr/include/c++/13/bits/std_thread.h:292 #7 0x00007f863017c926 in operator() () at /usr/include/c++/13/bits/std_thread.h:299 #8 0x00007f863017b148 in _M_run () at /usr/include/c++/13/bits/std_thread.h:244 #9 0x00007f866495bdb4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #10 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #11 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 9 (Thread 0x7f8639ffd6c0 (LWP 33148)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8633b347a1 in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00007f8633b34336 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00007f8633b344a9 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00007f8633b34bd0 in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00007f8633b3dcf6 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00007f8633b35bfd in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00007f8633b3ced7 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00007f8630379901 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00007f8630a79ec4 in grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:629 #10 0x00007f8630a798a2 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:565 #11 0x00007f8630a79391 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #12 0x00007f8630a778fb in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #13 0x00007f8630a77941 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #14 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #15 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #16 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #17 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 8 (Thread 0x7f86617be6c0 (LWP 33121)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c8640584 in gpr_cv_wait () at /arrow/build/cpp/_deps/grpc-src/src/core/util/sync_abseil.cc:84 #10 0x00005563c8097f87 in wait_until () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:186 #11 0x00005563c8098270 in timer_main_loop () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:238 #12 0x00005563c8098475 in timer_thread () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/timer_manager.cc:265 #13 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #14 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #15 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #16 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 7 (Thread 0x7f8653fff6c0 (LWP 33125)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c802d614 in grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:629 #10 0x00005563c802cff2 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:565 #11 0x00005563c802cae1 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #12 0x00005563c802b04b in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #13 0x00005563c802b091 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #14 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #15 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #16 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #17 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 6 (Thread 0x7f860ffff6c0 (LWP 33155)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f86301766ef in wait<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()>::<lambda()> >(void) () at /usr/include/c++/13/condition_variable:105 #3 0x00007f8630171c64 in operator() () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:594 #4 0x00007f863017cc55 in __invoke_impl<void, arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:61 #5 0x00007f863017cc18 in __invoke<arrow::flight::transport::grpc::(anonymous namespace)::GrpcGarbageBin::GrpcGarbageBin()::<lambda()> >(void) () at /usr/include/c++/13/bits/invoke.h:96 #6 0x00007f863017cb50 in _M_invoke<0> () at /usr/include/c++/13/bits/std_thread.h:292 #7 0x00007f863017c926 in operator() () at /usr/include/c++/13/bits/std_thread.h:299 #8 0x00007f863017b148 in _M_run () at /usr/include/c++/13/bits/std_thread.h:244 #9 0x00007f866495bdb4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6 #10 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #11 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 5 (Thread 0x7f865affe6c0 (LWP 33123)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8ebfdab in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00005563c8ebf940 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00005563c8ebfab3 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00005563c8ec01da in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00005563c8ec9300 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00005563c8ec1207 in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00005563c8ec84e1 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00005563c7925705 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00005563c802d614 in grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:629 #10 0x00005563c802cff2 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:565 #11 0x00005563c802cae1 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #12 0x00005563c802b04b in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #13 0x00005563c802b091 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #14 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #15 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #16 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #17 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 4 (Thread 0x7f8651ffd6c0 (LWP 33127)): #0 0x00007f8664670072 in epoll_wait () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00005563c8048d3a in do_epoll_wait () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_epoll1_linux.cc:735 #2 0x00005563c804a909 in pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_epoll1_linux.cc:1035 #3 0x00005563c80542cb in pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/ev_posix.cc:242 #4 0x00005563c8061625 in grpc_pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/iomgr/pollset.cc:48 #5 0x00005563c8127ee9 in maybe_event_engine_pollset_work () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:220 #6 0x00005563c812b5d2 in cq_next () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:1076 #7 0x00005563c812bf96 in grpc_completion_queue_next () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/surface/completion_queue.cc:1153 #8 0x00005563c77ad6ce in grpc::CompletionQueue::AsyncNextInternal () at /arrow/build/cpp/_deps/grpc-src/src/cpp/common/completion_queue_cc.cc:147 #9 0x00005563c77fe7ad in grpc::CompletionQueue::AsyncNext<gpr_timespec> () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/completion_queue.h:201 #10 0x00005563c77fcb60 in grpc::Server::SyncRequestThreadManager::PollForWork () at /arrow/build/cpp/_deps/grpc-src/src/cpp/server/server_cc.cc:825 #11 0x00005563c7810e1b in grpc::ThreadManager::MainWorkLoop () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:153 #12 0x00005563c7810357 in grpc::ThreadManager::WorkerThread::Run () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:47 #13 0x00005563c781017e in operator() () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:39 #14 0x00005563c78101a2 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/cpp/thread_manager/thread_manager.cc:39 #15 0x00005563c863d6c2 in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #16 0x00005563c863d70f in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #17 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #18 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 3 (Thread 0x7f8625ffd6c0 (LWP 33151)): #0 0x00007f866466d28d in syscall () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f8633b347a1 in absl::lts_20250127::synchronization_internal::FutexImpl::WaitRelativeTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex.h:130 #2 0x00007f8633b34336 in absl::lts_20250127::synchronization_internal::FutexWaiter::WaitUntil () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:53 #3 0x00007f8633b344a9 in absl::lts_20250127::synchronization_internal::FutexWaiter::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/futex_waiter.cc:78 #4 0x00007f8633b34bd0 in AbslInternalPerThreadSemWait_lts_20250127 () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.cc:93 #5 0x00007f8633b3dcf6 in absl::lts_20250127::synchronization_internal::PerThreadSem::Wait () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/internal/per_thread_sem.h:116 #6 0x00007f8633b35bfd in absl::lts_20250127::Mutex::DecrementSynchSem () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:598 #7 0x00007f8633b3ced7 in absl::lts_20250127::CondVar::WaitCommon () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.cc:2642 #8 0x00007f8630379901 in absl::lts_20250127::CondVar::WaitWithTimeout () at /arrow/build/cpp/_deps/absl-src/absl/synchronization/mutex.h:943 #9 0x00007f8630a79ec4 in grpc_event_engine::experimental::WorkStealingThreadPool::WorkSignal::WaitWithTimeout () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:629 #10 0x00007f8630a798a2 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::Step () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:565 #11 0x00007f8630a79391 in grpc_event_engine::experimental::WorkStealingThreadPool::ThreadState::ThreadBody () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:497 #12 0x00007f8630a778fb in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:259 #13 0x00007f8630a77941 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/lib/event_engine/thread_pool/work_stealing_thread_pool.cc:261 #14 0x00007f8631096c0a in operator() () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:145 #15 0x00007f8631096c57 in _FUN () at /arrow/build/cpp/_deps/grpc-src/src/core/util/posix/thd.cc:150 #16 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #17 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 2 (Thread 0x7f86629ff6c0 (LWP 33120)): #0 0x00007f86645ded71 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f86645e17ed in pthread_cond_wait () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00005563c8670034 in background_thread_sleep (tsdn=0x7f86629fe708, info=0x7f8663017480, interval=18446744073709551615) at src/background_thread.c:137 #3 0x00005563c86704e9 in background_work_sleep_once (tsdn=0x7f86629fe708, info=0x7f8663017480, ind=0) at src/background_thread.c:229 #4 0x00005563c8670b53 in background_thread0_work (tsd=0x7f86629fe708) at src/background_thread.c:374 #5 0x00005563c8670e57 in background_work (tsd=0x7f86629fe708, ind=0) at src/background_thread.c:412 #6 0x00005563c8671002 in background_thread_entry (ind_arg=0x0) at src/background_thread.c:444 #7 0x00007f86645e2aa4 in ?? () from /lib/x86_64-linux-gnu/libc.so.6 #8 0x00007f866466fc6c in ?? () from /lib/x86_64-linux-gnu/libc.so.6 Thread 1 (Thread 0x7f8663485980 (LWP 33119)): #0 0x00007f86645e4b2c in pthread_kill () from /lib/x86_64-linux-gnu/libc.so.6 #1 0x00007f866458b27e in raise () from /lib/x86_64-linux-gnu/libc.so.6 #2 0x00007f866456e8ff in abort () from /lib/x86_64-linux-gnu/libc.so.6 #3 0x00007f8633abaf31 in absl::lts_20250127::log_internal::LogMessage::FailWithoutStackTrace () at /arrow/build/cpp/_deps/absl-src/absl/log/internal/log_message.cc:390 #4 0x00007f8633abb994 in absl::lts_20250127::log_internal::LogMessage::Die () at /arrow/build/cpp/_deps/absl-src/absl/log/internal/log_message.cc:550 #5 0x00007f8633abba48 in absl::lts_20250127::log_internal::LogMessage::SendToLog () at /arrow/build/cpp/_deps/absl-src/absl/log/internal/log_message.cc:559 #6 0x00007f8633abb3e1 in absl::lts_20250127::log_internal::LogMessage::Flush () at /arrow/build/cpp/_deps/absl-src/absl/log/internal/log_message.cc:471 #7 0x00007f8633abbce2 in absl::lts_20250127::log_internal::LogMessageFatal::~LogMessageFatal () at /arrow/build/cpp/_deps/absl-src/absl/log/internal/log_message.cc:694 #8 0x00007f86301a30d0 in grpc::internal::CallOpSet<grpc::internal::CallOpRecvInitialMetadata, grpc::internal::CallOpClientRecvStatus, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6> >::ContinueFillOpsAfterInterception () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/call_op_set.h:981 #9 0x00007f863018357f in grpc::internal::InterceptorBatchMethodsImpl::ProceedClient () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/interceptor_common.h:326 #10 0x00007f8630182266 in grpc::internal::InterceptorBatchMethodsImpl::Proceed () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/interceptor_common.h:58 #11 0x00007f863016f78e in Intercept () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:145 #12 0x00007f86301817d7 in grpc::experimental::ClientRpcInfo::RunInterceptor () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/support/client_interceptor.h:144 #13 0x00007f863018337a in grpc::internal::InterceptorBatchMethodsImpl::RunClientInterceptors () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/interceptor_common.h:288 #14 0x00007f8630183226 in grpc::internal::InterceptorBatchMethodsImpl::RunInterceptors () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/interceptor_common.h:246 #15 0x00007f86301a6d52 in grpc::internal::CallOpSet<grpc::internal::CallOpRecvInitialMetadata, grpc::internal::CallOpClientRecvStatus, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6> >::RunInterceptors () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/call_op_set.h:1013 #16 0x00007f86301a2d6a in grpc::internal::CallOpSet<grpc::internal::CallOpRecvInitialMetadata, grpc::internal::CallOpClientRecvStatus, grpc::internal::CallNoOp<3>, grpc::internal::CallNoOp<4>, grpc::internal::CallNoOp<5>, grpc::internal::CallNoOp<6> >::FillOps () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/call_op_set.h:901 #17 0x00007f8630223f38 in grpc::Channel::PerformOpsOnCall () at /arrow/build/cpp/_deps/grpc-src/src/cpp/client/channel_cc.cc:171 #18 0x00007f8630180c3b in grpc::internal::Call::PerformOps () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/impl/call.h:67 #19 0x00007f863018809e in grpc::ClientReaderWriter<arrow::flight::protocol::HandshakeRequest, arrow::flight::protocol::HandshakeResponse>::Finish () at /arrow/build/cpp/_deps/grpc-src/include/grpcpp/support/sync_stream.h:539 #20 0x00007f8630175c69 in AuthenticateInternal () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:1089 #21 0x00007f8630172fe4 in Authenticate () at /arrow/cpp/src/arrow/flight/transport/grpc/grpc_client.cc:878 #22 0x00007f8630129ece in arrow::flight::FlightClient::Authenticate () at /arrow/cpp/src/arrow/flight/client.cc:575 #23 0x00007f862ffbeaf3 in Authenticate () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/flight_sql_auth_method.cc:131 #24 0x00007f862ffc37d2 in arrow::flight::sql::odbc::FlightSqlConnection::Connect () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/flight_sql_connection.cc:169 #25 0x00007f863004d29c in ODBC::ODBCConnection::Connect () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/odbc_connection.cc:90 #26 0x00007f862ff7c002 in operator() () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_api.cc:908 #27 0x00007f862ff8662b in Execute<arrow::flight::sql::odbc::SQLDriverConnectW(SQLHDBC, SQLHWND, SQLWCHAR*, SQLSMALLINT, SQLWCHAR*, SQLSMALLINT, SQLSMALLINT*, SQLUSMALLINT)::<lambda()> >(void) () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/odbc_handle.h:49 #28 0x00007f862ff8657b in ExecuteWithLock<arrow::flight::sql::odbc::SQLDriverConnectW(SQLHDBC, SQLHWND, SQLWCHAR*, SQLSMALLINT, SQLWCHAR*, SQLSMALLINT, SQLSMALLINT*, SQLUSMALLINT)::<lambda()> >(void) () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/odbc_handle.h:85 #29 0x00007f862ff80a94 in ExecuteWithDiagnostics<arrow::flight::sql::odbc::SQLDriverConnectW(SQLHDBC, SQLHWND, SQLWCHAR*, SQLSMALLINT, SQLWCHAR*, SQLSMALLINT, SQLSMALLINT*, SQLUSMALLINT)::<lambda()> >(void) () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_impl/odbc_handle.h:95 #30 0x00007f862ff7c418 in arrow::flight::sql::odbc::SQLDriverConnectW () at /arrow/cpp/src/arrow/flight/sql/odbc/odbc_api.cc:857 #31 0x00007f862ff7444d in SQLDriverConnectW () at /arrow/cpp/src/arrow/flight/sql/odbc/entry_points.cc:135 #32 0x00007f8664e8b6d7 in SQLDriverConnectW () from /lib/x86_64-linux-gnu/libodbc.so.2 #33 0x00005563c61b58e8 in arrow::flight::sql::odbc::ConnectionHandleTest_TestSQLDriverConnect_Test<arrow::flight::sql::odbc::FlightSQLOdbcEnvConnHandleMockTestBase>::TestBody () at /arrow/cpp/src/arrow/flight/sql/odbc/tests/connection_test.cc:229 #34 0x00007f8664cc1347 in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void> () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2664 #35 0x00007f8664cb705f in testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void> () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2700 #36 0x00007f8664c8bbdc in testing::Test::Run () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2739 #37 0x00007f8664c8c69a in testing::TestInfo::Run () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2885 #38 0x00007f8664c8d071 in testing::TestSuite::Run () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:3063 #39 0x00007f8664c9d669 in testing::internal::UnitTestImpl::RunAllTests () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:6054 #40 0x00007f8664cc2a5e in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2664 #41 0x00007f8664cb8521 in testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:2700 #42 0x00007f8664c9b670 in testing::UnitTest::Run () at /arrow/build/cpp/_deps/googletest-src/googletest/src/gtest.cc:5594 #43 0x00007f8664ce7a25 in RUN_ALL_TESTS () at /arrow/build/cpp/_deps/googletest-src/googletest/include/gtest/gtest.h:2334 #44 0x00007f8664ce7a0d in main () at /arrow/build/cpp/_deps/googletest-src/googlemock/src/gmock_main.cc:71 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! /arrow/build/cpp/src/arrow/flight/sql/odbc/tests Start 71: arrow-flight-sql-odbc-test Test #71: arrow-flight-sql-odbc-test ............ Passed 8.50 sec ... Errors while running CTest ``` ### Component(s) FlightRPC, C++ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
