[ https://issues.apache.org/jira/browse/GEODE-9431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17382243#comment-17382243 ]
Blake Bender edited comment on GEODE-9431 at 7/16/21, 5:53 PM: --------------------------------------------------------------- This failure appears to be due to some upgrade we took on RHEL-8 several weeks ago - most likely compiler/toolchain. It only fails on RHEL-8, and only on release-built bits. Failure is a crash in `std::regex`, way down in the guts of the library code. Here's the callstack: {code:java} Program received signal SIGSEGV, Segmentation fault. 0x0000000000000000 in ?? () Missing separate debuginfos, use: yum debuginfo-install libgcc-8.4.1-1.el8.x86_64 libstdc++-8.4.1-1.el8.x86_64 openssl-libs-1.1.1g-15.el8_3.x86_64 zlib-1.2.11-17.el8.x86_64 (gdb) bt #0 0x0000000000000000 in ?? () #1 0x000000000064c8cc in std::ctype<char>::narrow (__dfault=32 ' ', __c=115 's', this=0x7ffff70286a0) at /usr/include/c++/8/bits/locale_facets.h:935 #2 std::__detail::_Scanner<char>::_M_scan_normal (this=0x7fffffffde58) at /usr/include/c++/8/bits/regex_scanner.tcc:101 #3 std::__detail::_Scanner<char>::_M_advance (this=<optimized out>) at /usr/include/c++/8/bits/regex_scanner.tcc:80 #4 0x00000000006583c0 in std::_detail::_Scanner<char>::_Scanner (_loc=..., __flags=<optimized out>, __end=<optimized out>, __begin=<optimized out>, this=<optimized out>, this=<optimized out>, __begin=<optimized out>, __end=<optimized out>, __flags=<optimized out>, __loc=...) at /usr/include/c++/8/bits/regex_constants.h:185 #5 std::_detail::_Compiler<std::_cxx11::regex_traits<char> >::_Compiler (this=<optimized out>, __b=<optimized out>, __e=<optimized out>, __loc=..., __flags=<optimized out>) at /usr/include/c++/8/bits/regex_compiler.tcc:80 #6 0x0000000000522da0 in std::_detail::compile_nfa<std::cxx11::regex_traits<char>, char const*> (_flags=<optimized out>, __loc=..., __last=<optimized out>, __first=<optimized out>) at /usr/include/c++/8/bits/regex_compiler.h:193 #7 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<char const*> (_f=<optimized out>, __loc=..., __last=<optimized out>, __first=<optimized out>, this=<optimized out>, this=<optimized out>, __first=<optimized out>, __last=<optimized out>, __loc=..., __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:761 #8 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<char const*> (_f=<optimized out>, __last=<optimized out>, __first=<optimized out>, this=<optimized out>, this=<optimized out>, __first=<optimized out>, __last=<optimized out>, __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:506 #9 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<std::char_traits<char>, std::allocator<char> > (_f=<optimized out>, __s=..., this=<optimized out>, this=<optimized out>, __s=..., __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:487 #10 apache::geode::statistics::forEachIndexStatFile<apache::geode::statistics::HostStatSampler::initRollIndex()::<lambda(int32_t, const boost::filesystem::path&)> >(void) ( this=<optimized out>, function=...) at /home/bblake/geode-native/cppcache/src/statistics/HostStatSampler.cpp:375 #11 0x0000000000602181 in apache::geode::statistics::HostStatSampler::initRollIndex (this=0x7fffffffe040) at /home/bblake/geode-native/cppcache/src/statistics/HostStatSampler.cpp:124 #12 TestableHostStatSampler::initRollIndex (this=0x7fffffffe040) at /home/bblake/geode-native/cppcache/test/statistics/HostStatSamplerTest.cpp:67 #13 HostStatSamplerTest_initRollIndexNoFiles_Test::TestBody (this=<optimized out>) at /home/bblake/geode-native/cppcache/test/statistics/HostStatSamplerTest.cpp:401 #14 0x00000000008400ca in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void> (location=0x93abd8 "the test body", method=<optimized out>, object=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2414 #15 testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void> (object=object@entry=0xcf1600, method=<optimized out>, location=location@entry=0x93abd8 "the test body") at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2469 #16 0x0000000000837ad0 in testing::Test::Run (this=this@entry=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2508 #17 0x0000000000837d2a in testing::Test::Run (this=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2684 #18 testing::TestInfo::Run (this=0xcc9650) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2684 #19 0x0000000000837e9b in testing::TestInfo::Run (this=<optimized out>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2658 #20 testing::TestSuite::Run (this=0xcc6830) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2816 #21 0x00000000008384c3 in testing::TestSuite::Run (this=<optimized out>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2796 #22 testing::internal::UnitTestImpl::RunAllTests (this=0xcbff60) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:5338 #23 0x000000000084058a in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> ( location=0x93bff0 "auxiliary test code (environments or event listeners)", method=<optimized out>, object=0xcbff60) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2414 #24 testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0xcbff60, method=<optimized out>, location=location@entry=0x93bff0 "auxiliary test code (environments or event listeners)") at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2469 #25 0x0000000000838726 in testing::UnitTest::Run (this=0xca5f00 <testing::UnitTest::GetInstance()::instance>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/include/gtest/gtest.h:1412 #26 0x0000000000491b77 in RUN_ALL_TESTS () at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/include/gtest/gtest.h:2473 #27 main (argc=<optimized out>, argv=0x7fffffffe438) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest_main.cc:45 (gdb) {code} was (Author: bbender): This failure appears to be due to some upgrade we took on RHEL-8 several weeks ago - most likely compiler/toolchain. It only fails on RHEL-8, and only on release-built bits. Failure is a crash in `std::regex` code, way down in the guts of the library code. Here's the callstack: {code:java} Program received signal SIGSEGV, Segmentation fault. 0x0000000000000000 in ?? () Missing separate debuginfos, use: yum debuginfo-install libgcc-8.4.1-1.el8.x86_64 libstdc++-8.4.1-1.el8.x86_64 openssl-libs-1.1.1g-15.el8_3.x86_64 zlib-1.2.11-17.el8.x86_64 (gdb) bt #0 0x0000000000000000 in ?? () #1 0x000000000064c8cc in std::ctype<char>::narrow (__dfault=32 ' ', __c=115 's', this=0x7ffff70286a0) at /usr/include/c++/8/bits/locale_facets.h:935 #2 std::__detail::_Scanner<char>::_M_scan_normal (this=0x7fffffffde58) at /usr/include/c++/8/bits/regex_scanner.tcc:101 #3 std::__detail::_Scanner<char>::_M_advance (this=<optimized out>) at /usr/include/c++/8/bits/regex_scanner.tcc:80 #4 0x00000000006583c0 in std::_detail::_Scanner<char>::_Scanner (_loc=..., __flags=<optimized out>, __end=<optimized out>, __begin=<optimized out>, this=<optimized out>, this=<optimized out>, __begin=<optimized out>, __end=<optimized out>, __flags=<optimized out>, __loc=...) at /usr/include/c++/8/bits/regex_constants.h:185 #5 std::_detail::_Compiler<std::_cxx11::regex_traits<char> >::_Compiler (this=<optimized out>, __b=<optimized out>, __e=<optimized out>, __loc=..., __flags=<optimized out>) at /usr/include/c++/8/bits/regex_compiler.tcc:80 #6 0x0000000000522da0 in std::_detail::compile_nfa<std::cxx11::regex_traits<char>, char const*> (_flags=<optimized out>, __loc=..., __last=<optimized out>, __first=<optimized out>) at /usr/include/c++/8/bits/regex_compiler.h:193 #7 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<char const*> (_f=<optimized out>, __loc=..., __last=<optimized out>, __first=<optimized out>, this=<optimized out>, this=<optimized out>, __first=<optimized out>, __last=<optimized out>, __loc=..., __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:761 #8 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<char const*> (_f=<optimized out>, __last=<optimized out>, __first=<optimized out>, this=<optimized out>, this=<optimized out>, __first=<optimized out>, __last=<optimized out>, __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:506 #9 std::_cxx11::basic_regex<char, std::cxx11::regex_traits<char> >::basic_regex<std::char_traits<char>, std::allocator<char> > (_f=<optimized out>, __s=..., this=<optimized out>, this=<optimized out>, __s=..., __f=<optimized out>) at /usr/include/c++/8/bits/regex.h:487 #10 apache::geode::statistics::forEachIndexStatFile<apache::geode::statistics::HostStatSampler::initRollIndex()::<lambda(int32_t, const boost::filesystem::path&)> >(void) ( this=<optimized out>, function=...) at /home/bblake/geode-native/cppcache/src/statistics/HostStatSampler.cpp:375 #11 0x0000000000602181 in apache::geode::statistics::HostStatSampler::initRollIndex (this=0x7fffffffe040) at /home/bblake/geode-native/cppcache/src/statistics/HostStatSampler.cpp:124 #12 TestableHostStatSampler::initRollIndex (this=0x7fffffffe040) at /home/bblake/geode-native/cppcache/test/statistics/HostStatSamplerTest.cpp:67 #13 HostStatSamplerTest_initRollIndexNoFiles_Test::TestBody (this=<optimized out>) at /home/bblake/geode-native/cppcache/test/statistics/HostStatSamplerTest.cpp:401 #14 0x00000000008400ca in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void> (location=0x93abd8 "the test body", method=<optimized out>, object=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2414 #15 testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void> (object=object@entry=0xcf1600, method=<optimized out>, location=location@entry=0x93abd8 "the test body") at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2469 #16 0x0000000000837ad0 in testing::Test::Run (this=this@entry=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2508 #17 0x0000000000837d2a in testing::Test::Run (this=0xcf1600) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2684 #18 testing::TestInfo::Run (this=0xcc9650) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2684 #19 0x0000000000837e9b in testing::TestInfo::Run (this=<optimized out>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2658 #20 testing::TestSuite::Run (this=0xcc6830) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2816 #21 0x00000000008384c3 in testing::TestSuite::Run (this=<optimized out>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2796 #22 testing::internal::UnitTestImpl::RunAllTests (this=0xcbff60) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:5338 #23 0x000000000084058a in testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> ( location=0x93bff0 "auxiliary test code (environments or event listeners)", method=<optimized out>, object=0xcbff60) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2414 #24 testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool> (object=0xcbff60, method=<optimized out>, location=location@entry=0x93bff0 "auxiliary test code (environments or event listeners)") at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest.cc:2469 #25 0x0000000000838726 in testing::UnitTest::Run (this=0xca5f00 <testing::UnitTest::GetInstance()::instance>) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/include/gtest/gtest.h:1412 #26 0x0000000000491b77 in RUN_ALL_TESTS () at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/include/gtest/gtest.h:2473 #27 main (argc=<optimized out>, argv=0x7fffffffe438) at /home/bblake/geode-native/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest_main.cc:45 (gdb) {code} > CI Failure: SegFault in apache-geode_unittests > ---------------------------------------------- > > Key: GEODE-9431 > URL: https://issues.apache.org/jira/browse/GEODE-9431 > Project: Geode > Issue Type: Bug > Components: native client > Reporter: Kamilla Aslami > Priority: Major > > {{Two consequent geode-native-develop/build-rhel-8-release runs failed with > segmentation fault: }} > {noformat} > selected worker: 3eb01fee-0959-4e2d-8c25-44a153962eaa > Warning: Permanently added '34.67.7.72' (ECDSA) to the list of known hosts. > Test project /home/build/build/cppcache/test > Start 1: apache-geode_unittests > 1/1 Test #1: apache-geode_unittests ...........***Exception: SegFault 0.43 > sec > Running main() from > /home/build/build/dependencies/gtest/gtest-extern-prefix/src/gtest-extern/googletest/src/gtest_main.cc > [==========] Running 374 tests from 42 test suites. > [----------] Global test environment set-up. > [----------] 6 tests from durationTest > [ RUN ] durationTest.ceil > [ OK ] durationTest.ceil (0 ms) > [ RUN ] durationTest.toString > [ OK ] durationTest.toString (0 ms) > [ RUN ] durationTest.fromString > [ OK ] durationTest.fromString (0 ms) > [ RUN ] durationTest.fromStringWithCeil > [ OK ] durationTest.fromStringWithCeil (0 ms) > [ RUN ] durationTest.fromStringException > [ OK ] durationTest.fromStringException (0 ms) > [ RUN ] durationTest.assertBounds > [ OK ] durationTest.assertBounds (1 ms) > [----------] 6 tests from durationTest (1 ms total){noformat} > ... > {noformat} > 0% tests passed, 1 tests failed out of 1 > Total Test time (real) = 0.91 sec > The following tests FAILED: > 1 - apache-geode_unittests (SEGFAULT) > Errors while running CTest{noformat} > > -- This message was sent by Atlassian Jira (v8.3.4#803005)