[Sun Jun 19 06:25:02.603416 2016] [core:notice] [pid 6916:tid 134356776200064] AH00094: Command line: '/usr/sbin/apache2' [Sun Jun 19 06:25:07.444587 2016] [mpm_event:notice] [pid 6916:tid 134356776200064] AH00493: SIGUSR1 received. Doing graceful restart [Sun Jun 19 06:25:07.484307 2016] [mpm_event:notice] [pid 6916:tid 134356776200064] AH00489: Apache/2.4.10 (Debian) OpenSSL/1.0.1k mod_perl/2.0.9dev Perl/v5.20.2 configured -- resuming normal operations [Sun Jun 19 06:25:07.484326 2016] [core:notice] [pid 6916:tid 134356776200064] AH00094: Command line: '/usr/sbin/apache2' [Sun Jun 19 12:21:30.486083 2016] [core:notice] [pid 6916:tid 134356776200064] AH00052: child pid 6990 exit signal Segmentation fault (11) [Sun Jun 19 13:21:36.368290 2016] [core:notice] [pid 6916:tid 134356776200064] AH00052: child pid 5351 exit signal Segmentation fault (11) [Sun Jun 19 15:22:59.320210 2016] [mpm_event:notice] [pid 6916:tid 134356776200064] AH00491: caught SIGTERM, shutting down [Sun Jun 19 15:23:00.536564 2016] [mpm_event:notice] [pid 20781:tid 119978398734208] AH00489: Apache/2.4.10 (Debian) OpenSSL/1.0.1k mod_perl/2.0.9dev Perl/v5.20.2 configured -- resuming normal operations [Sun Jun 19 15:23:00.536597 2016] [core:notice] [pid 20781:tid 119978398734208] AH00094: Command line: '/usr/sbin/apache2' [Sun Jun 19 17:22:34.249996 2016] [core:notice] [pid 20781:tid 119978398734208] AH00051: child pid 20784 exit signal Segmentation fault (11), possible coredump in /tmp/apache-coredumps
root@ns3023045:~# apache2ctl -M Loaded Modules: core_module (static) so_module (static) watchdog_module (static) http_module (static) log_config_module (static) logio_module (static) version_module (static) unixd_module (static) access_compat_module (shared) alias_module (shared) auth_basic_module (shared) authn_core_module (shared) authn_file_module (shared) authz_core_module (shared) authz_host_module (shared) authz_user_module (shared) autoindex_module (shared) deflate_module (shared) dir_module (shared) env_module (shared) filter_module (shared) mime_module (shared) mpm_event_module (shared) negotiation_module (shared) perl_module (shared) proxy_module (shared) proxy_ajp_module (shared) proxy_http_module (shared) rewrite_module (shared) setenvif_module (shared) socache_shmcb_module (shared) ssl_module (shared) status_module (shared) userdir_module (shared) root@ns3023045:~# LANG=EN_en;gdb /usr/sbin/apache2 --core /tmp/apache-coredumps/core GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1 Copyright (C) 2014 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html > This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-linux-gnu". Type "show configuration" for configuration details. For bug reporting instructions, please see: <http://www.gnu.org/software/gdb/bugs/>. Find the GDB manual and other documentation resources online at: <http://www.gnu.org/software/gdb/documentation/>. For help, type "help". Type "apropos word" to search for commands related to "word"... Reading symbols from /usr/sbin/apache2...Reading symbols from /usr/lib/debug//usr/sbin/apache2...done. done. warning: core file may not match specified executable file. [New LWP 20784] [New LWP 20812] [New LWP 20802] [New LWP 20806] [New LWP 20810] [New LWP 20804] [New LWP 20814] [New LWP 20816] [New LWP 20818] [New LWP 20820] [New LWP 20822] [New LWP 20824] [New LWP 20826] [New LWP 20827] [New LWP 20828] [New LWP 20829] [New LWP 20830] [New LWP 20831] [New LWP 20832] [New LWP 20834] [New LWP 20835] [New LWP 20836] [New LWP 20837] [New LWP 20838] [New LWP 20833] [New LWP 20808] [New LWP 20839] [Thread debugging using libthread_db enabled] Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1". Core was generated by `/usr/sbin/apache2 -k start'. Program terminated with signal SIGSEGV, Segmentation fault. #0 0x00006d1ea5278add in read () at ../sysdeps/unix/syscall-template.S:81 81 ../sysdeps/unix/syscall-template.S: No such file or directory. (gdb) info sharedlibrary (gdb) info sharedlibrary >From To Syms Read Shared Object Library No linux-vdso.so.1 0x00006d1ea58e6710 0x00006d1ea59350c5 Yes (*) /lib/x86_64-linux-gnu/libpcre.so.3 0x00006d1ea56c57e0 0x00006d1ea56daf7f Yes (*) /usr/lib/x86_64-linux-gnu/libaprutil-1.so.0 0x00006d1ea5493e90 0x00006d1ea54af7cf Yes (*) /usr/lib/x86_64-linux-gnu/libapr-1.so.0 0x00006d1ea526f9f0 0x00006d1ea527b771 Yes /lib/x86_64-linux-gnu/libpthread.so.0 0x00006d1ea4ede4a0 0x00006d1ea500ac73 Yes /lib/x86_64-linux-gnu/libc.so.6 0x00006d1ea4cbd620 0x00006d1ea4cbece7 Yes (*) /lib/x86_64-linux-gnu/libuuid.so.1 0x00006d1ea4ab6350 0x00006d1ea4ab906c Yes /lib/x86_64-linux-gnu/librt.so.1 0x00006d1ea487dcc0 0x00006d1ea48828b4 Yes /lib/x86_64-linux-gnu/libcrypt.so.1 0x00006d1ea4679ed0 0x00006d1ea467a97e Yes /lib/x86_64-linux-gnu/libdl.so.2 0x00006d1ea4453b90 0x00006d1ea446bff9 Yes (*) /lib/x86_64-linux-gnu/libexpat.so.1 0x00006d1ea5b53ae0 0x00006d1ea5b6c130 Yes /lib64/ld-linux-x86-64.so.2 0x00006d1e9fde63b0 0x00006d1e9fdeab4e Yes /lib/x86_64-linux-gnu/libnss_compat.so.2 0x00006d1e9fbd1160 0x00006d1e9fbdc693 Yes /lib/x86_64-linux-gnu/libnsl.so.1 0x00006d1e9f9c41a0 0x00006d1e9f9ca1bc Yes /lib/x86_64-linux-gnu/libnss_nis.so.2 0x00006d1e9f7b82a0 0x00006d1e9f7beba3 Yes /lib/x86_64-linux-gnu/libnss_files.so.2 0x00006d1ea424dcf0 0x00006d1ea424e603 Yes /usr/lib/apache2/modules/mod_access_compat.so 0x00006d1ea4049120 0x00006d1ea404a0f3 Yes /usr/lib/apache2/modules/mod_alias.so 0x00006d1ea3e44fe0 0x00006d1ea3e4605e Yes /usr/lib/apache2/modules/mod_auth_basic.so 0x00006d1ea3c40f70 0x00006d1ea3c41712 Yes /usr/lib/apache2/modules/mod_authn_core.so 0x00006d1ea3a3dae0 0x00006d1ea3a3e03a Yes /usr/lib/apache2/modules/mod_authn_file.so 0x00006d1ea38375d0 0x00006d1ea383920a Yes /usr/lib/apache2/modules/mod_authz_core.so 0x00006d1ea3633de0 0x00006d1ea36344fc Yes /usr/lib/apache2/modules/mod_authz_host.so 0x00006d1ea3430980 0x00006d1ea3430daa Yes /usr/lib/apache2/modules/mod_authz_user.so 0x00006d1ea3228420 0x00006d1ea322c87a Yes /usr/lib/apache2/modules/mod_autoindex.so 0x00006d1ea301d9c0 0x00006d1ea3021d9a Yes /usr/lib/apache2/modules/mod_deflate.so 0x00006d1ea2e03220 0x00006d1ea2e14469 Yes (*) /lib/x86_64-linux-gnu/libz.so.1 0x00006d1ea2bfdf10 0x00006d1ea2bfe95f Yes /usr/lib/apache2/modules/mod_dir.so 0x00006d1ea29fab30 0x00006d1ea29faeab Yes /usr/lib/apache2/modules/mod_env.so 0x00006d1ea27f6160 0x00006d1ea27f7f12 Yes /usr/lib/apache2/modules/mod_filter.so 0x00006d1ea25f0700 0x00006d1ea25f1df1 Yes /usr/lib/apache2/modules/mod_mime.so 0x00006d1ea23e4050 0x00006d1ea23ea325 Yes /usr/lib/apache2/modules/mod_mpm_event.so 0x00006d1ea21d8ed0 0x00006d1ea21dd263 Yes /usr/lib/apache2/modules/mod_negotiation.so 0x00006d1ea1fa91f0 0x00006d1ea1fc7983 Yes (*) /usr/lib/apache2/modules/mod_perl.so 0x00006d1ea1c0b650 0x00006d1ea1d35eb7 Yes (*) /usr/lib/x86_64-linux-gnu/libperl.so.5.20 0x00006d1ea18dd580 0x00006d1ea1948d96 Yes /lib/x86_64-linux-gnu/libm.so.6 0x00006d1ea16c1bb0 0x00006d1ea16cfe8e Yes /usr/lib/apache2/modules/mod_proxy.so 0x00006d1ea14b0660 0x00006d1ea14b75d8 Yes /usr/lib/apache2/modules/mod_proxy_ajp.so 0x00006d1ea12a5680 0x00006d1ea12aa2a5 Yes /usr/lib/apache2/modules/mod_proxy_http.so 0x00006d1ea1095350 0x00006d1ea109df1a Yes /usr/lib/apache2/modules/mod_rewrite.so 0x00006d1ea0e8f110 0x00006d1ea0e90002 Yes /usr/lib/apache2/modules/mod_setenvif.so 0x00006d1ea0c87db0 0x00006d1ea0c8a571 Yes /usr/lib/apache2/modules/mod_socache_shmcb.so 0x00006d1ea0a5ca40 0x00006d1ea0a75839 Yes /usr/lib/apache2/modules/mod_ssl.so 0x00006d1ea0804db0 0x00006d1ea083932e Yes (*) /usr/lib/x86_64-linux-gnu/libssl.so.1.0.0 0x00006d1ea0468200 0x00006d1ea055dd2f Yes (*) /usr/lib/x86_64-linux-gnu/libcrypto.so.1.0.0 0x00006d1ea01f1270 0x00006d1ea01f3147 Yes /usr/lib/apache2/modules/mod_status.so 0x00006d1e9ffedce0 0x00006d1e9ffee581 Yes /usr/lib/apache2/modules/mod_userdir.so ---Type <return> to continue, or q <return> to quit--- 0x00006d1e9f5b1830 0x00006d1e9f5b3c33 Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/ServerUtil/ServerUtil.so 0x00006d1e9f3aab10 0x00006d1e9f3ad28f Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/RequestUtil/RequestUtil.so 0x00006d1e9f1a1230 0x00006d1e9f1a5d31 Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/RequestRec/RequestRec.so 0x00006d1e9ef9a650 0x00006d1e9ef9d2a5 Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/RequestIO/RequestIO.so 0x00006d1e9ed943f0 0x00006d1e9ed96a7b Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/Filter/Filter.so 0x00006d1e9eb8f1b0 0x00006d1e9eb90920 Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/Log/Log.so 0x00006d1e9e98a4e0 0x00006d1e9e98c32e Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/APR/Table/Table.so 0x00006d1e9e787740 0x00006d1e9e787928 Yes (*) /usr/lib/x86_64-linux-gnu/perl5/5.20/auto/Apache2/Const/Const.so 0x00006d1e9c38cab0 0x00006d1e9c39c9a5 Yes (*) /lib/x86_64-linux-gnu/libgcc_s.so.1 (*): Shared library is missing debugging information. (gdb) info threads Id Target Id Frame 27 Thread 0x6d1e8c625700 (LWP 20839) 0x00006d1ea4fa7623 in __libc_ifunc_impl_list (name=<optimized out>, array=0x186a0, max=<optimized out>) at ../sysdeps/x86_64/multiarch/ifunc-impl-list.c:229 26 Thread 0x6d1e97f1c700 (LWP 20808) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 25 Thread 0x6d1e8f814700 (LWP 20833) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 24 Thread 0x6d1e8ce52700 (LWP 20838) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 23 Thread 0x6d1e8d723700 (LWP 20837) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 22 Thread 0x6d1e8df2c700 (LWP 20836) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 21 Thread 0x6d1e8e794700 (LWP 20835) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 20 Thread 0x6d1e8efa4700 (LWP 20834) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 19 Thread 0x6d1e900fe700 (LWP 20832) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 18 Thread 0x6d1e909b3700 (LWP 20831) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 17 Thread 0x6d1e911fd700 (LWP 20830) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 16 Thread 0x6d1e91a5d700 (LWP 20829) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 15 Thread 0x6d1e922db700 (LWP 20828) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 14 Thread 0x6d1e92bda700 (LWP 20827) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 13 Thread 0x6d1e9348f700 (LWP 20826) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 12 Thread 0x6d1e93cc8700 (LWP 20824) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 11 Thread 0x6d1e944e2700 (LWP 20822) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 10 Thread 0x6d1e94dd3700 (LWP 20820) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 9 Thread 0x6d1e955ea700 (LWP 20818) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 8 Thread 0x6d1e95e30700 (LWP 20816) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 7 Thread 0x6d1e9663d700 (LWP 20814) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 6 Thread 0x6d1e9d5ad700 (LWP 20804) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 5 Thread 0x6d1e976bb700 (LWP 20810) 0x00006d1ea4ef63d7 in __add_to_environ (name=0x6d1e9def7920 "(p\357\235\036m", name@entry=<error reading variable: Cannot access memory at address 0x7d9>, value=<error reading variable: Cannot access memory at address 0x781>, value@entry=<error reading variable: Cannot access memory at address 0x7d9>, combined=<error reading variable: Cannot access memory at address 0x7d9>, replace=<error reading variable: Cannot access memory at address 0x7d9>) at setenv.c:216 4 Thread 0x6d1e9cda0700 (LWP 20806) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 3 Thread 0x6d1e9de34700 (LWP 20802) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 2 Thread 0x6d1e96e43700 (LWP 20812) pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 * 1 Thread 0x6d1ea5d65780 (LWP 20784) 0x00006d1ea5278add in read () at ../sysdeps/unix/syscall-template.S:81 (gdb) Thread 5 (Thread 0x6d1e976bb700 (LWP 20810)): Python Exception <class 'gdb.MemoryError'> Cannot access memory at address 0x7d9: #0 0x00006d1ea4ef63d7 in __add_to_environ (name=0x6d1e9def7920 "(p\357\235\036m", name@entry=<error reading variable: Cannot access memory at address 0x7d9>, value=<error reading variable: Cannot access memory at address 0x781>, value@entry=<error reading variable: Cannot access memory at address 0x7d9>, combined=<error reading variable: Cannot access memory at address 0x7d9>, replace=<error reading variable: Cannot access memory at address 0x7d9>) at setenv.c:216 varlen = <optimized out> new_environ = 0x2 ep = <optimized out> size = <optimized out> namelen = <optimized out> vallen = <error reading variable vallen (Cannot access memory at address 0x789)> Cannot access memory at address 0x7d9 (gdb) bt full #0 0x00006d1ea5278add in read () at ../sysdeps/unix/syscall-template.S:81 No locals. #1 0x00000c699257d9c7 in read (__nbytes=1, __buf=0x74fffa803693, __fd=<optimized out>) at /usr/include/x86_64-linux-gnu/bits/unistd.h:44 No locals. #2 ap_mpm_podx_check (pod=<optimized out>) at mpm_unix.c:535 c = -110 '\222' fd = 7 rc = <optimized out> #3 0x00006d1ea23e4524 in child_main (child_num_arg=0) at event.c:2268 threads = 0xc6996796440 ts = 0x6d1ea5cbb840 thread_attr = 0x6d1ea5cbb860 start_thread_id = 0x6d1ea5cbb8c0 #4 0x00006d1ea23e8d5d in make_child (s=0x6d1ea5d39de0, slot=0) at event.c:2355 No locals. #5 0x00006d1ea23e8de5 in startup_children (number_to_start=2) at event.c:2381 i = 0 #6 0x00006d1ea23e981e in event_run (_pconf=0x7, plog=0x6d1ea5d35028, s=0x6d1ea5d39de0) at event.c:2721 No locals. #7 0x00000c6992556e7e in ap_run_mpm (pconf=0x6d1ea5d61028, plog=0x6d1ea5d35028, s=0x6d1ea5d39de0) at mpm_common.c:94 pHook = <optimized out> n = 0 rv = -1 #8 0x00000c69925503c3 in main (argc=3, argv=0x74fffa803ac8) at main.c:777 c = 0 '\000' error = 0xfffffffffffffe00 <error: Cannot access memory at address 0xfffffffffffffe00> process = 0x6d1ea5d63118 pconf = 0x6d1ea5d61028 plog = 0x6d1ea5d35028 ptemp = 0x6d1ea5d37028 pcommands = 0x6d1ea5d3f028 opt = 0x6d1ea5d3f118 mod = 0xc69927b41c0 <ap_prelinked_modules+64> opt_arg = 0x6d1ea5d63028 "(\340\326\245\036m" signal_server = 0xfffffffffffffe00