------- Comment From rahch...@in.ibm.com 2017-12-05 00:19 EDT------- Breno, This happened in one of the ISST test systems not sure how it got into this state. Underlying SAN got full before this. The system is not in the failed state now. Is there any useful debug info available in the logs? Thanks!
-- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1735713 Title: Ubuntu16.04.03: Kernel Oops on targetcli Status in The Ubuntu-power-systems project: Triaged Status in linux package in Ubuntu: Triaged Bug description: == Comment: #0 - RAHUL CHANDRAKAR <rahch...@in.ibm.com> - 2017-12-01 03:26:31 == ---Problem Description--- Error while running targetcli command on Ubuntu 16.04 ---uname output--- Linux alpvm2nova 4.4.0-98-generic #121-Ubuntu SMP Tue Oct 10 14:23:01 UTC 2017 ppc64le ppc64le ppc64le GNU/Linux Machine Type = 8408-44E ---System Hang--- gpfs is stuck because of this ---Debugger--- A debugger is not configured Contact Information = rahch...@in.ibm.com Stack trace output: [Fri Dec 1 03:05:12 2017] Unable to handle kernel paging request for data at address 0x010d0688 [Fri Dec 1 03:05:12 2017] Faulting instruction address: 0xd000000007570a30 [Fri Dec 1 03:05:12 2017] Oops: Kernel access of bad area, sig: 11 [#2] [Fri Dec 1 03:05:12 2017] SMP NR_CPUS=2048 NUMA pSeries [Fri Dec 1 03:05:12 2017] Modules linked in: hvcs(OE) hvcserver rpadlpar_io rpaphp xt_tcpudp xt_nat target_core_pscsi(OE) target_core_file(OE) target_core_iblock(OE) target_core_user(OE) uio iscsi_target_mod(OE) mmfs26(OE) mmfslinux(OE) tracedev(OE) dccp_diag dccp tcp_diag udp_diag inet_diag unix_diag af_packet_diag netlink_diag openvswitch binfmt_misc pseries_rng ibmvmc(OE) vmx_crypto rtc_generic xt_conntrack nf_nat_ftp nf_conntrack_ftp nf_conntrack_netlink nfnetlink nf_conntrack_netbios_ns nf_conntrack_broadcast nf_conntrack_ipv6 nf_defrag_ipv6 nbd br_netfilter bridge ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr vhost_net vhost macvtap macvlan iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi ip_vs libcrc32c iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 iptable_mangle iptable_filter [Fri Dec 1 03:05:12 2017] ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE nf_nat_masquerade_ipv4 nf_nat nf_conntrack ip_tables ip6table_filter ip6_tables ebtables x_tables dm_snapshot dm_bufio 8021q garp mrp stp llc autofs4 dm_round_robin ses enclosure scsi_transport_sas be2net ibmvscsis(OE) target_core_mod(OE) configfs(OE) ibmveth(OE) lpfc vxlan ip6_udp_tunnel udp_tunnel scsi_transport_fc ipr scsi_dh_emc scsi_dh_rdac scsi_dh_alua dm_multipath [Fri Dec 1 03:05:12 2017] CPU: 13 PID: 178523 Comm: targetcli Tainted: G D W OE 4.4.0-98-generic #121-Ubuntu [Fri Dec 1 03:05:12 2017] task: c0000007d399cf60 ti: c0000007e4a84000 task.ti: c0000007e4a84000 [Fri Dec 1 03:05:12 2017] NIP: d000000007570a30 LR: d0000000075709c4 CTR: c00000000016e220 [Fri Dec 1 03:05:12 2017] REGS: c0000007e4a87820 TRAP: 0300 Tainted: G D W OE (4.4.0-98-generic) [Fri Dec 1 03:05:12 2017] MSR: 8000000000009033 <SF,EE,ME,IR,DR,RI,LE> CR: 42222248 XER: 00000000 [Fri Dec 1 03:05:12 2017] CFAR: c000000000008468 DAR: 00000000010d0688 DSISR: 40000000 SOFTE: 1 GPR00: d0000000075709c4 c0000007e4a87aa0 d00000000757fdf8 0000000000000001 GPR04: 0000000002400000 c0000007e8739b10 0000000000000001 0000000000000000 GPR08: 00000000010d0680 d000000007f61d50 d00000000757fdf8 d0000000075765f0 GPR12: c00000000016e220 c00000000fb47b80 00003fffc86beb50 0000000000000000 GPR16: 0000000000000000 00000000103b7d00 0000000000000000 0000000000000000 GPR20: c0000007d5379aa0 c0000004d39b5280 0000000000000000 0000000000000024 GPR24: c0000007e8739b00 c0000004d39b5280 d000000007570910 c000000516f61d00 GPR28: c000000518b7e488 c0000007a6367810 c0000007e8739b00 d000000007f6db50 [Fri Dec 1 03:05:12 2017] NIP [d000000007570a30] configfs_open_file+0x120/0x260 [configfs] [Fri Dec 1 03:05:12 2017] LR [d0000000075709c4] configfs_open_file+0xb4/0x260 [configfs] [Fri Dec 1 03:05:12 2017] Call Trace: [Fri Dec 1 03:05:12 2017] [c0000007e4a87aa0] [d0000000075709c4] configfs_open_file+0xb4/0x260 [configfs] (unreliable) [Fri Dec 1 03:05:12 2017] [c0000007e4a87af0] [c0000000002e2d40] do_dentry_open+0x2c0/0x460 [Fri Dec 1 03:05:12 2017] [c0000007e4a87b50] [c0000000002fb388] do_last+0x178/0xff0 [Fri Dec 1 03:05:12 2017] [c0000007e4a87c10] [c0000000002fc41c] path_openat+0xcc/0x3c0 [Fri Dec 1 03:05:12 2017] [c0000007e4a87c90] [c0000000002fe33c] do_filp_open+0xfc/0x170 [Fri Dec 1 03:05:12 2017] [c0000007e4a87db0] [c0000000002e4b30] do_sys_open+0x1c0/0x3b0 [Fri Dec 1 03:05:12 2017] [c0000007e4a87e30] [c000000000009204] system_call+0x38/0xb4 [Fri Dec 1 03:05:12 2017] Instruction dump: [Fri Dec 1 03:05:12 2017] 419e00e0 792a07e1 41820020 a13c0000 71290124 2f890000 419e00c8 e93f0018 [Fri Dec 1 03:05:12 2017] 2fa90000 419e00bc 3d420000 3c800240 <eb880008> e92a8028 38a00050 608480c0 [Fri Dec 1 03:05:12 2017] ---[ end trace 16fe4073c33fc91e ]--- Oops output: no System Dump Info: The system is not configured to capture a system dump. *Additional Instructions for rahch...@in.ibm.com: -Post a private note with access information to the machine that the bug is occuring on. -Attach sysctl -a output output to the bug. == Comment: #1 - RAHUL CHANDRAKAR <rahch...@in.ibm.com> - 2017-12-01 03:31:28 == == Comment: #2 - RAHUL CHANDRAKAR <rahch...@in.ibm.com> - 2017-12-01 03:36:09 == == Comment: #5 - VIPIN K. PARASHAR <vipar...@in.ibm.com> - 2017-12-01 06:00:29 == (In reply to comment #4) > From dmesg logs > =========== > [Fri Dec 1 02:16:57 2017] ------------[ cut here ]------------ > [Fri Dec 1 02:16:57 2017] WARNING: at include/linux/kref.h:46 > [Fri Dec 1 02:16:57 2017] Modules linked in: hvcs(OE) hvcserver rpadlpar_io > rpaphp xt_tcpudp xt_nat target_core_pscsi(OE) target_core_file(OE) > target_core_iblock(OE) target_core_user(OE) uio iscsi_target_mod(OE) > mmfs26(OE) mmfslinux(OE) tracedev(OE) dccp_diag dccp tcp_diag udp_diag > inet_diag unix_diag af_packet_diag netlink_diag openvswitch binfmt_misc > pseries_rng ibmvmc(OE) vmx_crypto rtc_generic xt_conntrack nf_nat_ftp > nf_conntrack_ftp nf_conntrack_netlink nfnetlink nf_conntrack_netbios_ns > nf_conntrack_broadcast nf_conntrack_ipv6 nf_defrag_ipv6 nbd br_netfilter > bridge ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr vhost_net > vhost macvtap macvlan iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > ip_vs libcrc32c iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 > iptable_mangle iptable_filter > [Fri Dec 1 02:16:57 2017] ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE > nf_nat_masquerade_ipv4 nf_nat nf_conntrack ip_tables ip6table_filter > ip6_tables ebtables x_tables dm_snapshot dm_bufio 8021q garp mrp stp llc > autofs4 dm_round_robin ses enclosure scsi_transport_sas be2net ibmvscsis(OE) > target_core_mod(OE) configfs(OE) ibmveth(OE) lpfc vxlan ip6_udp_tunnel > udp_tunnel scsi_transport_fc ipr scsi_dh_emc scsi_dh_rdac scsi_dh_alua > dm_multipath > [Fri Dec 1 02:16:57 2017] CPU: 14 PID: 139667 Comm: targetcli Tainted: G > OE 4.4.0-98-generic #121-Ubuntu > [Fri Dec 1 02:16:57 2017] task: c0000007d39911d0 ti: c000000783430000 > task.ti: c000000783430000 > [Fri Dec 1 02:16:57 2017] NIP: d000000007575c10 LR: d000000007570980 CTR: > c000000000b10610 > [Fri Dec 1 02:16:57 2017] REGS: c0000007834337f0 TRAP: 0700 Tainted: G > OE (4.4.0-98-generic) > [Fri Dec 1 02:16:57 2017] MSR: 8000000000029033 <SF,EE,ME,IR,DR,RI,LE> CR: > 22242842 XER: 00000000 > [Fri Dec 1 02:16:57 2017] CFAR: d000000007575bec SOFTE: 1 > GPR00: d000000007570980 c000000783433a70 > d00000000757fdf8 c0000007a6367810 > GPR04: c00000078264e400 c00000078264e410 > 0000000000000001 0000000000000000 > GPR08: 0000000000000000 0000000000000001 > d000000007578848 d0000000075763e8 > GPR12: c000000000b10610 c00000000fb48500 > 00003fffd23170f0 0000000000000000 > GPR16: 0000000000000000 00000000103b7d00 > 0000000000000000 0000000000000000 > GPR20: c0000007d5379aa0 c0000004d39b5280 > 0000000000000000 0000000000000024 > GPR24: c00000078264e400 c0000004d39b5280 > d000000007570910 c0000007637e0200 > GPR28: c000000518b7e488 0000000000000000 > c00000078264e400 c0000004d39b5280 > [Fri Dec 1 02:16:57 2017] NIP [d000000007575c10] config_item_get+0x70/0x90 > [configfs] > [Fri Dec 1 02:16:57 2017] LR [d000000007570980] > configfs_open_file+0x70/0x260 [configfs] > [Fri Dec 1 02:16:57 2017] Call Trace: > [Fri Dec 1 02:16:57 2017] [c000000783433aa0] [d000000007570980] > configfs_open_file+0x70/0x260 [configfs] > [Fri Dec 1 02:16:57 2017] [c000000783433af0] [c0000000002e2d40] > do_dentry_open+0x2c0/0x460 > [Fri Dec 1 02:16:57 2017] [c000000783433b50] [c0000000002fb388] > do_last+0x178/0xff0 > [Fri Dec 1 02:16:57 2017] [c000000783433c10] [c0000000002fc41c] > path_openat+0xcc/0x3c0 > [Fri Dec 1 02:16:57 2017] [c000000783433c90] [c0000000002fe33c] > do_filp_open+0xfc/0x170 > [Fri Dec 1 02:16:57 2017] [c000000783433db0] [c0000000002e4b30] > do_sys_open+0x1c0/0x3b0 > [Fri Dec 1 02:16:57 2017] [c000000783433e30] [c000000000009204] > system_call+0x38/0xb4 > [Fri Dec 1 02:16:57 2017] Instruction dump: > [Fri Dec 1 02:16:57 2017] 40c2fff4 7c0004ac 2f890001 409d0014 38210030 > e8010010 7c0803a6 4e800020 > [Fri Dec 1 02:16:57 2017] 3d220000 e94981c8 892a0000 69290001 <0b090000> > 2fa90000 41feffd8 39200001 > [Fri Dec 1 02:16:57 2017] ---[ end trace 16fe4073c33fc91c ]--- > [Fri Dec 1 02:16:57 2017] Unable to handle kernel paging request for data > at address 0x010d0688 > [Fri Dec 1 02:16:57 2017] Faulting instruction address: 0xd000000007570a30 > [Fri Dec 1 02:16:57 2017] Oops: Kernel access of bad area, sig: 11 [#1] > [Fri Dec 1 02:16:57 2017] SMP NR_CPUS=2048 NUMA pSeries > [Fri Dec 1 02:16:57 2017] Modules linked in: hvcs(OE) hvcserver rpadlpar_io > rpaphp xt_tcpudp xt_nat target_core_pscsi(OE) target_core_file(OE) > target_core_iblock(OE) target_core_user(OE) uio iscsi_target_mod(OE) > mmfs26(OE) mmfslinux(OE) tracedev(OE) dccp_diag dccp tcp_diag udp_diag > inet_diag unix_diag af_packet_diag netlink_diag openvswitch binfmt_misc > pseries_rng ibmvmc(OE) vmx_crypto rtc_generic xt_conntrack nf_nat_ftp > nf_conntrack_ftp nf_conntrack_netlink nfnetlink nf_conntrack_netbios_ns > nf_conntrack_broadcast nf_conntrack_ipv6 nf_defrag_ipv6 nbd br_netfilter > bridge ib_iser rdma_cm iw_cm ib_cm ib_sa ib_mad ib_core ib_addr vhost_net > vhost macvtap macvlan iscsi_tcp libiscsi_tcp libiscsi scsi_transport_iscsi > ip_vs libcrc32c iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 > iptable_mangle iptable_filter > [Fri Dec 1 02:16:57 2017] ipt_REJECT nf_reject_ipv4 ipt_MASQUERADE > nf_nat_masquerade_ipv4 nf_nat nf_conntrack ip_tables ip6table_filter > ip6_tables ebtables x_tables dm_snapshot dm_bufio 8021q garp mrp stp llc > autofs4 dm_round_robin ses enclosure scsi_transport_sas be2net ibmvscsis(OE) > target_core_mod(OE) configfs(OE) ibmveth(OE) lpfc vxlan ip6_udp_tunnel > udp_tunnel scsi_transport_fc ipr scsi_dh_emc scsi_dh_rdac scsi_dh_alua > dm_multipath > [Fri Dec 1 02:16:57 2017] CPU: 14 PID: 139667 Comm: targetcli Tainted: G > W OE 4.4.0-98-generic #121-Ubuntu > [Fri Dec 1 02:16:57 2017] task: c0000007d39911d0 ti: c000000783430000 > task.ti: c000000783430000 > [Fri Dec 1 02:16:57 2017] NIP: d000000007570a30 LR: d0000000075709c4 CTR: > c00000000016e220 > [Fri Dec 1 02:16:57 2017] REGS: c000000783433820 TRAP: 0300 Tainted: G > W OE (4.4.0-98-generic) > [Fri Dec 1 02:16:57 2017] MSR: 8000000000009033 <SF,EE,ME,IR,DR,RI,LE> CR: > 42242848 XER: 00000000 > [Fri Dec 1 02:16:57 2017] CFAR: c000000000008468 DAR: 00000000010d0688 > DSISR: 40000000 SOFTE: 1 > GPR00: d0000000075709c4 c000000783433aa0 > d00000000757fdf8 0000000000000001 > GPR04: 0000000002400000 c00000078264e410 > 0000000000000001 0000000000000000 > GPR08: 00000000010d0680 d000000007f61d50 > d00000000757fdf8 d0000000075765f0 > GPR12: c00000000016e220 c00000000fb48500 > 00003fffd23170f0 0000000000000000 > GPR16: 0000000000000000 00000000103b7d00 > 0000000000000000 0000000000000000 > GPR20: c0000007d5379aa0 c0000004d39b5280 > 0000000000000000 0000000000000024 > GPR24: c00000078264e400 c0000004d39b5280 > d000000007570910 c0000007637e0200 > GPR28: c000000518b7e488 c0000007a6367810 > c00000078264e400 d000000007f6db50 > [Fri Dec 1 02:16:57 2017] NIP [d000000007570a30] > configfs_open_file+0x120/0x260 [configfs] > [Fri Dec 1 02:16:57 2017] LR [d0000000075709c4] > configfs_open_file+0xb4/0x260 [configfs] > [Fri Dec 1 02:16:57 2017] Call Trace: > [Fri Dec 1 02:16:57 2017] [c000000783433aa0] [d0000000075709c4] > configfs_open_file+0xb4/0x260 [configfs] (unreliable) > [Fri Dec 1 02:16:57 2017] [c000000783433af0] [c0000000002e2d40] > do_dentry_open+0x2c0/0x460 > [Fri Dec 1 02:16:57 2017] [c000000783433b50] [c0000000002fb388] > do_last+0x178/0xff0 > [Fri Dec 1 02:16:57 2017] [c000000783433c10] [c0000000002fc41c] > path_openat+0xcc/0x3c0 > [Fri Dec 1 02:16:57 2017] [c000000783433c90] [c0000000002fe33c] > do_filp_open+0xfc/0x170 > [Fri Dec 1 02:16:57 2017] [c000000783433db0] [c0000000002e4b30] > do_sys_open+0x1c0/0x3b0 > [Fri Dec 1 02:16:57 2017] [c000000783433e30] [c000000000009204] > system_call+0x38/0xb4 > [Fri Dec 1 02:16:57 2017] Instruction dump: > [Fri Dec 1 02:16:57 2017] 419e00e0 792a07e1 41820020 a13c0000 71290124 > 2f890000 419e00c8 e93f0018 > [Fri Dec 1 02:16:57 2017] 2fa90000 419e00bc 3d420000 3c800240 <eb880008> > e92a8028 38a00050 608480c0 > [Fri Dec 1 02:16:57 2017] ---[ end trace 16fe4073c33fc91d ]--- > Kernel WARNING: at include/linux/kref.h:46 is reported just before Kernel Oops. Both get triggered with configfs module while executing configfs_open_file(). Transferring this bug to Canonical for further debug. To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-power-systems/+bug/1735713/+subscriptions -- Mailing list: https://launchpad.net/~kernel-packages Post to : kernel-packages@lists.launchpad.net Unsubscribe : https://launchpad.net/~kernel-packages More help : https://help.launchpad.net/ListHelp
