This is the mail archive of the systemtap@sourceware.org mailing list for the systemtap project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

[Bug uprobes/11672] New: utrace_report_syscall_exit crash


I get this oops sometimes. It involves utrace_report_syscall_exit going bad.
There is no simple reliable reproducer. It happens when I am stress testing
systemtap and have several scripts doing various uprobes.

BUG: unable to handle kernel paging request at ffffffffa0b10d00
IP: [<ffffffff810c7686>] utrace_report_syscall_exit+0x96/0xf0
PGD 1003067 PUD 1007063 PMD 104a7d067 PTE 0
Oops: 0000 [#1] SMP 
last sysfs file:
/sys/devices/pci0000:00/0000:00:1c.5/0000:01:00.0/net/eth0/statistics/tx_packets
CPU 4 
Modules linked in: uprobes(U) authenc(U) iptable_nat(U) nf_nat(U) ah6(U) ah4(U)
esp6(U) esp4(U) xfrm4_mode_beet(U) xfrm4_tunnel(U) xfrm4_mode_tunnel(U)
xfrm4_mode_transport(U) xfrm6_mode_transport(U) xfrm6_mode_ro(U)
xfrm6_mode_beet(U) xfrm6_mode_tunnel(U) ipcomp(U) ipcomp6(U) xfrm6_tunnel(U)
af_key(U) fuse(U) ip6table_filter(U) ip6_tables(U) ebtable_nat(U) ebtables(U)
netconsole(U) configfs(U) deflate(U) zlib_deflate(U) ctr(U) camellia(U) cast5(U)
rmd160(U) crypto_null(U) ccm(U) serpent(U) blowfish(U) twofish_x86_64(U)
twofish_common(U) ecb(U) xcbc(U) cbc(U) sha256_generic(U) sha512_generic(U)
des_generic(U) cryptd(U) aes_x86_64(U) aes_generic(U) tunnel4(U) xfrm_ipcomp(U)
tunnel6(U) nfsd(U) nfs_acl(U) auth_rpcgss(U) exportfs(U) autofs4(U) lockd(U)
sunrpc(U) cpufreq_ondemand(U) acpi_cpufreq(U) freq_table(U) bridge(U) stp(U)
llc(U) xt_physdev(U) be2iscsi(U) bnx2i(U) cnic(U) uio(U) cxgb3i(U) cxgb3(U)
mdio(U) ib_iser(U) rdma_cm(U) ib_cm(U) iw_cm(U) ib_sa(U) ib_mad(U) ib_core(U)
ib_addr(U) ipv6(U) iscsi_tcp(U) libiscsi_tcp(U) libiscsi(U)
scsi_transport_iscsi(U) ext3(U) jbd(U) dm_mirror(U) dm_region_hash(U) dm_log(U)
kvm_intel(U) kvm(U) uinput(U) snd_hda_codec_realtek(U) snd_hda_intel(U)
snd_hda_codec(U) snd_usb_audio(U) snd_seq(U) snd_pcm(U) snd_usb_lib(U)
snd_rawmidi(U) snd_timer(U) snd_seq_device(U) snd_hwdep(U) serio_raw(U) snd(U)
sg(U) tg3(U) i7core_edac(U) edac_core(U) soundcore(U) wmi(U) tpm_infineon(U)
snd_page_alloc(U) iTCO_wdt(U) iTCO_vendor_support(U) ext4(U) mbcache(U) jbd2(U)
raid456(U) async_raid6_recov(U) async_pq(U) raid6_pq(U) async_xor(U) xor(U)
async_memcpy(U) async_tx(U) sd_mod(U) crc_t10dif(U) firewire_ohci(U)
usb_storage(U) firewire_core(U) crc_itu_t(U) ahci(U) radeon(U) ttm(U)
drm_kms_helper(U) drm(U) i2c_algo_bit(U) i2c_core(U) dm_mod(U) [last unloaded:
stap_5a471983680cefbac658241d073264fb_77899]

Modules linked in: uprobes(U) authenc(U) iptable_nat(U) nf_nat(U) ah6(U) ah4(U)
esp6(U) esp4(U) xfrm4_mode_beet(U) xfrm4_tunnel(U) xfrm4_mode_tunnel(U)
xfrm4_mode_transport(U) xfrm6_mode_transport(U) xfrm6_mode_ro(U)
xfrm6_mode_beet(U) xfrm6_mode_tunnel(U) ipcomp(U) ipcomp6(U) xfrm6_tunnel(U)
af_key(U) fuse(U) ip6table_filter(U) ip6_tables(U) ebtable_nat(U) ebtables(U)
netconsole(U) configfs(U) deflate(U) zlib_deflate(U) ctr(U) camellia(U) cast5(U)
rmd160(U) crypto_null(U) ccm(U) serpent(U) blowfish(U) twofish_x86_64(U)
twofish_common(U) ecb(U) xcbc(U) cbc(U) sha256_generic(U) sha512_generic(U)
des_generic(U) cryptd(U) aes_x86_64(U) aes_generic(U) tunnel4(U) xfrm_ipcomp(U)
tunnel6(U) nfsd(U) nfs_acl(U) auth_rpcgss(U) exportfs(U) autofs4(U) lockd(U)
sunrpc(U) cpufreq_ondemand(U) acpi_cpufreq(U) freq_table(U) bridge(U) stp(U)
llc(U) xt_physdev(U) be2iscsi(U) bnx2i(U) cnic(U) uio(U) cxgb3i(U) cxgb3(U)
mdio(U) ib_iser(U) rdma_cm(U) ib_cm(U) iw_cm(U) ib_sa(U) ib_mad(U) ib_core(U)
ib_addr(U) ipv6(U) iscsi_tcp(U) libiscsi_tcp(U) libiscsi(U)
scsi_transport_iscsi(U) ext3(U) jbd(U) dm_mirror(U) dm_region_hash(U) dm_log(U)
kvm_intel(U) kvm(U) uinput(U) snd_hda_codec_realtek(U) snd_hda_intel(U)
snd_hda_codec(U) snd_usb_audio(U) snd_seq(U) snd_pcm(U) snd_usb_lib(U)
snd_rawmidi(U) snd_timer(U) snd_seq_device(U) snd_hwdep(U) serio_raw(U) snd(U)
sg(U) tg3(U) i7core_edac(U) edac_core(U) soundcore(U) wmi(U) tpm_infineon(U)
snd_page_alloc(U) iTCO_wdt(U) iTCO_vendor_support(U) ext4(U) mbcache(U) jbd2(U)
raid456(U) async_raid6_recov(U) async_pq(U) raid6_pq(U) async_xor(U) xor(U)
async_memcpy(U) async_tx(U) sd_mod(U) crc_t10dif(U) firewire_ohci(U)
usb_storage(U) firewire_core(U) crc_itu_t(U) ahci(U) radeon(U) ttm(U)
drm_kms_helper(U) drm(U) i2c_algo_bit(U) i2c_core(U) dm_mod(U) [last unloaded:
stap_5a471983680cefbac658241d073264fb_77899]
Pid: 11329, comm: run-mozilla.sh Tainted: G        W  2.6.32-33.el6.x86_64 #1 HP
Z400 Workstation
RIP: 0010:[<ffffffff810c7686>]  [<ffffffff810c7686>]
utrace_report_syscall_exit+0x96/0xf0
RSP: 0000:ffff88014fee7e00  EFLAGS: 00010282
RAX: ffffffffa0b10cd0 RBX: ffff880133d9fdb8 RCX: ffff8801161700c0
RDX: ffff88014fee7f58 RSI: ffff880133d9fdb8 RDI: 0000000000000005
RBP: ffff88014fee7e50 R08: 0000000000000080 R09: ffff8801161700c0
R10: ffff880193052950 R11: dead000000200200 R12: ffff88010a0eeca0
R13: ffff8801161700c0 R14: ffff88014fee7e10 R15: ffff88010a0eeca8
FS:  00007f5759dd2700(0000) GS:ffff880028280000(0000) knlGS:0000000000000000
CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
CR2: ffffffffa0b10d00 CR3: 000000014fee8000 CR4: 00000000000026e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400
Process run-mozilla.sh (pid: 11329, threadinfo ffff88014fee6000, task
ffff8801161700c0)
Stack:
 0000000000000000 ffff88014fee7f58 0000000500000000 0000000100000005
<0> ffffffff8106e1b3 ffff88014fee7f58 ffff88014fee7f58 0000000000000001
<0> 0000000000000000 0000000000000000 ffff88014fee7f10 ffffffff8101eb2b
Call Trace:
 [<ffffffff8106e1b3>] ? wait_consider_task+0x7e3/0xb20
 [<ffffffff8101eb2b>] tracehook_report_syscall_exit+0xcb/0x120
 [<ffffffff8106e6e7>] ? do_wait+0x1f7/0x250
 [<ffffffff810d3449>] ? audit_syscall_exit+0x239/0x270
 [<ffffffff8101ebef>] syscall_trace_leave+0x6f/0xf0
 [<ffffffff8106cd50>] ? child_wait_callback+0x0/0x70
 [<ffffffff81013423>] int_check_syscall_exit_work+0x34/0x3d
Code: 00 00 00 00 00 41 b8 80 00 00 00 4c 89 e9 48 89 da 4c 89 f6 4c 89 e7 e8 29
e7 ff ff 48 85 c0 74 21 48 8b 55 b8 48 89 de 8b 7d c4 <ff> 50 30 48 89 d9 41 89
c0 4c 89 f2 4c 89 e6 4c 89 ef e8 c3 e5 
RIP  [<ffffffff810c7686>] utrace_report_syscall_exit+0x96/0xf0
 RSP <ffff88014fee7e00>
CR2: ffffffffa0b10d00
---[ end trace 407d787c552fbee3 ]---
Kernel panic - not syncing: Fatal exception
Pid: 11329, comm: run-mozilla.sh Tainted: G      D W  2.6.32-33.el6.x86_64 #1
Call Trace:
 [<ffffffff814d72ad>] panic+0x78/0x137
 [<ffffffff814db3e4>] oops_end+0xe4/0x100
 [<ffffffff8104545b>] no_context+0xfb/0x260
 [<ffffffff810456e5>] __bad_area_nosemaphore+0x125/0x1e0
 [<ffffffff810457b3>] bad_area_nosemaphore+0x13/0x20
 [<ffffffff814dcec8>] do_page_fault+0x2a8/0x3a0
 [<ffffffff814da735>] page_fault+0x25/0x30
 [<ffffffff810c7686>] ? utrace_report_syscall_exit+0x96/0xf0
 [<ffffffff8106e1b3>] ? wait_consider_task+0x7e3/0xb20
 [<ffffffff8101eb2b>] tracehook_report_syscall_exit+0xcb/0x120
 [<ffffffff8106e6e7>] ? do_wait+0x1f7/0x250
 [<ffffffff810d3449>] ? audit_syscall_exit+0x239/0x270
 [<ffffffff8101ebef>] syscall_trace_leave+0x6f/0xf0
 [<ffffffff8106cd50>] ? child_wait_callback+0x0/0x70
 [<ffffffff81013423>] int_check_syscall_exit_work+0x34/0x3d

-- 
           Summary: utrace_report_syscall_exit crash
           Product: systemtap
           Version: unspecified
            Status: NEW
          Severity: normal
          Priority: P2
         Component: uprobes
        AssignedTo: systemtap at sources dot redhat dot com
        ReportedBy: mjw at redhat dot com


http://sourceware.org/bugzilla/show_bug.cgi?id=11672

------- You are receiving this mail because: -------
You are the assignee for the bug, or are watching the assignee.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]