This is the mail archive of the systemtap@sourceware.org mailing list for the systemtap project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]
Other format: [Raw text]

[Bug runtime/22265] on rawhide, we're getting a kernel panic


https://sourceware.org/bugzilla/show_bug.cgi?id=22265

--- Comment #1 from David Smith <dsmith at redhat dot com> ---
I tried to simplify this a bit, so here's an update. First, I reconfigured
without dyninst, to get rid of all those dyninst segfaults. I also turned off
systemd-coredump. With those changes, I got the following console output:

====
[ 2059.437921] stap_39a623e80f942e3f1ad318c0a09bc408_8846: loading out-of-tree
module taints kernel. 
[ 2059.451140] stap_39a623e80f942e3f1ad318c0a09bc408_8846: module verification
failed: signature and/or required key missing - tainting kernel 
[ 3040.947653] stap_96032c2366fb4c972bf2a4c92e8671d5_7864: `z29' invalid for
parameter `var1' 
[ 3041.218072] stap_96032c2366fb4c972bf2a4c92e8671d5_7875: unknown parameter
'var2' ignored 
[ 5490.898599] Systemtap Error at _stp_mempool_init:50  
[ 5490.898601] Memory allocation failed. 
[ 5490.911076] Systemtap Error at _stp_register_ctl_channel:738  
[ 5490.911077] Error creating systemtap control channel. 
[ 5834.338830] stap_f8b3c6b1576e3ecc57deda9d89da28dd_6016: unknown parameter
'pt' ignored 
[ 7471.401936] hrtimer: interrupt took 1278 ns 
[ 7784.646918] Scheduler tracepoints stat_sleep, stat_iowait, stat_blocked and
stat_runtime require the kernel parameter schedstats=enable or
kernel.sched_schedstats=1 
[ 8740.442413] nr_pdflush_threads exported in /proc is scheduled for removal 
[18595.783147] traps: beah-rhts-task[855] trap invalid opcode ip:7f0608c1d080
sp:7ffc6fde41c8 error:0 in libc-2.26.90.so[7f0608b9b000+1ae000] 
[18595.790367] auditd[522]: segfault at 1 ip 00007fa2242a2260 sp
00007ffe50a84138 error 6 in libc-2.26.90.so[7fa2241a0000+1ae000] 
[18595.791510] systemd-journal[442]: segfault at 7fd25fec4268 ip
00007fd25fec4262 sp 00007fff403e1068 error 7 in
libc-2.26.90.so[7fd25fdc2000+1ae000] 
[18595.799273] systemd[1]: segfault at 2 ip 00007effb34fc260 sp
00007ffdbc92d1b8 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18595.801984] systemd[1]: segfault at 1 ip 00007effb34fc200 sp
00007ffdbc92c988 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18595.803362] systemd[1]: segfault at 1 ip 00007effb34fc200 sp
00007ffdbc92c188 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18595.808521] systemd[1]: segfault at 1 ip 00007effb34fc200 sp
00007ffdbc92b988 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18595.809739] systemd[19961]: segfault at 4df9 ip 00007effb342e800 sp
00007ffdbc92ca88 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18595.813196] audit: type=1701 audit(1507318677.561:235): auid=4294967295
uid=0 gid=0 ses=4294967295 subj=system_u:system_r:init_t:s0 pid=19961
comm="systemd" exe="/usr/lib/systemd/systemd" sig=11 res=1 
[18595.814920] systemd[19962]: segfault at 4dfa ip 00007effb342e800 sp
00007ffdbc92c288 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.785023] show_signal_msg: 10925 callbacks suppressed 
[18600.785600] systemd[27233]: segfault at 6a61 ip 00007effb342e800 sp
00007ffdbc213288 error 6 
[18600.785665] systemd[27234]: segfault at 6a62 ip 00007effb342e800 sp
00007ffdbc212a88 error 6 
[18600.786582] systemd[27235]: segfault at 6a63 ip 00007effb342e800 sp
00007ffdbc212288 error 6 
[18600.787565] systemd[27237]: segfault at 6a65 ip 00007effb342e800 sp
00007ffdbc211288 error 6 
[18600.790231] systemd[27236]: segfault at 6a64 ip 00007effb342e800 sp
00007ffdbc211a88 error 6 
[18600.791735] systemd[27238]: segfault at 6a66 ip 00007effb342e800 sp
00007ffdbc210a88 error 6 
[18600.792609]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.794108] systemd[1]: segfault at 1 ip 00007effb34fc200 sp
00007ffdbc210188 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.795487]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.797543]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.798533]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.800502]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.801140]  in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.801780] systemd[27239]: segfault at 6a67 ip 00007effb342e800 sp
00007ffdbc210288 error 6 in libc-2.26.90.so[7effb33fa000+1ae000] 
[18600.803228] audit: type=1701 audit(1507318682.552:3880): auid=4294967295
uid=0 gid=0 ses=4294967295 subj=system_u:system_r:init_t:s0 pid=27234
comm="systemd" exe="/usr/lib/systemd/systemd" sig=11 res=1 
[18600.805702] audit: type=1701 audit(1507318682.554:3881): auid=4294967295
uid=0 gid=0 ses=4294967295 subj=system_u:system_r:init_t:s0 pid=27233
comm="systemd" exe="/usr/lib/systemd/systemd" sig=11 res=1 
[18601.261136] Kernel panic - not syncing: Attempted to kill init!
exitcode=0x0000008b 
[18601.261136]  
[18601.262065] CPU: 0 PID: 1 Comm: systemd Tainted: G           OE  
4.14.0-0.rc3.git0.1.fc28.x86_64 #1 
[18601.262954] Hardware name: Red Hat KVM, BIOS 0.5.1 01/01/2011 
[18601.263517] Call Trace: 
[18601.263795]  dump_stack+0x63/0x8b 
[18601.264146]  panic+0xe4/0x237 
[18601.264447]  do_exit+0xbb9/0xbc0 
[18601.264766]  do_group_exit+0x47/0xb0 
[18601.265128]  get_signal+0x27b/0x590 
[18601.265506]  do_signal+0x37/0x680 
[18601.265845]  ? __probe_kernel_read+0x5a/0x90 
[18601.266273]  exit_to_usermode_loop+0x6e/0xb0 
[18601.266694]  prepare_exit_to_usermode+0x74/0x80 
[18601.267146]  retint_user+0x8/0x10 
[18601.267476] RIP: 0033:0x7effb34fc200 
[18601.267830] RSP: 002b:00007ffdbc12e188 EFLAGS: 00010206 
[18601.268343] RAX: 0000000000000001 RBX: 0000000000000001 RCX:
0000000000000004 
[18601.269038] RDX: 00007ffdbc12e2a0 RSI: 0000000000006df5 RDI:
0000000000000001 
[18601.270369] RBP: 0000000000006df5 R08: 0000000000000000 R09:
0000000000000000 
[18601.271048] R10: 0000000000000004 R11: 0000000000000246 R12:
00007ffdbc12e2a0 
[18601.271740] R13: 0000000000000004 R14: 00007ffdbc12e2a0 R15:
0000000000000000 
[18601.273159] Kernel Offset: 0x8000000 from 0xffffffff81000000 (relocation
range: 0xffffffff80000000-0xffffffffbfffffff) 
[18601.274204] ---[ end Kernel panic - not syncing: Attempted to kill init!
exitcode=0x0000008b 
====

I was doing a "tail -f" on systemtap.log, and the last test I saw being run was 
 testsuite/semok/twenty.stp. Now, that test does a lot of wildcarding. After a
reboot, I ran that test by hand, then did a free:

====
# free -h
              total        used        free      shared  buff/cache   available
Mem:           3.9G         31M        3.8G          0B         60M        3.7G
Swap:          3.0G        156M        2.8G
====

So, that test doesn't appear to be using a ton of memory.

-- 
You are receiving this mail because:
You are the assignee for the bug.

Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]