The timekeeping subsystem has had some known problems (bug #10651). This one reliably hits a new larger server: BUG: scheduling while atomic: stapio/16908/0x10000100 Modules linked in: stap_5032a4d55b1c8bc0d09b556f3698504d_1081 uprobes [...] Pid: 16908, comm: stapio Not tainted 2.6.35.6-48.fc14.x86_64 #1 /ProLiant DL180 G6 RIP: 0010:[<ffffffff81022d83>] RSP: 0018:ffff880913c37d38 EFLAGS: 00000296 RAX: 0000000000000100 RBX: ffff880913c37d38 RCX: 0000000000000018 RDX: 0000000000000018 RSI: 0000000000000100 RDI: 0000000000000296 RBP: ffffffff8100a68e R08: 0000000000000100 R09: ffffffff81b81f80 R10: 0000000000000000 R11: 00000000000000e3 R12: ffff880100000e00 R13: ffffffff810da18c R14: ffff880913c37da0 R15: 00007f4fa5a7d9d0 FS: 00007f4fa627f720(0000) GS:ffff8800020e0000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b CR2: 00007f4fa5a7cfd8 CR3: 0000000913968000 CR4: 00000000000006e0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 Process stapio (pid: 16908, threadinfo ffff880913c36000, task ffff8809134345c0) Call Trace: [<ffffffff81022f39>] ? default_send_IPI_mask_allbutself_phys+0x77/0x86 [<ffffffff810263ac>] ? physflat_send_IPI_allbutself+0x17/0x19 [<ffffffff81021816>] ? native_send_call_func_ipi+0x76/0x96 [<ffffffff81077b2b>] ? smp_call_function_many+0x198/0x1b9 [<ffffffffa06c2fbb>] ? __stp_init_time+0x0/0x97 [stap_5032a4d55b1c8bc0d09b556f3698504d_10818] [<ffffffff81077b6e>] ? smp_call_function+0x22/0x26 [<ffffffff810532cf>] ? on_each_cpu+0x1b/0x38 [<ffffffffa06c7865>] ? _stp_ctl_write_cmd+0x233/0xc05 [stap_5032a4d55b1c8bc0d09b556f3698504d_10818] [<ffffffff811e37ca>] ? selinux_file_permission+0x5a/0xb9 [<ffffffff8104cda8>] ? do_fork+0x291/0x352 [<ffffffff811dc1f1>] ? security_file_permission+0x16/0x18 [<ffffffff81117004>] ? vfs_write+0xac/0x100 [<ffffffff8111720d>] ? sys_write+0x4a/0x6e [<ffffffff81009cf2>] ? system_call_fastpath+0x16/0x1b [...] kernel BUG at kernel/timer.c:662! invalid opcode: 0000 [#1]
Fixed by commit 3fd1c49