Bug 14226 - semantic error: missing x86_64 kernel/module debuginfo under '...' while resolving probe point kernel.function("vfs_read").return
Summary: semantic error: missing x86_64 kernel/module debuginfo under '...' while res...
Status: RESOLVED WORKSFORME
Alias: None
Product: systemtap
Classification: Unclassified
Component: translator (show other bugs)
Version: unspecified
: P2 normal
Target Milestone: ---
Assignee: Unassigned
URL:
Keywords:
Depends on:
Blocks:
 
Reported: 2012-06-12 10:50 UTC by henrypepr
Modified: 2015-02-23 20:13 UTC (History)
6 users (show)

See Also:
Host:
Target:
Build:
Last reconfirmed:


Attachments

Note You need to log in before you can comment on or make changes to this bug.
Description henrypepr 2012-06-12 10:50:56 UTC
sudo io/iotop.stp
semantic error: missing x86_64 kernel/module debuginfo under '/lib/modules/3.3.4-5.fc17.x86_64/build' while resolving probe point kernel.function("vfs_read").return
semantic error: no match while resolving probe point vfs.read.return
semantic error: missing x86_64 kernel/module debuginfo under '/lib/modules/3.3.4-5.fc17.x86_64/build' while resolving probe point kernel.function("vfs_write").return
semantic error: no match while resolving probe point vfs.write.return
Pass 2: analysis failed.  Try again with another '--vp 01' option.
Missing separate debuginfos, use: debuginfo-install kernel-3.3.4-5.fc17.x86_64 

$ uname -r
3.3.4-5.fc17.x86_64

$ sudo debuginfo-install kernel-3.3.4-5.fc17.x86_64
Loaded plugins: auto-update-debuginfo, langpacks, presto, refresh-packagekit
enabling fedora-debuginfo
enabling updates-debuginfo
updates/metalink                                                                                              |  11 kB     00:00     
updates                                                                                                       | 4.5 kB     00:00     
updates-debuginfo/metalink                                                                                    | 9.0 kB     00:00     
updates-debuginfo                                                                                             | 3.1 kB     00:00     
updates-debuginfo/primary_db                                                                                  | 161 kB     00:01     
Package matching kernel-debuginfo-3.3.4-5.fc17.x86_64 already installed. Checking for update.
No debuginfo packages available to install


 stap-report
== stap -V ==
Systemtap translator/driver (version 1.7/0.153 non-git sources)
Copyright (C) 2005-2012 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBRPM LIBSQLITE3 NSS BOOST_SHARED_PTR TR1_UNORDERED_MAP NLS
== which stap ==
/bin/stap
== locate --regex '/stap(run)?$' | xargs ls -ald ==
-rwxr-xr-x. 1 root root    1983528 May  1 01:30 /usr/bin/stap
---s--x---. 1 root stapusr  154408 May  1 01:30 /usr/bin/staprun
== printenv | egrep '^PATH=|^LD_LIBRARY_PATH=|^SYSTEMTAP_.*=|^XDG_DATA.*=' ==
PATH=/usr/local/bin:/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/home/cadm/.local/bin:/home/cadm/bin
== stap -vv -p4 -e 'probe begin {exit()}' ==
Systemtap translator/driver (version 1.7/0.153 non-git sources)
Copyright (C) 2005-2012 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBRPM LIBSQLITE3 NSS BOOST_SHARED_PTR TR1_UNORDERED_MAP NLS
Created temporary directory "/tmp/stapbVUI7B"
Session arch: x86_64 release: 3.3.4-5.fc17.x86_64
Searched: " /usr/share/systemtap/tapset/x86_64/*.stp ", found: 4, processed: 4
Searched: " /usr/share/systemtap/tapset/*.stp ", found: 78, processed: 78
Pass 1: parsed user script and 82 library script(s) using 200920virt/23084res/2968shr kb, in 130usr/30sys/178real ms.
Pass 2: analyzed script: 1 probe(s), 1 function(s), 0 embed(s), 0 global(s) using 201448virt/23612res/3000shr kb, in 10usr/0sys/6real ms.
function recursion-analysis: max-nesting 0  non-recursive
Pass 3: translated to C into "/tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728_src.c" using 201448virt/23952res/3260shr kb, in 0usr/0sys/1real ms.
Running make -C /lib/modules/3.3.4-5.fc17.x86_64/build M=/tmp/stapbVUI7B modules ARCH=x86_64 --no-print-directory -j2
  CC [M]  /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728_src.o
  LD [M]  /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.o
  Building modules, stage 2.
  MODPOST 1 modules
  CC      /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.mod.o
  LD [M]  /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.ko
Spawn waitpid result (0x0): 0
/home/cadm/.systemtap/cache/62/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.ko
Pass 4: compiled C into "stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.ko" in 7890usr/3200sys/13062real ms.
Cache limit file /home/cadm/.systemtap/cache/cache_mb_limit missing, creating default.
Cache clean interval file /home/cadm/.systemtap/cache/cache_clean_interval_s missing, creating default.
Cache cleaning skipped, interval not reached 0 s / 30 s.
Copying /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.ko to /home/cadm/.systemtap/cache/62/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.ko
Copying /tmp/stapbVUI7B/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728_src.c to /home/cadm/.systemtap/cache/62/stap_62a235d7eb4cecb8f7a51fe6e54631ce_728.c
Copying /tmp/stapbVUI7B/stapconf_21281bac61c99465ab35ab0fad84ec7d_543.h to /home/cadm/.systemtap/cache/21/stapconf_21281bac61c99465ab35ab0fad84ec7d_543.h
Running rm -rf /tmp/stapbVUI7B
Spawn waitpid result (0x0): 0
== gcc -v ==
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/x86_64-redhat-linux/4.7.0/lto-wrapper
Target: x86_64-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --disable-build-with-cxx --disable-build-poststage1-with-cxx --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --with-linker-hash-style=gnu --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-initfini-array --enable-java-awt=gtk --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --enable-libgcj-multifile --enable-java-maintainer-mode --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib --with-ppl --with-cloog --with-tune=generic --with-arch_32=i686 --build=x86_64-redhat-linux
Thread model: posix
gcc version 4.7.0 20120507 (Red Hat 4.7.0-5) (GCC) 
== uname -a ==
Linux fedora17amd64 3.3.4-5.fc17.x86_64 #1 SMP Mon May 7 17:29:34 UTC 2012 x86_64 x86_64 x86_64 GNU/Linux
== dmesg | egrep 'stap|systemtap' | tail -n 10 ==
[ 6634.525980] stap_568b08c70ec23ee5db1d59112c15131_10852: systemtap: 1.7/0.153, base: ffffffffa0156000, memory: 21data/20text/0ctx/2058net/9alloc kb, probes: 1
[53809.651468] stap_90b47d8b4b3ac8c745983b4d3a91055b_8501: systemtap: 1.7/0.153, base: ffffffffa01a3000, memory: 27data/40text/5ctx/2058net/2170alloc kb, probes: 4
[53911.605707] stap_90b47d8b4b3ac8c745983b4d3a91055b_8577: systemtap: 1.7/0.153, base: ffffffffa01df000, memory: 27data/40text/5ctx/2058net/2170alloc kb, probes: 4
== cat /proc/cpuinfo | egrep 'processor|vendor_id|model name' ==
processor	: 0
vendor_id	: GenuineIntel
model name	: QEMU Virtual CPU version 1.0
== rpm -qa --qf '%{name}-%{version} %{release}.%{arch}\n' | egrep 'systemtap|elfutils|kernel|gcc' | sort ==
abrt-addon-kerneloops-2.0.10 4.fc17.x86_64
elfutils-0.153 2.fc17.x86_64
elfutils-libelf-0.153 2.fc17.x86_64
elfutils-libs-0.153 2.fc17.x86_64
gcc-4.7.0 5.fc17.x86_64
gcc-c++-4.7.0 5.fc17.x86_64
kernel-3.3.4 5.fc17.x86_64
kernel-3.4.0 1.fc17.x86_64
kernel-debuginfo-3.4.0 1.fc17.x86_64
kernel-debuginfo-common-x86_64-3.4.0 1.fc17.x86_64
kernel-devel-3.3.4 5.fc17.x86_64
kernel-devel-3.4.0 1.fc17.x86_64
kernel-headers-3.4.0 1.fc17.x86_64
libgcc-4.7.0 5.fc17.x86_64
libreport-plugin-kerneloops-2.0.10 3.fc17.x86_64
systemtap-1.7 7.fc17.x86_64
systemtap-client-1.7 7.fc17.x86_64
systemtap-devel-1.7 7.fc17.x86_64
systemtap-runtime-1.7 7.fc17.x86_64
== egrep 'PROBE|TRACE|MARKER|_DEBUG_|MODULE' /lib/modules/3.3.4-5.fc17.x86_64/build/.config | grep -v not.set | sort | fmt -w 80 ==
CONFIG_AIC79XX_DEBUG_MASK=0 CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_ARCH_CPU_PROBE_RELEASE=y CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_BLK_DEV_IO_TRACE=y CONFIG_CAN_PM_TRACE=y
CONFIG_CB710_DEBUG_ASSUMPTIONS=y CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_DEBUG_BOOT_PARAMS=y CONFIG_DEBUG_BUGVERBOSE=y CONFIG_DEBUG_DEVRES=y
CONFIG_DEBUG_FS=y CONFIG_DEBUG_INFO=y CONFIG_DEBUG_KERNEL=y
CONFIG_DEBUG_LIST=y CONFIG_DEBUG_MEMORY_INIT=y CONFIG_DEBUG_NX_TEST=m
CONFIG_DEBUG_RODATA_TEST=y CONFIG_DEBUG_RODATA=y CONFIG_DEBUG_SET_MODULE_RONX=y
CONFIG_DEBUG_SHIRQ=y CONFIG_DEBUG_STACKOVERFLOW=y CONFIG_DEBUG_VM=y
CONFIG_DYNAMIC_FTRACE=y CONFIG_FTRACE_MCOUNT_RECORD=y CONFIG_FTRACE_NMI_ENTER=y
CONFIG_FTRACE_SYSCALLS=y CONFIG_FTRACE=y CONFIG_FUNCTION_GRAPH_TRACER=y
CONFIG_FUNCTION_TRACER=y CONFIG_GENERIC_IRQ_PROBE=y CONFIG_GENERIC_TRACER=y
CONFIG_HAVE_ARCH_TRACEHOOK=y CONFIG_HAVE_DYNAMIC_FTRACE=y
CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y CONFIG_HAVE_FTRACE_NMI_ENTER=y
CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y
CONFIG_HAVE_FUNCTION_TRACER=y CONFIG_HAVE_KPROBES=y CONFIG_HAVE_KRETPROBES=y
CONFIG_HAVE_MMIOTRACE_SUPPORT=y CONFIG_HAVE_OPTPROBES=y
CONFIG_HAVE_SYSCALL_TRACEPOINTS=y CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=y
CONFIG_KEYS_DEBUG_PROC_KEYS=y CONFIG_KPROBE_EVENT=y CONFIG_KPROBES=y
CONFIG_KRETPROBES=y CONFIG_MODULES=y CONFIG_MODULE_UNLOAD=y
CONFIG_NETFILTER_XT_TARGET_TRACE=m CONFIG_NET_SCTPPROBE=m CONFIG_NOP_TRACER=y
CONFIG_OPTPROBES=y CONFIG_PM_TRACE_RTC=y CONFIG_PM_TRACE=y
CONFIG_SCHED_TRACER=y CONFIG_STACK_TRACER=y CONFIG_STACKTRACE_SUPPORT=y
CONFIG_STACKTRACE=y CONFIG_TRACE_IRQFLAGS_SUPPORT=y CONFIG_TRACEPOINTS=y
CONFIG_TRACER_MAX_TRACE=y CONFIG_USER_STACKTRACE_SUPPORT=y CONFIG_UTRACE=y
CONFIG_WIMAX_DEBUG_LEVEL=8 CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8
CONFIG_XEN_DEBUG_FS=y
== find /debugfs /proc /sys /dev -name '*kprobes*' 2>/dev/null | xargs grep . ==
/proc/sys/debug/kprobes-optimization:0
grep: /sys/kernel/debug/kprobes: Is a directory
== lsmod ==
Module                  Size  Used by
fuse                   77772  2 
binfmt_misc            17463  1 
lockd                  84836  0 
sunrpc                235511  1 lockd
bnep                   19584  2 
bluetooth             273667  7 bnep
rfkill                 21384  3 bluetooth
ip6t_REJECT            12939  2 
nf_conntrack_ipv4      14622  2 
nf_conntrack_ipv6      14297  3 
nf_defrag_ipv4         12673  1 nf_conntrack_ipv4
nf_defrag_ipv6         18095  1 nf_conntrack_ipv6
xt_state               12578  5 
nf_conntrack           82339  3 xt_state,nf_conntrack_ipv6,nf_conntrack_ipv4
ip6table_filter        12815  1 
ip6_tables             27073  1 ip6table_filter
snd_hda_intel          33277  2 
microcode              19252  0 
snd_hda_codec         116112  1 snd_hda_intel
snd_hwdep              17650  1 snd_hda_codec
snd_pcm                97129  2 snd_hda_codec,snd_hda_intel
snd_page_alloc         18101  2 snd_pcm,snd_hda_intel
snd_timer              28690  1 snd_pcm
snd                    78862  9 snd_timer,snd_pcm,snd_hwdep,snd_hda_codec,snd_hda_intel
soundcore              14491  1 snd
virtio_balloon         13394  0 
virtio_net             23267  0 
i2c_piix4              13694  0 
i2c_core               38028  1 i2c_piix4
uinput                 17673  0 
virtio_blk             17549  3 

Running on Fedora 17, as a KVM guest.
Comment 1 henrypepr 2012-06-13 06:13:40 UTC
The command works on Fedora 16


sudo stap-report
== stap -V ==
Systemtap translator/driver (version 1.7/0.153 non-git sources)
Copyright (C) 2005-2012 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBRPM LIBSQLITE3 NSS BOOST_SHARED_PTR TR1_UNORDERED_MAP NLS
== which stap ==
/usr/bin/stap
== locate --regex '/stap(run)?$' | xargs ls -ald ==
-rwxr-xr-x 1 root root    2047592 Feb 22 20:16 /usr/bin/stap
---s--x--- 1 root stapusr  153608 Feb 22 20:16 /usr/bin/staprun
== printenv | egrep '^PATH=|^LD_LIBRARY_PATH=|^SYSTEMTAP_.*=|^XDG_DATA.*=' ==
PATH=/sbin:/bin:/usr/sbin:/usr/bin
== stap -vv -p4 -e 'probe begin {exit()}' ==
Systemtap translator/driver (version 1.7/0.153 non-git sources)
Copyright (C) 2005-2012 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBRPM LIBSQLITE3 NSS BOOST_SHARED_PTR TR1_UNORDERED_MAP NLS
Created temporary directory "/tmp/stapUUpQzW"
Session arch: i386 release: 3.3.7-1.fc16.i686
Searched: " /usr/share/systemtap/tapset/i386/*.stp ", found: 4, processed: 4
Searched: " /usr/share/systemtap/tapset/*.stp ", found: 78, processed: 78
Pass 1: parsed user script and 82 library script(s) using 25380virt/13848res/2600shr kb, in 140usr/50sys/182real ms.
Pass 2: analyzed script: 1 probe(s), 1 function(s), 0 embed(s), 0 global(s) using 25644virt/14376res/2672shr kb, in 0usr/0sys/6real ms.
function recursion-analysis: max-nesting 0  non-recursive
Pass 3: translated to C into "/tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640_src.c" using 25644virt/14652res/2916shr kb, in 10usr/0sys/3real ms.
Pass 4: using cached /root/.systemtap/cache/13/stapconf_13387aecda5dbd6f8218e4e2abcdf739_455.h
Running make -C /lib/modules/3.3.7-1.fc16.i686/build M=/tmp/stapUUpQzW modules ARCH=i386 --no-print-directory -j2
  CC [M]  /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640_src.o
  LD [M]  /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640.o
  Building modules, stage 2.
  MODPOST 1 modules
  CC      /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640.mod.o
  LD [M]  /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640.ko
Spawn waitpid result (0x0): 0
/root/.systemtap/cache/e7/stap_e7f4332dd09567029fbe360b94c9a9fe_640.ko
Pass 4: compiled C into "stap_e7f4332dd09567029fbe360b94c9a9fe_640.ko" in 1640usr/900sys/2811real ms.
Cache cleaning skipped, interval not reached 15 s / 30 s.
Copying /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640.ko to /root/.systemtap/cache/e7/stap_e7f4332dd09567029fbe360b94c9a9fe_640.ko
Copying /tmp/stapUUpQzW/stap_e7f4332dd09567029fbe360b94c9a9fe_640_src.c to /root/.systemtap/cache/e7/stap_e7f4332dd09567029fbe360b94c9a9fe_640.c
Copying /tmp/stapUUpQzW/stapconf_13387aecda5dbd6f8218e4e2abcdf739_455.h to /root/.systemtap/cache/13/stapconf_13387aecda5dbd6f8218e4e2abcdf739_455.h
Running rm -rf /tmp/stapUUpQzW
Spawn waitpid result (0x0): 0
== gcc -v ==
Using built-in specs.
COLLECT_GCC=gcc
COLLECT_LTO_WRAPPER=/usr/libexec/gcc/i686-redhat-linux/4.6.3/lto-wrapper
Target: i686-redhat-linux
Configured with: ../configure --prefix=/usr --mandir=/usr/share/man --infodir=/usr/share/info --with-bugurl=http://bugzilla.redhat.com/bugzilla --enable-bootstrap --enable-shared --enable-threads=posix --enable-checking=release --with-system-zlib --enable-__cxa_atexit --disable-libunwind-exceptions --enable-gnu-unique-object --enable-linker-build-id --enable-languages=c,c++,objc,obj-c++,java,fortran,ada,go,lto --enable-plugin --enable-java-awt=gtk --disable-dssi --with-java-home=/usr/lib/jvm/java-1.5.0-gcj-1.5.0.0/jre --enable-libgcj-multifile --enable-java-maintainer-mode --with-ecj-jar=/usr/share/java/eclipse-ecj.jar --disable-libjava-multilib --with-ppl --with-cloog --with-tune=generic --with-arch=i686 --build=i686-redhat-linux
Thread model: posix
gcc version 4.6.3 20120306 (Red Hat 4.6.3-2) (GCC) 
== uname -a ==
Linux fedora16 3.3.7-1.fc16.i686 #1 SMP Tue May 22 14:14:30 UTC 2012 i686 i686 i386 GNU/Linux
== dmesg | egrep 'stap|systemtap' | tail -n 10 ==
[  529.252708] stap_3f2ca7308c2350cd097304e5d6dfed4b_2829: systemtap: 1.7/0.153, base: f86d4000, memory: 17data/24text/2ctx/2058net/8alloc kb, probes: 2
[  540.266455] stap_7b0bde7878ce79cd834ddee1140c29bb_3054: systemtap: 1.7/0.153, base: f8779000, memory: 17data/24text/2ctx/2058net/8alloc kb, probes: 2
[  613.433570] stap_4ce84f5eb1947db7387317b91205cb41__3345: systemtap: 1.7/0.153, base: f86d4000, memory: 17data/28text/1ctx/2058net/1761alloc kb, probes: 5
[  651.503100] stap_0cc75ed440aae8918401b13b87c51969__3570: systemtap: 1.7/0.153, base: f8779000, memory: 17data/24text/3ctx/2058net/8alloc kb, probes: 2
== cat /proc/cpuinfo | egrep 'processor|vendor_id|model name' ==
processor	: 0
vendor_id	: GenuineIntel
model name	: QEMU Virtual CPU version 1.0
== rpm -qa --qf '%{name}-%{version} %{release}.%{arch}\n' | egrep 'systemtap|elfutils|kernel|gcc' | sort ==
abrt-addon-kerneloops-2.0.7 3.fc16.i686
elfutils-0.153 1.fc16.i686
elfutils-libelf-0.153 1.fc16.i686
elfutils-libs-0.153 1.fc16.i686
gcc-4.6.3 2.fc16.i686
gcc-c++-4.6.3 2.fc16.i686
kernel-3.1.0 7.fc16.i686
kernel-3.3.7 1.fc16.i686
kernel-debuginfo-3.3.7 1.fc16.i686
kernel-debuginfo-common-i686-3.3.7 1.fc16.i686
kernel-devel-3.3.7 1.fc16.i686
kernel-headers-3.3.7 1.fc16.i686
libgcc-4.6.3 2.fc16.i686
libreport-plugin-kerneloops-2.0.8 4.fc16.i686
systemtap-1.7 2.fc16.i686
systemtap-client-1.7 2.fc16.i686
systemtap-devel-1.7 2.fc16.i686
systemtap-runtime-1.7 2.fc16.i686
== egrep 'PROBE|TRACE|MARKER|_DEBUG_|MODULE' /lib/modules/3.3.7-1.fc16.i686/build/.config | grep -v not.set | sort | fmt -w 80 ==
CONFIG_AIC79XX_DEBUG_MASK=0 CONFIG_AIC7XXX_DEBUG_MASK=0
CONFIG_ARCH_CPU_PROBE_RELEASE=y CONFIG_ARCH_SUPPORTS_DEBUG_PAGEALLOC=y
CONFIG_BLK_DEV_IO_TRACE=y CONFIG_CAN_PM_TRACE=y
CONFIG_CB710_DEBUG_ASSUMPTIONS=y CONFIG_CONTEXT_SWITCH_TRACER=y
CONFIG_DEBUG_BOOT_PARAMS=y CONFIG_DEBUG_BUGVERBOSE=y
CONFIG_DEBUG_DEVRES=y CONFIG_DEBUG_FS=y CONFIG_DEBUG_HIGHMEM=y
CONFIG_DEBUG_INFO=y CONFIG_DEBUG_KERNEL=y CONFIG_DEBUG_LIST=y
CONFIG_DEBUG_MEMORY_INIT=y CONFIG_DEBUG_NX_TEST=m CONFIG_DEBUG_RODATA_TEST=y
CONFIG_DEBUG_RODATA=y CONFIG_DEBUG_SET_MODULE_RONX=y CONFIG_DEBUG_SHIRQ=y
CONFIG_DEBUG_STACKOVERFLOW=y CONFIG_DEBUG_VM=y CONFIG_DYNAMIC_FTRACE=y
CONFIG_FTRACE_MCOUNT_RECORD=y CONFIG_FTRACE_NMI_ENTER=y
CONFIG_FTRACE_SYSCALLS=y CONFIG_FTRACE=y CONFIG_FUNCTION_TRACER=y
CONFIG_GENERIC_IRQ_PROBE=y CONFIG_GENERIC_TRACER=y CONFIG_HAVE_ARCH_TRACEHOOK=y
CONFIG_HAVE_DYNAMIC_FTRACE=y CONFIG_HAVE_FTRACE_MCOUNT_RECORD=y
CONFIG_HAVE_FTRACE_NMI_ENTER=y CONFIG_HAVE_FUNCTION_GRAPH_TRACER=y
CONFIG_HAVE_FUNCTION_TRACE_MCOUNT_TEST=y CONFIG_HAVE_FUNCTION_TRACER=y
CONFIG_HAVE_KPROBES=y CONFIG_HAVE_KRETPROBES=y CONFIG_HAVE_MMIOTRACE_SUPPORT=y
CONFIG_HAVE_OPTPROBES=y CONFIG_HAVE_SYSCALL_TRACEPOINTS=y
CONFIG_INFINIBAND_IPOIB_DEBUG_DATA=y CONFIG_KEYS_DEBUG_PROC_KEYS=y
CONFIG_KPROBE_EVENT=y CONFIG_KPROBES=y CONFIG_KRETPROBES=y CONFIG_MODULES=y
CONFIG_MODULE_UNLOAD=y CONFIG_MTD_GEN_PROBE=m CONFIG_MTD_JEDECPROBE=m
CONFIG_MTD_NAND_DISKONCHIP_PROBE_ADDRESS=0 CONFIG_MTD_QINFO_PROBE=m
CONFIG_NETFILTER_XT_TARGET_TRACE=m CONFIG_NET_SCTPPROBE=m CONFIG_NOP_TRACER=y
CONFIG_OPTPROBES=y CONFIG_PCMCIA_PROBE=y CONFIG_PM_TRACE_RTC=y
CONFIG_PM_TRACE=y CONFIG_SCHED_TRACER=y CONFIG_STACK_TRACER=y
CONFIG_STACKTRACE_SUPPORT=y CONFIG_STACKTRACE=y CONFIG_TRACE_IRQFLAGS_SUPPORT=y
CONFIG_TRACEPOINTS=y CONFIG_TRACER_MAX_TRACE=y CONFIG_USER_STACKTRACE_SUPPORT=y
CONFIG_UTRACE=y CONFIG_WIMAX_DEBUG_LEVEL=8 CONFIG_WIMAX_I2400M_DEBUG_LEVEL=8
== find /debugfs /proc /sys /dev -name '*kprobes*' 2>/dev/null | xargs grep . ==
/proc/sys/debug/kprobes-optimization:0
== lsmod ==
Module                  Size  Used by
binfmt_misc            17207  1 
tcp_lp                 12583  0 
nf_conntrack_ipv6      13885  2 
nf_defrag_ipv6         13678  1 nf_conntrack_ipv6
ip6table_filter        12711  1 
ip6_tables             17844  1 ip6table_filter
nf_conntrack_ipv4      14182  2 
nf_defrag_ipv4         12601  1 nf_conntrack_ipv4
xt_state               12514  4 
nf_conntrack           70512  3 nf_conntrack_ipv6,nf_conntrack_ipv4,xt_state
8021q                  23401  0 
garp                   13744  1 8021q
stp                    12719  1 garp
llc                    13770  2 garp,stp
fcoe                   22673  0 
libfcoe                41950  1 fcoe
libfc                 101889  2 fcoe,libfcoe
scsi_transport_fc      47165  2 fcoe,libfc
scsi_tgt               18993  1 scsi_transport_fc
lockd                  73543  0 
be2iscsi               62864  0 
iscsi_boot_sysfs       15121  1 be2iscsi
ip6t_REJECT            12782  2 
bnx2i                  49424  0 
cnic                   57653  1 bnx2i
uio                    14374  1 cnic
cxgb4i                 32063  0 
cxgb4                  96268  1 cxgb4i
cxgb3i                 28014  0 
libcxgbi               50487  2 cxgb4i,cxgb3i
cxgb3                 130826  1 cxgb3i
mdio                   13214  1 cxgb3
ib_iser                32818  0 
rdma_cm                36864  1 ib_iser
ib_cm                  36679  1 rdma_cm
iw_cm                  13715  1 rdma_cm
ib_sa                  23625  2 rdma_cm,ib_cm
ib_mad                 37189  2 ib_cm,ib_sa
ib_core                61900  6 ib_iser,rdma_cm,ib_cm,iw_cm,ib_sa,ib_mad
ib_addr                13473  1 rdma_cm
iscsi_tcp              18015  0 
libiscsi_tcp           19333  4 cxgb4i,cxgb3i,libcxgbi,iscsi_tcp
libiscsi               44809  8 be2iscsi,bnx2i,cxgb4i,cxgb3i,libcxgbi,ib_iser,iscsi_tcp,libiscsi_tcp
scsi_transport_iscsi    45361  8 be2iscsi,bnx2i,libcxgbi,ib_iser,iscsi_tcp,libiscsi
joydev                 17124  0 
snd_hda_intel          32323  2 
snd_hda_codec         102795  1 snd_hda_intel
snd_hwdep              13236  1 snd_hda_codec
snd_seq                54637  0 
snd_seq_device         13817  1 snd_seq
snd_pcm                81170  2 snd_hda_intel,snd_hda_codec
microcode              18642  0 
snd_timer              23896  2 snd_seq,snd_pcm
snd                    62853  11 snd_hda_intel,snd_hda_codec,snd_hwdep,snd_seq,snd_seq_device,snd_pcm,snd_timer
i2c_piix4              13406  0 
soundcore              14116  1 snd
virtio_balloon         13071  0 
i2c_core               28151  1 i2c_piix4
snd_page_alloc         13709  2 snd_hda_intel,snd_pcm
virtio_net             22589  0 
sunrpc                196934  2 lockd
uinput                 17246  0 
virtio_blk             17304  3
Comment 2 Frank Ch. Eigler 2012-06-13 11:43:14 UTC
> $ sudo debuginfo-install kernel-3.3.4-5.fc17.x86_64
> [...]
> Package matching kernel-debuginfo-3.3.4-5.fc17.x86_64 already installed.

It appears as though debuginfo-install is lying to you: you do not have kernel-debuginfo-3.3.4-5.fc17 installed (see the stap-report output), but some other later version.  Please consider opening a yum-utils fedora bug report.

In the mean time, you may have luck manually downloading the right version from http://koji.fedoraproject.org/koji/buildinfo?buildID=317848 or perhaps via "stap --download-debuginfo".
Comment 3 P Fudd 2013-12-31 17:41:46 UTC
Hi...

I'm using CentOS 6.5, and I'm finding the same thing:
---------------
# stap -v -e 'probe vfs.read {printf("read performed\n"); exit()}'
Pass 1: parsed user script and 96 library script(s) using 198468virt/26680res/3108shr/24072data kb, in 170usr/10sys/178real ms.
semantic error: while resolving probe point: identifier 'kernel' at /usr/share/systemtap/tapset/linux/vfs.stp:768:18
        source: probe vfs.read = kernel.function("vfs_read")
                                 ^

semantic error: missing x86_64 kernel/module debuginfo [man warning::debuginfo] under '/lib/modules/2.6.32-431.1.2.0.1.el6.x86_64/build'
semantic error: while resolving probe point: identifier 'vfs' at <input>:1:7
        source: probe vfs.read {printf("read performed\n"); exit()}
                      ^

semantic error: no match
Pass 2: analyzed script: 0 probe(s), 0 function(s), 0 embed(s), 0 global(s) using 204316virt/32416res/5036shr/27816data kb, in 50usr/80sys/131real ms.
Pass 2: analysis failed.  [man error::pass2]
---------------

If I add '--download-debuginfo -vv' to that command line, it does the following:
---------------
# stap --download-debuginfo -vv -e 'probe vfs.read {printf("read performed\n"); exit()}'
Systemtap translator/driver (version 2.3/0.152, rpm 2.3-4.el6_5)
Copyright (C) 2005-2013 Red Hat, Inc. and others
This is free software; see the source for copying conditions.
enabled features: AVAHI LIBRPM LIBSQLITE3 NSS TR1_UNORDERED_MAP NLS
Created temporary directory "/tmp/stap0KjZio"
Session arch: x86_64 release: 2.6.32-431.1.2.0.1.el6.x86_64
Searched for library macro files: "/usr/share/systemtap/tapset/linux/*.stpm", found: 2, processed: 2
Searched for library macro files: "/usr/share/systemtap/tapset/*.stpm", found: 1, processed: 1
Searched: "/usr/share/systemtap/tapset/linux/x86_64/*.stp", found: 3, processed: 3
Searched: "/usr/share/systemtap/tapset/linux/*.stp", found: 67, processed: 67
Searched: "/usr/share/systemtap/tapset/x86_64/*.stp", found: 1, processed: 1
Searched: "/usr/share/systemtap/tapset/*.stp", found: 22, processed: 22
Pass 1: parsed user script and 96 library script(s) using 198476virt/26728res/3152shr/24080data kb, in 160usr/10sys/175real ms.
Attempting to extract kernel debuginfo build ID from /lib/modules/2.6.32-431.1.2.0.1.el6.x86_64/build/vmlinux.id
Attempting to extract kernel debuginfo build ID from /sys/kernel/notes
Success! Extracted kernel debuginfo build ID: f802fda8d8a3aafaf3fc235cda81a62a46c20617
Running /bin/sh -c echo f802fda8d8a3aafaf3fc235cda81a62a46c20617 | /usr/libexec/abrt-action-install-debuginfo-to-abrt-cache -y --ids=-
Coredump references 1 debuginfo files, 1 of them are not installed
Setting up yum repositories
Looking for needed packages in repositories
Can't find packages for 1 debuginfo files
Missing debuginfo file: /usr/lib/debug/.build-id/f8/02fda8d8a3aafaf3fc235cda81a62a46c20617.debug
ABRT finished attempting to download debuginfo.
Attempting to extract kernel debuginfo build ID from /lib/modules/2.6.32-431.1.2.0.1.el6.x86_64/build/vmlinux.id
Attempting to extract kernel debuginfo build ID from /sys/kernel/notes
semantic error: while resolving probe point: identifier 'kernel' at /usr/share/systemtap/tapset/linux/vfs.stp:768:18
        source: probe vfs.read = kernel.function("vfs_read")
                                 ^

semantic error: missing x86_64 kernel/module debuginfo [man warning::debuginfo] under '/lib/modules/2.6.32-431.1.2.0.1.el6.x86_64/build'
semantic error: while resolving probe point: identifier 'vfs' at <input>:1:7
        source: probe vfs.read {printf("read performed\n"); exit()}
                      ^

semantic error: no match
Pass 2: analyzed script: 0 probe(s), 0 function(s), 0 embed(s), 0 global(s) using 204312virt/32444res/5056shr/27812data kb, in 240usr/190sys/1200real ms.
Pass 2: analysis failed.  [man error::pass2]
Running rm -rf /tmp/stap0KjZio
Spawn waitpid result (0x0): 0
Removed temporary directory "/tmp/stap0KjZio"
-------------------

I take it that CentOS has its own debug repository that I should be looking at?
Comment 4 Frank Ch. Eigler 2014-01-03 16:11:46 UTC
stap is diagnosing henrypepr's problem correctly: missing debuginfo
of the appropriate version.  Perhaps yum-utils' debuginfo-install is
confused by the presence of more than one kernel version, including a
newer one installed than being run.

P.Fudd's problem is similar: his debuginfo may probably be found here.
If debuginfo-install isn't running right on his distro, he should raise
a bug over there.

http://debuginfo.centos.org/6/x86_64/kernel-debuginfo-2.6.32-431.1.2.0.1.el6.x86_64.rpm
Comment 5 snehal 2014-11-03 11:16:18 UTC
On ppc64le, ubuntu14.10 I am getting following after installing required pkgs for systemtap. I do have linux-image-3.16.0-23-generic-dbgsym installed. 

~# stap -v -e  'probe kernel.function("sys_open") {log("hello world" 
Pass 1: parsed user script and 102 library script(s) using 45376virt/35072res/6080shr/28480data kb, in 170usr/0sys/167real ms.
semantic error: while resolving probe point: identifier 'kernel' at <input>:1:7
        source: probe kernel.function("sys_open") {log("hello world") exit()}
                      ^

semantic error: no match
Pass 2: analyzed script: 0 probe(s), 0 function(s), 0 embed(s), 0 global(s) using 46464virt/38080res/7552shr/29568data kb, in 10usr/90sys/100real ms.
Pass 2: analysis failed.  [man error::pass2]
Tip: /usr/share/doc/systemtap/README.Debian should help you get started.
----------------------------------------------------------------------
My system details
root@ubuntu:~# uname -a
Linux ubuntu 3.16.0-23-generic #31-Ubuntu SMP Tue Oct 21 17:55:08 UTC 2014 ppc64le ppc64le ppc64le GNU/Linux

root@ubuntu:~# dpkg -la | grep kernel
ii  kmod                                 18-1ubuntu2                  ppc64el      tools for managing Linux kernel modules
ii  libdrm-nouveau2:ppc64el              2.4.56-1                     ppc64el      Userspace interface to nouveau-specific kernel DRM services -- runtime
ii  libdrm-radeon1:ppc64el               2.4.56-1                     ppc64el      Userspace interface to radeon-specific kernel DRM services -- runtime
ii  libdrm2:ppc64el                      2.4.56-1                     ppc64el      Userspace interface to kernel DRM services -- runtime
ii  linux-firmware                       1.138                        all          Firmware for Linux kernel drivers
ii  linux-generic                        3.16.0.23.24                 ppc64el      Complete Generic Linux kernel and headers
ii  linux-headers-3.16.0-23              3.16.0-23.31                 all          Header files related to Linux kernel version 3.16.0
ii  linux-headers-3.16.0-23-generic      3.16.0-23.31                 ppc64el      Linux kernel headers for version 3.16.0 on PowerPC 64el SMP
ii  linux-headers-generic                3.16.0.23.24                 ppc64el      Generic Linux kernel headers
ii  linux-image-3.16.0-23-generic        3.16.0-23.31                 ppc64el      Linux kernel image for version 3.16.0 on PowerPC 64el SMP
ii  linux-image-3.16.0-23-generic-dbgsym 3.16.0-23.31                 ppc64el      Linux kernel debug image for version 3.16.0 on PowerPC 64el SMP
ii  linux-image-extra-3.16.0-23-generic  3.16.0-23.31                 ppc64el      Linux kernel extra modules for version 3.16.0 on PowerPC 64el SMP
ii  linux-image-generic                  3.16.0.23.24                 ppc64el      Generic Linux kernel image
ii  rsyslog                              7.4.4-1ubuntu11              ppc64el      reliable system and kernel logging daemon
root@ubuntu:~# 


Any suggestions ?
Comment 6 Frank Ch. Eigler 2014-11-03 14:36:07 UTC
Try "strace stap --vp 09 ..." to see which vmlinux files stap tries to open.
Compare that to the file list of the intended -dbgsym package.
Comment 7 snehal 2014-11-04 10:30:53 UTC
Tried 

strace stap --vp 09 'probe kernel.function("sys_open") {log("hello world") exit()}'

This is the same version as debugsymbols. 

openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16.0-23-generic/powerpc", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16.0-23-generic", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16.0/powerpc", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16.0", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16/powerpc", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/3.16", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/usr/share/systemtap/tapset/powerpc", O_RDONLY|O_NONBLOCK|O_DIRECTORY|O_CLOEXEC) = 3
Comment 8 Frank Ch. Eigler 2014-11-05 17:01:15 UTC
(Sorry, that part of the strace output is not relevant to the
kernel debuginfo.  strace -eopen ... then grep for vmlinux.)
Comment 9 snehal 2014-11-07 08:49:15 UTC
I tried to run following and tried to grep for open, I didnt see anything related to open vmlinux, however there are only read calls. 

strace -o stap --vp 09 'probe kernel.function("sys_open") {log("hello world") exit()}'


root@ubuntu:/home# cat result2.log | grep vmlinux
read(3, "ft_qdisc\tvmlinux\tEXPORT_SYMBOL\n0"..., 8191) = 8191
read(3, "_guest_info_callbacks\tvmlinux\tEX"..., 8191) = 8191
read(3, "ost\tvmlinux\tEXPORT_SYMBOL\n0x051c"..., 8191) = 8191
read(3, "gister_quota_format\tvmlinux\tEXPO"..., 8191) = 8191
read(3, "b_get_hash\tvmlinux\tEXPORT_SYMBOL"..., 8191) = 8191
read(3, "ex\tvmlinux\tEXPORT_SYMBOL\n0x3465f"..., 8191) = 8191
read(3, "read_multi_bytes\tvmlinux\tEXPORT_"..., 8191) = 8191
read(3, "\tuse_mm\tvmlinux\tEXPORT_SYMBOL_GP"..., 8191) = 8191
read(3, "10de535\tioread8\tvmlinux\tEXPORT_S"..., 8191) = 8191
read(3, "1962f8\tparam_get_ushort\tvmlinux\t"..., 8191) = 8191
read(3, "queue_make_request\tvmlinux\tEXPOR"..., 8191) = 8191
read(3, "cooling_device_register\tvmlinux\t"..., 8191) = 8191
read(3, "r\tvmlinux\tEXPORT_SYMBOL\n0x335c57"..., 8191) = 8191
read(3, "et_random_long\tvmlinux\tEXPORT_SY"..., 8191) = 8191
read(3, "6_rcv_spi\tvmlinux\tEXPORT_SYMBOL\n"..., 8191) = 8191
read(3, "ory\tvmlinux\tEXPORT_SYMBOL_GPL\n0x"..., 8191) = 8191
read(3, "ree_s\tvmlinux\tEXPORT_SYMBOL\n0x7a"..., 8191) = 8191
read(3, "blic_key_subtype\tvmlinux\tEXPORT_"..., 8191) = 8191
read(3, "register\tvmlinux\tEXPORT_SYMBOL_G"..., 8191) = 8191
read(3, "e_parts_free\tvmlinux\tEXPORT_SYMB"..., 8191) = 8191
read(3, "13d0adf7\t__kfifo_out\tvmlinux\tEXP"..., 8191) = 8191
read(3, "bb2\tusb_disable_lpm\tvmlinux\tEXPO"..., 8191) = 8191
read(3, "xbb0ab47b\tdebug_locks\tvmlinux\tEX"..., 8191) = 8191
read(3, "p_irq_get_virq\tvmlinux\tEXPORT_SY"..., 8191) = 8191
read(3, "_sff_queue_delayed_work\tvmlinux\t"..., 8191) = 8191
read(3, "mmu_tce_direction\tvmlinux\tEXPORT"..., 8191) = 8191
read(3, "OL\n0x9b3796f2\tbmap\tvmlinux\tEXPOR"..., 8191) = 8191
read(3, "limit\tvmlinux\tEXPORT_SYMBOL\n0xa2"..., 8191) = 8191
root@ubuntu:/home#
Comment 10 snehal 2014-11-07 09:21:55 UTC
As per your suggestion , output of strace -e open is blank. 
(Does not have any open function calls)

root@ubuntu:/home# strace -e open stap --vp 09 'probe kernel.function("sys_open") {log("hello world") exit()}' |& grep vmlinu 
root@ubuntu:/home#
Comment 11 Srikar Dronamraju 2014-11-07 10:21:26 UTC
(In reply to snehal from comment #10)
> As per your suggestion , output of strace -e open is blank. 
> (Does not have any open function calls)
> 
> root@ubuntu:/home# strace -e open stap --vp 09 'probe
> kernel.function("sys_open") {log("hello world") exit()}' |& grep vmlinu 
> root@ubuntu:/home#

missing -e option to the probe string

Please run "strace -e open stap --vp 09 -e 'probe kernel.function("sys_open") {log("hello world") exit()}' |& grep vmlinu"
Comment 12 snehal 2014-11-10 07:11:15 UTC
Tried following 

#strace -e open stap --vp 09 -e 'probe kernel.function("sys_open") {log("hello world") exit()}' |& grep vmlinu


open("/boot/vmlinux-3.12.28-4-default", O_RDONLY) = 3
checking pattern '' vs. module 'kernel' file '/boot/vmlinux-3.12.28-4-default'
Attempting to extract kernel debuginfo build ID from /lib/modules/3.12.28-4-default/build/vmlinux.id
open("/lib/modules/3.12.28-4-default/build/vmlinux.id", O_RDONLY) = -1 ENOENT (No such file or directory)
focused on module 'kernel' = [0xc000000000000000-0xc000000001231eb4, bias 0 file /usr/lib/debug/boot/vmlinux-3.12.28-4-default.debug ELF machine powerpc| (code 21)

After this system hangs and does not respond untill ctr+c
Comment 13 snehal 2014-11-10 09:57:04 UTC
Ignore previous comment (I pasted sles result by mistake)...
On ubuntu again I did run 
strace -e open stap --vp 09 -e 'probe kernel.function("sys_open") {log("hello world") exit()}' |& grep vmlinu

open("/boot/vmlinux-3.16.0-23-generic", O_RDONLY) = 3
checking pattern '' vs. module 'kernel' file '/boot/vmlinux-3.16.0-23-generic'
Attempting to extract kernel debuginfo build ID from /lib/modules/3.16.0-23-generic/build/vmlinux.id
open("/lib/modules/3.16.0-23-generic/build/vmlinux.id", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/boot/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/boot/.debug/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/debug/boot/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = 4
focused on module 'kernel' = [0xc000000000000000-0xc0000000016fc81c, bias 0 file /usr/lib/debug/boot/vmlinux-3.16.0-23-generic.debug ELF machine powerpc| (code 21)
open("/boot/vmlinux-3.16.0-23-generic", O_RDONLY) = 5
open("/lib/modules/3.16.0-23-generic/build/vmlinux.id", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/boot/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/boot/.debug/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = -1 ENOENT (No such file or directory)
open("/usr/lib/debug/boot/vmlinux-3.16.0-23-generic.debug", O_RDONLY) = 6
root@ubuntu:~# 


-----------------------------------------
I tried crating link 

 root@ubuntu:~#  ls -l /usr/lib/debug/boot/vmlinux-3.16.0-23-generic.debug
 lrwxrwxrwx 1 root root 45 Nov 10 03:35 /usr/lib/debug/boot/vmlinux-3.16.0-23-generic.debug -> /usr/lib/debug/boot/vmlinux-3.16.0-23-generic

Then did try to run stap again 

#stap -v -e  'probe kernel.function("sys_open") {log("hello world") exit()}'

Pass 1: parsed user script and 102 library script(s) using 45376virt/35072res/6080shr/28480data kb, in 170usr/0sys/168real ms.
Pass 2: analyzed script: 1 probe(s), 2 function(s), 0 embed(s), 0 global(s) using 77184virt/68800res/7488shr/60288data kb, in 560usr/90sys/665real ms.
Pass 3: translated to C into "/tmp/stap7jBR5P/stap_249960a02a2d0edf9b9c7b95dc166d4d_1155_src.c" using 77184virt/69120res/7808shr/60288data kb, in 20usr/90sys/100real ms.
ld: BFD (GNU Binutils for Ubuntu) 2.24.90.20141014 internal error, aborting at ../../bfd/elf-eh-frame.c line 1727 in _bfd_elf_write_section_eh_frame

ld: Please report this bug.

scripts/Makefile.modpost:124: recipe for target '/tmp/stap7jBR5P/stap_249960a02a2d0edf9b9c7b95dc166d4d_1155.ko' failed
make[1]: *** [/tmp/stap7jBR5P/stap_249960a02a2d0edf9b9c7b95dc166d4d_1155.ko] Error 1
Makefile:1348: recipe for target 'modules' failed
make: *** [modules] Error 2
WARNING: kbuild exited with status: 2
Pass 4: compiled C into "stap_249960a02a2d0edf9b9c7b95dc166d4d_1155.ko" in 5940usr/810sys/6885real ms.
Pass 4: compilation failed.  [man error::pass4]
Tip: /usr/share/doc/systemtap/README.Debian should help you get started.
root@ubuntu:~#
Comment 14 Alan Modra 2014-11-11 09:02:44 UTC
In reply to comment 13

The abort might be because I turned on .eh_frame processing for ld -r with binutils commit 5b69e357 on 20141013 which is likely in the Ubuntu 20141014 binutils..

What the abort says is that one of the .eh_frame sections is not a multiple of 8 (for 64-bit objects like ppc64le or x86_64).  I'm guessing that this is due to your last object file containing CIEs, FDEs, and a terminating 0 word of 4 bytes.  The CIEs and FDEs will be adjusted to be on 8 byte boundaries but that terminator messes with the size.  Normally, the terminator is in a file all by itself, and isn't subject to the size check.

Can you verify that my guess is correct?  Or send me the object files and I'll check them myself.
Comment 15 Alan Modra 2014-11-11 10:03:51 UTC
OK, so one of the object files does contain both FDEs and a zero terminator.

ld bug fixed with git commit 4de1599b.
https://sourceware.org/ml/binutils/2014-11/msg00090.html

Note that systemtap could avoid the bug by linking an extra object file containing an .eh_frame section with just the zero terminator.
Comment 16 Frank Ch. Eigler 2014-11-11 21:05:34 UTC
> Note that systemtap could avoid the bug by linking an extra object
> file containing an .eh_frame section with just the zero terminator.

Wouldn't all other normal kernel modules be affected by this?
Comment 17 Alan Modra 2014-11-12 02:56:12 UTC
The question to ask is why this particular kernel module object file happened to contain a zero terminator.  One possibility is that it came about from .eh_frame alignment padding.
Comment 18 Frank Ch. Eigler 2015-02-23 20:13:27 UTC
Multiple different causes can give this error message
(as outlined in the error::pass2 man page).  None of
them appeared to be a systemtap bug as opposed to an
e.g. incomplete installation.