David Smith [Fri, 18 Oct 2013 18:49:45 +0000 (13:49 -0500)]
Fix PR16058 by updating the old syscall.mmap2/nd_syscall.mmap2 probe aliases.
* tapset/linux/i386/syscalls.stp: Break the 'mmap2' probe alias down into
subprobes, so that 'pgoff' can be converted to a number of bytes when
necessary.
* tapset/linux/i386/nd_syscalls.stp: Ditto.
* tapset/linux/x86_64/syscalls.stp: Ditto.
* tapset/linux/x86_64/nd_syscalls.stp: Ditto.
David Smith [Thu, 17 Oct 2013 21:23:58 +0000 (16:23 -0500)]
Fix PR15961 by avoiding use of symname(addr()) in syscall/nd_syscall tapsets.
* tapset/linux/nd_syscalls2.stp (nd_syscall.compat_rt_sigprocmask): Switch
from using 'symname(addr())' to 'ppfunc().
(nd_syscall.uname): Ditto.
(nd_syscall.rt_sigtimedwait): Break down into sub-probes to avoid
'symname(addr())'.
(nd_syscall.truncate): Ditto.
* tapset/linux/s390/nd_syscalls.stp (nd_syscall.mmap): Break down into
sub-probes to avoid 'symname(addr())'.
(nd_syscall.mmap2): Ditto.
* tapset/linux/s390/syscalls.stp (syscall.mmap): Break down into
sub-probes to avoid 'symname(addr())'.
(syscall.mmap2): Ditto.
David Smith [Thu, 17 Oct 2013 16:23:32 +0000 (11:23 -0500)]
Fix PR16058 by updating the syscall.mmap2/nd_syscall.mmap2 probe aliases.
* tapset/linux/syscalls.stp: Convert '$pgoff', which is a number of pages,
into a number of bytes.
* tapset/linux/nd_syscalls.stp: Ditto.
* testsuite/systemtap.syscall/mmap.c: Add testing for a non-zero offset
argument to mmap().
Jonathan Lebon [Thu, 17 Oct 2013 15:37:01 +0000 (11:37 -0400)]
man/stap.1: improve .SAMPLE macro
The .RE macro, used in the .ESAMPLE macro, restores the indentation
level to the default, not to what it was before the preceding .RS macro.
This meant that in already-indented regions (e.g. the .TP section of
--suppress-handler-errors or MAXMAPENTRIES), the text following .ESAMPLE
would be unindented one level too much.
The .SAMPLE macro now saves the current indentation level in a register
and the .ESAMPLE macro restores it. The macros were also modified so
that samples now have an empty line above and below to improve
legibility.
Old uses of .RS/.RE for samples were replaced by .SAMPLE/.ESAMPLE and
the printf examples section was unindented since the macro already
indents it once.
- man/stap.1: improve .SAMPLE macro, clean up usage
- man/stapvirt.1: improve .SAMPLE macro, use .PP instead of blank space
- man/stap-merge.1: improve .SAMPLE macro
- man/stap-prep.1: ditto
- man/stap-report.1: ditto
Josh Stone [Thu, 17 Oct 2013 00:15:31 +0000 (17:15 -0700)]
PR16057: Fix task_dentry_path crossing mount points
There were a couple ways that task_dentry_path failed on kernels which
have struct mount, i.e. >= kernel-3.3.
* tapset/linux/dentry.stp (real_mount): The (vfsmnt > offset) test fails
for most (all?) kernel pointers, as having the MSB set looks negative
in signed long comparisons. Explicitly allow "negative" pointers now.
(task_dentry_path): The @cast(mnt, "mount")->mnt_parent got us to
another struct mount, but we wanted the struct vfsmount. This is
available one step further in ->mnt_parent->mnt.
Jonathan Lebon [Tue, 3 Sep 2013 16:29:47 +0000 (12:29 -0400)]
add guest support files for libvirt/unix schemes
For systemd systems, the following files are used:
- stapsh@.service.in: template file for a service which automatically
respawns stapsh on a given virtio-serial port
- 99-stapsh.rules: udev rules file that instantiates (or terminates)
the stapsh service upon plugging in/out of virtio-serial ports
For SYSV systems, the following files are used:
- stapsh-daemon.in: libexec script file that automatically respawns
stapsh on a given virtio-serial port
- stapshd.in: init script to control stapsh-daemon instances
- 99-stapsh-init.rules: udev rules file that forces a configuration
reload upon plugging in/out of virtio-serial ports
- virtio_console.modules: ensures that the virtio_console module is
loaded at boot time if virtio-serial ports are detected. This is a
workaround for RHEL5, in which the module is not auto-loaded, but
does no harm in other systems such as RHEL6.
Jonathan Lebon [Fri, 16 Aug 2013 19:25:07 +0000 (15:25 -0400)]
stapvirt: initial release
The stapvirt binary is a tool for both users and stap. Users use it to
manage systemtap ports on their libvirt-managed domains. It allows them
to add, list, and remove ports. stap uses it to connect to a
libvirt-managed domain with a free systemtap port.
The stapvirt binary is only compiled if the libvirt-devel >= 1.0.2 and
the libxml-2.0 packages are installed.
- Makefile.am: build stapvirt if we HAVE_LIBVIRT and HAVE_LIBXML2
- configure.ac: PKG_CHECK_MODULES for libvirt and libxml2 and define
HAVE_LIBVIRT and HAVE_LIBXML2 conditionals
- man/Makefile.am: include stapvirt man page if we HAVE_LIBVIRT and
HAVE_LIBXML2
- man/stapvirt.1: created stapvirt man page
- stapvirt.c: created stapvirt source
Jonathan Lebon [Wed, 28 Aug 2013 16:13:50 +0000 (12:13 -0400)]
stapsh: use SIGIO to monitor port status
If the kernel supports it, a handler for SIGIO is installed. Upon any
event (e.g. host connection up/down), the handler updates a global
variable. This variable is used by host_connected() if possible, rather
than calling poll() everytime.
Jonathan Lebon [Mon, 26 Aug 2013 16:20:24 +0000 (12:20 -0400)]
stapsh: tweak error msgs
Make error messages more consistent with the rest of SystemTap (i.e.
capitalize the first word). Also, make die() respect host_connected()
and print out strerror().
Jonathan Lebon [Mon, 26 Aug 2013 16:01:19 +0000 (12:01 -0400)]
remote.cxx: use data option for unix
This commit actually enables the use of the new "data" option added in
commit 145fb2f. This is done by using a mini state machine. For now,
only the unix scheme uses this option. However, the upcoming libvirt
scheme will also make use of it.
The prefixing logic has also been revised. Now, cout is always flushed
so that e.g. printf("hello1\nhello2") will not only print out "hello1"
until ^C is done on stap. (This was most likely due to line-buffering).
Additionally, prefixing is now only done when necessary rather than
everytime (e.g. 'timer.s(1) { printf("hello") }' would add a prefix
before every 'hello').
Finally, prefixing now also accounts for multiple remotes, i.e. a new
line is automatically added and prefixed if data from a different remote
from the last was received.
- remote.cxx: add support for data commands and improve prefixing
- util.cxx: new split_lines() function
- util.h: split_lines() defn and new vector_has function
Jonathan Lebon [Mon, 26 Aug 2013 15:50:09 +0000 (11:50 -0400)]
stapsh: add data option
The data option causes stapsh to first send a "data" line before every
output from staprun. This has the key benefit of allowing us to
distinguish between stdout and stderr for schemes where the two are
mixed, such as unix and libvirt (upcoming in a future commit).
Jonathan Lebon [Mon, 26 Aug 2013 15:39:21 +0000 (11:39 -0400)]
stapsh: add option command
The new option command allows stap to change the behaviour of stapsh
depending on the scheme used. For now, only "verbose" is a valid option.
This is especially useful for the unix scheme, where we connect to an
already running instance of stapsh. Options are sent to stapsh right
after a successful handshake.
- remote.cxx: send options after successful handshake
- staprun/stapsh.c: add option command and verbose option
Jonathan Lebon [Fri, 16 Aug 2013 17:58:54 +0000 (13:58 -0400)]
stapsh-unix.exp: give time for socat to get set up
I've observed a few failures of this test in which stap gives the "No
such file or directory" error on connect() even though socat was started
properly. This happens the first time the test is run, but not
subsequent times. My theory is that socat takes some time to be loaded
and set up on the first run.
Looking at past testsuite results seem to indicate that this test failed
frequently, so this may have been a long-standing issue. Either way,
this small wait seems to do the trick.
Jonathan Lebon [Tue, 30 Jul 2013 14:08:48 +0000 (10:08 -0400)]
man/stap.1: small correction
This correction might be useful for those who want to parse the output.
Also add a small comment in stapsh.c to clarify the STAPSH_MAX_ARGS
comparison.
Frank Ch. Eigler [Sat, 12 Oct 2013 20:16:34 +0000 (16:16 -0400)]
PR9822: reduce timer load
Until this very moment, runtime/time.c's tsc-polling timer (the one
related to __stp_time_timer_callback) was being invoked every jiffy,
ie. something like 1000Hz, just to tune our per-cpu estimates of
tsc/real-time. This is excessive. Instead, use a much longer
interval (10Hz), and an even larger yet if cpufreq-change-notification
is in effect (0.1Hz).
* runtime/time.c (STP_TIME_SYNC_INTERVAL): New overrideable macro.
(__stp_init_time, __stp_time_timer_callback): Use it.
(__stp_time_cpufreq_callback): Refresh base_ns/base_cycles.
Josh Stone [Sat, 5 Oct 2013 00:12:04 +0000 (17:12 -0700)]
Fix minor errors found by clang analyzer
* dwflpp.cxx (dwflpp::iterate_over_plt): A bad plt_shdr pointer could be
dereferenced later in the function.
* mdfour.c (m): This static global pointer was retaining stack memory.
It's not needed at all - just pass an additional parameter as needed.
* stapregex-tree.cxx (range_union): In a twisted situation where old_b
is NULL, and old_a is valid but empty, then old_b was dereferenced.
This logic now stops trying to shortcut the empty case. Also, the
segment merging now uses std::merge, instead of doing it manually.
* staprun/stap_merge.c (main): Initialize num[];
* tapset-been.cxx (be_builder::build): Simplify 'priority' init;
* tapsets.cxx (dwarf_builder::build): Assert dw is always set.
* util.cxx (stap_spawn): Don't leave an unused 'cmd' local when SDT is
not enabled.
David Smith [Mon, 30 Sep 2013 15:12:47 +0000 (10:12 -0500)]
Fix PR15982 by making 'process.end' probes work reliably.
* runtime/linux/task_finder.c: Swith from using UTRACE_DEATH events to
using UTRACE_EXIT events, to avoid missing 'process.end' probes.
* tapset-utrace.cxx (utrace_derived_probe_group::emit_linux_probe_decl):
For CONFIG_UTRACE, use UTRACE_EXIT events instead of UTRACE_DEATH
events.
* testsuite/systemtap.base/proc_exec.exp: Tweak expected output.
Vincent Bernat [Sat, 28 Sep 2013 16:50:26 +0000 (18:50 +0200)]
PR15123: when PR15123_ASSUME_MFENTRY is set, don't check for -mfentry flag
-mfentry flag is recorded in `DW_AT_producer` only if
`CFLAGS=-grecord-gcc-switches` was used at compilation-time. We
provide PR15123_ASSUME_MFENTRY as an environment variable to override
this detection. The user is expected to set this variable only if it
is confident that that CFLAGS=-mfentry was used.
William Cohen [Fri, 27 Sep 2013 18:49:44 +0000 (14:49 -0400)]
Basic SystemTap support for aarch64
The SystemTap runtime libraries needs a number of machine specific
details for each architecture to be specified. This is an attempt to
provide the minimal set of them so that a "hello, world" SystemTap
script will compile.
Josh Stone [Thu, 26 Sep 2013 21:35:00 +0000 (14:35 -0700)]
testsuite: New sdt_casm for STAP_PROBE_ASM
An attempted fix for PR13974 had broken STAP_PROBE_ASM, because in that
case there's some ambiguity whether %note and %progbits should be
%%-escaped. We can't determine that in general, because it depends on
whether the user's asm() has operands. That fix was thus reverted, and
we're testing to make sure STAP_PROBE_ASM doesn't regress again.
We broke glibc's build on rawhide due to the way they use SDT_PROBE_ASM.
There's really no way to correctly use %note in that scenario, where we
can't know if there's operand parsing or not.
William Cohen [Thu, 1 Jan 1970 00:19:29 +0000 (00:00 -0019)]
Add am64 support
The "uname -m" reports arm64 as aarch64. Some translation is needed to
convert the name to the proper arch name so the appropriate Makefile
can be found. Also need to report the arch as a 64-bit architecture.
David Smith [Tue, 24 Sep 2013 16:20:22 +0000 (11:20 -0500)]
Define vzalloc() and vzalloc_node() for systems without them.
* buildrun.cxx (compile_pass): Add 'exportconf' tests for vzalloc() and
vzalloc_node().
* runtime/linux/alloc.c: Use STAPCONF_VZALLOC and STAPCONF_VZALLOC_NODE to
know if we need private versions of vzalloc() and vzalloc_node().
Josh Stone [Fri, 20 Sep 2013 23:57:27 +0000 (16:57 -0700)]
Fixes for CC=clang CXX=clang++
We can compile almost everything with clang now, except:
- loc2c.c due to nested functions.
- stapdyn/ because dyninst pulls in __gnu_cxx::hash_map for GNUC < 4.3,
which triggers -Wdeprecated in libstdc++-4.8.1.
(clang #defines itself as GNUC 4.2.1.)
* loc2c-test.c (fail): Indicate that this is itself a formatted
function, so it doesn't complain about non-const 'fmt' passed to
vfprintf. (The callers are in fact passing const strings.)
* session.cxx (systemtap_session::parse_cmdline): Added braces so
that the if-for-if-else doesn't have a dangling else.
* stapregex-dfa.h: translator_output is a class.
* stapregex.h: translator_output is a class; dfa is a struct.
* tapset-method.cxx (java_builder): Remove unused cache_initialized.
Josh Stone [Fri, 20 Sep 2013 23:08:28 +0000 (16:08 -0700)]
testsuite: split std_asm out of std_misc.exp
The asm part of sdt_misc.exp was not really dependent on any other part
of that testcase, so we can let it stand alone for direct testing. Its
reported name in test results is left as "sdt_misc", so it can still be
easily compared to previous test runs.
Josh Stone [Fri, 20 Sep 2013 23:00:44 +0000 (16:00 -0700)]
SDT: Use %foo for section types rather than "foo"
GAS can take section types as "foo", @foo, or %foo. We had the quoted
form, but this is not documented, and llvm-mc doesn't support it. Using
@foo starts a comment on ARM, so we're left with %foo.
For note, we have to escape it to %%note for the asm()'s operand
expansion, but leave it as %note for pure assembly. For progbits, there
are no operands, so it's %progbits either way.
Thanks to Martin C. Martin for first reporting this to LLVM[1], and then
returning to systemtap with a suggested compatibility fix.
[1] http://llvm.org/bugs/show_bug.cgi?id=17270
William Cohen [Thu, 19 Sep 2013 20:56:00 +0000 (16:56 -0400)]
Fix up testsuite/Makefile.am RUNTEST variable
The '"'s in the definition of RUNTEST in testsuite/Makefile.am was
making causing the test for DEJAGNU to fail. There didn't seem to be
a reason to keep the quotes around, so they were removed and "make
installcheck" works again.
William Cohen [Wed, 18 Sep 2013 17:25:29 +0000 (13:25 -0400)]
Correct systemtap.spec to match support currently available on aarch64
The aarch64 does not have dyninst, crash, or publican available. Thus,
the systmetap.spec file needs to turn those off those features
to allow systemtap to build on aarch64.
William Cohen [Thu, 19 Sep 2013 18:25:20 +0000 (14:25 -0400)]
Update gettext related material
The autoreconf command did not update the po/Makefile.in file. Needed
to update files files with a "gettext -f" so there is no complaint
about version mismatch for gettext.
William Cohen [Thu, 19 Sep 2013 15:39:17 +0000 (11:39 -0400)]
Update autoconf related files to support aarch64
The config.sub and config.guess were generated with an older version
of autoconf that did not know about aarch64 (64-bit ARM). Updated the
various files to support the aarch64 by running the following command:
Dave Brolley [Wed, 18 Sep 2013 15:17:05 +0000 (11:17 -0400)]
RHBZ 874205 [FJ6.2 Bug] Handle avahi-deamon restart gracefully in stap-serverd.
stap-serverd was crashing when the avahi-daemon was restarted. There was
some inproper use of the avahi-client API which casued this.
avahi_threaded_poll_stop() was being called from within the client callback
function.
Some reading of the API docs revelaed that, in this situation, the old
client should be freed and a new one created in order to transition
to the new daemon if/when it is started.
Also noticed a potential double free of objects associated with the client
when freeing the client. Freeing the client also frees the associated objects,
so it is not necessary, and potentially wrong, to free them ourselves before
freeing the client.
David Smith [Wed, 18 Sep 2013 14:44:13 +0000 (09:44 -0500)]
Avoid module compilation problems by unsetting the environment variable 'ARCH'.
* testsuite/lib/systemtap.exp (setup_systemtap_environment): Make sure the
environment variable 'ARCH' isn't set. If it is, it can cause custom
module building to fail.
David Smith [Mon, 16 Sep 2013 20:39:23 +0000 (15:39 -0500)]
PR15731 update: Fix 'syscall.{execve,compat_execve}' for older kernels.
* tapset/linux/syscalls.stp (syscall.execve): On kernels < 3.7, go back to
using 'do_execve', since sys_execve was in arch-specific code and had
varying arguments.
(syscall.compat_execve): Ditto.
* tapset/linux/nd_syscalls.stp: Ditto.
Lukas Berk [Fri, 13 Sep 2013 19:27:45 +0000 (15:27 -0400)]
Properly check and use minidebuginfo
dwflpp.cxx: add bool has_gnu_debuginfo() to check if section exists
dwflpp.h: declare bool has_gnu_debuginfo()
tapsets.cxx: check for .gnu_debuginfo as condition to query_module_symtab
and listing functions in a process
minidebuginfo.stp: correct the binary to probe
Stan Cox [Thu, 12 Sep 2013 19:44:19 +0000 (15:44 -0400)]
Bump python source releases.
* testsuite/systemtap.apps/python.exp: Bump python2release and python3release.
* testsuite/systemtap.apps/python2.stp: Check dict value before trying to
cast it.
Dave Brolley [Thu, 12 Sep 2013 17:30:25 +0000 (13:30 -0400)]
client.exp: Make sure spawned stap finishes.
Test cases should ensure that all spawned processes are
sufficiently complete before the expect {} block for that
test exits. This prevents any subsequent 'close' statement
from generating a SIGHUP and possibly interrupting the spawned
process.
William Cohen [Wed, 11 Sep 2013 21:18:29 +0000 (17:18 -0400)]
Parse additional SDT ARM arguments variations
When running qemu_count.stp example on arm a there were a number of
cases where systemtap could not parse the location of the marker
arguments for the qemu-system-arm.stp tapset. There were two cases
that were not handled in the code:
- Use of r10 in the argument location information
- Locations with zero offsets that omit the ", #0"
David Smith [Mon, 9 Sep 2013 20:03:31 +0000 (15:03 -0500)]
Make user_string_n_quoted.exp more robust.
* testsuite/systemtap.string/user_string_n_quoted.exp: Several small
changes. If we're not doing install testing, mark the test as
untested. Increase the timeout value, in case we're operating with a
cold cache. If we timeout, try to kill stap. Properly call "close" and
"wait" after "spawn" call.
* testsuite/systemtap.string/user_string_n_quoted.stp: Change
'nd_syscall.write' to 'syscall.write', since the 'syscall' variant has
more support.
Lukas Berk [Fri, 6 Sep 2013 17:41:39 +0000 (13:41 -0400)]
Fix minidebuginfo.exp testcase
The minidebuginfo testcase was based off of an incomplete documenation. We need
to properly fix the creation of the executable to test in a standalone instance.
create-minidebug.sh - properly create standalone testcase, this includes
removing all symbol, relocation and .debug_* sections.
Tweak naming of files with binary. prefix for easier
tracking
minidebuginfo.exp - updated file names to target and cleanup