Differences between revisions 11 and 12
Revision 11 as of 2013-09-06 09:25:30
Size: 2884
Editor: 134
Comment: Added ARI to roadmap
Revision 12 as of 2013-09-27 08:20:06
Size: 2910
Editor: 134
Comment: Added travis to hosted build services
Deletions are marked like this. Additions are marked like this.
Line 60: Line 60:
 * https://travis-ci.org

BuildBot

Goal

Test GDB for each new repository commit and report any regressions for it. Test also regressions for user-provided patches.

Regressions get detected by running the thorough GDB testsuite and (a bit fuzzy) comparison of its results against the previous build results. (optional, can be done by the GDB team)

Roadmap

  • Make builds more reliable e.g add local git mirror to avoid git timeouts
  • Move all native builds to cross builds.
  • Add new operating systems like windows, freebsd, openbsd
  • Add new architectures like mips, powerpc, ia64
  • Run tests for available targets and store results in a database
  • Write a script which detects regressions
  • Add a ARI step

Opens

  • How build fails and regression should be reported e.g. via irc, email to the offender or gdb-testers
  • How to trigger build/test runs prior to commits to the CVS
  • How to deal with reporting false regression positives due to fuzzy testsuite results

Feature list

Compatibility is required with GDB repository in both CVS and GIT.

Support various provided (as rpms, distros or upstream repository branches/tags) GCC versions for building GDB and its testing workload.

Support multiple testing hosts with various architectures. Beaker test system integration must not be required for x86* but it should be supported to be able to cover also other arches.

Support running tests inside various kinds of virtualized hosts. Either mock (=chroot) or the full KVM virtual host. (It may be just provided by Beaker, interfaced probably by libvirt.)

Support running multi-host testsuite using gdbserver (remote GDB backend).

Properly report kernel crashes of hosts under the test. Associate the kernel crash reports with the GDB workload under test.

(optional) Integration with Fedora/RHEL mock (OS distribution provisioning) and the rpm packaging to test also new Fedora/RHEL builds with it.

(optional) Besides GDB to regression test also binutils.

Supporting other features of existing buildbot solutions.

Analyze existing buildbot solutions, we could just deploy one of them:

Hosted Build Services

None: BuildBot (last edited 2013-09-27 08:20:06 by 134)

All content (C) 2008 Free Software Foundation. For terms of use, redistribution, and modification, please see the WikiLicense page.