[RFC] Automatic nightly builds?

[Joseph S. Myers]

On Sun, 21 Jul 2013, Frank Ch. Eigler wrote:

> "Joseph S. Myers" <joseph@codesourcery.com> writes:
> 
> > [...]
> > Diffs in .out files are not reliable indications of changes to testsuite 
> > failures.  Instead, we should get in some version of Tomas Dohnalek's 
> > patch to log PASS / FAIL results for individual tests.  At that point, you 
> > have something for which comparisons are reasonably reliable and useful, 
> > even if not perfect.
> 
> As an experiment, some of y'all might try emailing a copy of your
> dejagnu .sum files to dejazilla@elastic.org, to get them stored in a

Without Tomas Dohnalek's changes, there isn't anything looking passably 
like a DejaGnu .sum file at all.  (With those changes, generating a 
DejaGnu-like header and footer would be easy enough.  There are plenty of 
other glibc testsuite issues as described at length in 
<http://sourceware.org/ml/libc-alpha/2013-07/msg00256.html>, including 
wanting PASS/FAIL structured information for individual assertions within 
tests, but just PASS/FAIL information for tests run from makefiles - or 
even just for the subset of tests run with generic makefile rules rather 
than with their own special rules, which I think is all Tomas's patches 
actually handle - would be a very good start.)

-- 
Joseph S. Myers
joseph@codesourcery.com