How to properly check for regressions?

[Tom Tromey]

>>>>> "Marc" == Marc Khouzam <marc.khouzam@ericsson.com> writes:

Marc> What is the right way to make sure my patch does not cause regressions?

What I do is have a script that extracts the relevant lines from gdb.sum
and normalizes them; then I compare the normalized files.

Our buildbot automates all this -- but I suspect somewhat poorly,
because Jan is constantly finding regressions I didn't see.
Probably we should all use his script.  I think he's sent it to one of
the lists before; or maybe it is on the wiki.

Marc> And how do I deal with tests that sometimes pass and sometimes fail.

The most common approach is to learn what they are and ignore them.
This isn't totally satisfactory; fixing them or removing them would be
nicer.

Tom