Re: testsuite status

[Josh Stone <jistone at redhat dot com>]

On 05/20/2010 12:06 PM, David Smith wrote:
> On 05/20/2010 01:44 PM, Roland McGrath wrote:
>> Also, I'm interested in a slightly different regression testing scenario.
>> I'm doing some internal changes that should not affect output at all.  So
>> what I'd like to do is not even bother with a 'make installcheck' or any
>> dynamic tests, but instead run on a full set (as full as possible) of test
>> scripts, but only translate them to C and save all those .c files.  Then I
>> want to do that before and after a change, and see diffs on all the
>> generated C files.  Is there a way to run the testsuite like that?
> 
> Hmm, not that I know of.  You might be able to:
> 
> - delete your cache directory (in the testsuite, not in your home dir)
> - run the original code, then move the cache directory someplace
> - compile your new code, run the testsuite
> - compare old and new cache directories

Another idea -- if you want to also compare all the things that would
have been in installcheck, you could just neuter stap in the options
parsing to last_pass <= 3.  The testsuite will report lots of failures,
but you'll still be able to compare the generated C.

Josh