I put money on this one given pmuldoon found that files.list wasn't deleted.
Unless the in-tree testsuite is disabled, or customized so that system dependant it enables or disables test, this can't work.