improving testsuite runtime

[David Daney]

Ben Elliston wrote:
> On Thu, 2008-09-18 at 10:44 -0600, Tom Tromey wrote:
> 
>> Ben> So, I guess my question is: what now?  What do people feel would be
>> Ben> required to make this usable?  I assume that the most pressing thing
>> Ben> would be to have the build system fold the various .log and .sum files
>> Ben> together so that they look like they were run as a whole.
> 
>> Yeah, this seems necessary.  Ideally the order ought to be stable, too.
> 
> Do you think that the current order of .exps should be preserved in the
> resultant .sum and .logs?  I guess some people and/or build farms
> actually use diff rather than compare_tests?
> 

That would be nice, but you could sort your FAILs if it changed and be 
able to compare the sorted lists.

But stability within a given revision of the testsuite I think would be 
almost essential.

David Daney