Re: improving testsuite runtime

[David Daney <ddaney at avtrex dot com>]

Ben Elliston wrote:
> On Thu, 2008-09-18 at 10:44 -0600, Tom Tromey wrote:
>
> > Ben> So, I guess my question is: what now?  What do people feel would be
> > Ben> required to make this usable?  I assume that the most pressing thing
> > Ben> would be to have the build system fold the various .log and .sum files
> > Ben> together so that they look like they were run as a whole.
>
> > Yeah, this seems necessary.  Ideally the order ought to be stable, too.
>
> Do you think that the current order of .exps should be preserved in the
> resultant .sum and .logs?  I guess some people and/or build farms
> actually use diff rather than compare_tests?

That would be nice, but you could sort your FAILs if it changed and be 
able to compare the sorted lists.

But stability within a given revision of the testsuite I think would be 
almost essential.

David Daney