SPEC regression in perl

Wolfgang Bangerth bangerth@ices.utexas.edu
Tue Aug 17 15:24:00 GMT 2004


Jeff,

> Perl is notoriously flakey -- to the point of running the same binary
> with the same inputs varying by 10% without rhyme or reason.  In fact,
> I've found it's the most useless of all the SPEC tests because of the
> inability to get consistent results out of the bloody thing.
>
> I wouldn't mind looking at a specific problem if you can find one, but
> I'm not likely to go on what is likely a wild goose chase inside perl.

While your claim about variability is clearly supported by the charts in the 
tester, I think you can't decline looking at the problem that easily. 
Averaged over about 10 runs, the results for base tests in perlbmk are about 
20% worse starting at the date Andrew mentioned, and the drop is about four 
times as large as the variability. 

It would be nice if you could spend a little more time explaining why you 
think that you need not look into the problem pointed out.

Thanks
  Wolfgang

-------------------------------------------------------------------------
Wolfgang Bangerth              email:            bangerth@ices.utexas.edu
                               www: http://www.ices.utexas.edu/~bangerth/



More information about the Gcc mailing list