This is the mail archive of the
gcc@gcc.gnu.org
mailing list for the GCC project.
Re: Exhaustive simulator testing
- From: Richard Earnshaw <rearnsha at arm dot com>
- To: Zack Weinberg <zack at codesourcery dot com>
- Cc: gcc at gcc dot gnu dot org, Richard dot Earnshaw at arm dot com
- Date: Fri, 27 Sep 2002 11:01:41 +0100
- Subject: Re: Exhaustive simulator testing
- Organization: ARM Ltd.
- Reply-to: Richard dot Earnshaw at arm dot com
> Mostly to see what would happen, I wrote a script that built and
> tested the combined tree for every last target in the matrix I posted
> yesterday as part of the simtest-howto rewrite.
> arm-elf pass fail xpass xfail unres unsup untest
> binutils 31 1
> gas 63
> ld 29 3
> newlib 5 1
> gdb 6832 291 51 30 11 9
> gcc 20211 26 1 63 42 150
He He: here's a more complete list from my own runs, including some
multi-lib varaints...
All tests run from a compiler checked out at: Thu Sep 26 08:44:01 UTC 2002
configuration: arm-elf
arm-sim
pass fail xpass xfail unres unsup untest
binutils 31 1
gas 64
ld 29 3
newlib[1] 5 1
gdb[2] 6447 264 64 493 7
gcc 20662 26 1 63 42 151
g++ 7463 15 93 21 11 29
g77 1564 43 31 9 8
objc 1153
libjava[3] 2034 18 14 104
libstdc++ tests not run -- ?? couldn't locate runtest
arm-sim/-mhard-float
pass fail xpass xfail unres unsup untest
binutils 31 1
gas 64
ld 29 3
newlib[1] 5 1
gdb[2] 6238 276 64 596 7
gcc 20534 154 64 42 151
g++ 7463 15 93 21 11 29
g77 1559 47 21 9 8
objc 1153
libjava[3] 2034 18 14 104
libstdc++ tests not run -- ?? couldn't locate runtest
arm-sim/-mthumb
pass fail xpass xfail unres unsup untest
binutils 31 1
gas 64
ld 29 3
newlib[1] 5 1
gdb[2] 6280 390 64 466 7
gcc 20649 36 2 62 44 151
g++ 7491 58 93 21 11 29
g77 1560 46 21 9 8
objc 1153
libjava[3] 2035 18 14 103
libstdc++ tests not run -- ?? couldn't locate runtest
Notes:
[1] Newlib tests are run in every multi-lib variant on every pass;
typically all tests will fail if the multi-lib does not match the test
config ;-(
[2] My gdb sources contain major changes from the mainline, so are not
really representative.
[3] Libjava requires some minor changes to enable the package for arm-elf.
R.
PS. Does your script also produce the above summary tables? Something to
do that automatically would be very cool.