DF branch benchmarking on SPEC2000

Vladimir N. Makarov vmakarov@redhat.com
Wed May 23 00:23:00 GMT 2007


  Ken Zadeck asked me to do another round of DF branch benchmarking on
SPEC2000.  There is a progress on compilation speed (0.5%-1%) since
last my benchmarking pratically for all platforms.  Now in average
code size and SPEC scores are practically the same for the mainline
and the branch.  To be honest I am not worried anymore about the
branch because most serious degradations were fixed a few weeks ago.
Because people working on the branch are determined to add the code
for 4.3 release, so may be it is worth to plan the merge of
the branch into the mainline to have more time to fix bugs on minor
platforms (of course if people find them).

  So this is latest df-branch (with latest Ken Zadeck's
patches)/mainline(r124833) comparison after the last merge to the branch
(done 05/18).  When the merge was done, fma3d was broken on the
mainline.  Therefore the results for SPECFP are given without this
benchmark.  My scripts also failed to produce code size change for
x86_64.

  All toolchains were compiled with --enable-checking=release (-O2 was
used to SPEC2000 benchmarks).  Four platforms for benchmarking were
used:

x86_64: 2.6 Ghz Core2.
Itanium: 1.6Ghz Itanium2.
PPC64: 2.5Ghz G5.
Pentium4: 3.2Ghz Pentium4 (additionally -mtune=pentium4 was used).

The attachments contain more verbose info about SPEC2000 results
(there base is df-branch, peak is mainline on the merge point).

Here is the summary:

Compilation time SPECINT2000 (user time sec):
**********Mainline Branch Change
--------------------------------
x86_64    139.96   148.15   +5.8%
Itanium   441.01   476.72   +8.1%
PPC64     375.41   399.43   +6.3%
Pentium4  252.67   269.27   +6.5%

Compilation time SPECFP2000 (user time sec):
**********Mainline Branch Change
--------------------------------
x86_64     94.64   102.02   +7.7%
Itanium   331.56   370.22  +11.6%   
PPC64     296.11   298.75   +0.9%
Pentium4  168.99   180.48   +6.7%

Code Size SPECINT2000 (text segment)
**********Change
--------------------------------
x86_64    -
Itanium   -0.10%
PPC64     -0.10%
Pentium4  +0.11%

Code Size SPECFP2000 (text segment)
**********Change
--------------------------------
x86_64    -
Itanium   -0.21%
PPC64     -0.06%
Pentium4  +0.02%

SPECINT200 Scores:
**********Mainline Branch Change
--------------------------------
x86_64    1939     1937   -0.10%
Itanium    866      865   -0.12%
PPC64      674      674   0%
Pentium4   897      897   0%

SPECFP200 Scores:
**********Mainline Branch Change
--------------------------------
x86_64    1782     1775   -0.39%
Itanium    552      548   -0.72%
PPC64      618      619   +0.16%
Pentium4   686      682   -0.58%

-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: X86_64
URL: <https://gcc.gnu.org/pipermail/gcc/attachments/20070523/79de73cf/attachment.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: PPC64
URL: <https://gcc.gnu.org/pipermail/gcc/attachments/20070523/79de73cf/attachment-0001.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: P4
URL: <https://gcc.gnu.org/pipermail/gcc/attachments/20070523/79de73cf/attachment-0002.ksh>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: Itanium
URL: <https://gcc.gnu.org/pipermail/gcc/attachments/20070523/79de73cf/attachment-0003.ksh>


More information about the Gcc mailing list