Added LLVM 1.2 to nightly SPEC comparison runs

Diego Novillo dnovillo@redhat.com
Thu Apr 8 02:28:00 GMT 2004


I have added LLVM v1.2 to the mix of baseline compilers we compare
against on the nightly SPEC runs.

Chris, I've used the flags '-O2 -Wl,-native-cbe' and '-O3
-Wl,-native-cbe' for base and peak runs of LLVM.  I could use others,
but the idea is to compare compilers with default optimizations.

What I found so far is that at -O2, tree-ssa tends to generate faster
code except in eon (-8%) and, most notably, in art (-63%).

It's not easy to compare SPECfp because LLVM does not seem to have a
fortran FE.

LLVM also seems much slower than tree-ssa.  Total build time for SPECint
using tree-ssa is 362 seconds, compared to 797 seconds for LLVM.

Detailed results for LLVM are available from the main SPEC2k test page
at http://people.redhat.com/dnovillo/spec2000/tree-ssa-branch/


Diego.

-----------------------------------------------------------------------

LLVM (Before)

Compiler:   gcc version 3.4-llvm 20030924 (experimental)
flags:      -O3 -Wl,-native-cbe
Processor:  Intel(R) Pentium(R) 4 CPU 2.26GHz (2259.163 Mhz)
Memory:     1029860 kB
Cache:      512 KB

GCC (After)

Compiler:   gcc version 3.5-tree-ssa 20040407 (merged 20040331)
Flags:      -O2
Processor:  Intel(R) Pentium(R) 4 CPU 2.26GHz (2259.163 Mhz)
Memory:     1029860 kB
Cache:      512 KB


SPECint

    Benchmark	Before	 After	% diff
     164.gzip	488.22	643.83	+ 31.87%
      175.vpr	400.15	421.14	+  5.25%
      176.gcc	  0.00	  0.00	INF
      181.mcf	415.22	430.57	+  3.70%
   186.crafty	  0.00	665.66	INF
   197.parser	528.90	577.13	+  9.12%
      252.eon	626.26	574.25	-  8.31%
  253.perlbmk	  0.00	746.89	INF
      254.gap	631.74	741.06	+ 17.30%
   255.vortex	  0.00	852.20	INF
    256.bzip2	434.02	534.41	+ 23.13%
    300.twolf	493.08	527.10	+  6.90%
         mean	495.48	596.82	+ 20.45%


SPECfp

    Benchmark	Before	 After	% diff
  168.wupwise	  0.00	612.46	INF
     171.swim	  0.00	506.78	INF
    172.mgrid	  0.00	415.32	INF
    173.applu	  0.00	548.51	INF
     177.mesa	384.46	446.18	+ 16.05%
   178.galgel	  0.00	  0.00	INF
      179.art	512.55	189.21	- 63.08%
   183.equake	785.53	812.73	+  3.46%
  187.facerec	  0.00	  0.00	INF
     188.ammp	349.81	349.35	-  0.13%
    189.lucas	  0.00	  0.00	INF
    191.fma3d	  0.00	  0.00	INF
 200.sixtrack	  0.00	  0.00	INF
     301.apsi	  0.00	  0.00	INF
         mean	482.39	450.44	-  6.62%



More information about the Gcc mailing list