This is the mail archive of the gcc@gcc.gnu.org mailing list for the GCC project.


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]

SPECFP95 comparison: 2.95.3 vs 3.0-20010525 on SPARC


Hi!

Here are the results for the floating point benchmarks from SPEC95. A
short description for all of them is included at the end of this
message. All the benchmarks are in F77. 

These are what SPEC calls "validated results", ie each benchmark is
run 3 times, and the results have to be similar. 
The same is true for the results that appear at:
http://gcc.gnu.org/ml/gcc/2001-05/msg01438.html
and for those timing was even more consistent.
The machine is in multi-user mode, so that might affect the results.

What's the use of this kind of benchmarking? 
IMHO the main use is that it might help uncover some major
blunders... If there is any desire I could run the benchmarks with
different sets of optimization options. 

What can be extrapolated from this relative to GCC's performance on
other applications, or other platforms? Probably not much. 

An interesting read if you are interested in bechmarking is:
 http://www.cs.virginia.edu/~mccalpin/wwc-keynote.html
(and the author is a member of the SPECcpu committee)

Now here are the numbers (running time in seconds):

                     2.95.3             3.0-20010525
                     Base     Peak     Base     Peak 
   Benchmarks    Run Time Run Time Run Time Run Time 
   ------------  -------- -------- -------- -------- 
   101.tomcatv        280      271      295      290 
   102.swim           387      377      385      386 
   103.su2cor         235      237      235      238 
   104.hydro2d        395      395      398      395 
   107.mgrid          382      371      368      321 
   110.applu          300      294      300      286 
   125.turb3d         471      333      579      312 
   141.apsi           213      194      216      196 
   145.fpppp          657     1087      602      836 
   146.wave5          225      213      216      204 


The machine used for benchmarking: SUN Blade 100
Processor:   500MHz UltraSPARCIIe
RAM:         1GB
OS:          Solaris 2.8

The benchmarks are compiled with 2 sets of options:
   
for "Base": -O3
for "Peak": -O3 -mcpu=v8 -mtune=ultrasparc

It's interesting to see the spectacular performance gain when 
using -mcpu=v8 -mtune=ultrasparc for turb3d, and the drop for 
fpppp. 



Benchmark descriptions:
101.tomcatv Fluid Dynamics / Geometric Translation Generation of a
        two-dimensional boundary-fitted coordinate system around
        general geometric domains.
102.swim Weather Prediction Solves shallow water equations using
        finite difference approximations. (The only single precision
        benchmark in CFP95.)
103.su2cor Quantum Physics Masses of elementary particles are
        computed in the Quark-Gluon theory.
104.hydro2d Astrophysics Hydrodynamical Navier Stokes equations are
        used to compute galactic jets.
107.mgrid Electromagnetism Calculation of a 3D potential field.
110.applu Fluid Dynamics/Math Solves matrix system with pivoting.
125.turb3d Simulation Simulates turbulence in a cubic area.
141.apsi Weather Predication Calculates statistics on temperature
        and pollutants in a grid.
145.fpppp Chemistry Performs multi-electron derivatives.
146.wave Electromagnetics Solve's Maxwell's equations on a cartesian
        mesh.


Complete SPEC reports:
(note: SPEC scores are computed as a geometric mean of the "Ratio")


for 2.95.3

                     Base      Base      Base      Peak      Peak      Peak
   Benchmarks    Ref Time  Run Time     Ratio  Ref Time  Run Time     Ratio
   ------------  --------  --------  --------  --------  --------  --------
   101.tomcatv       3700       280     13.2       3700       271     13.7  
   101.tomcatv       3700       280     13.2       3700       271     13.7 *
   101.tomcatv       3700       280     13.2 *     3700       273     13.6  
   102.swim          8600       389     22.1       8600       377     22.8 *
   102.swim          8600       387     22.2 *     8600       377     22.8  
   102.swim          8600       387     22.2       8600       378     22.8  
   103.su2cor        1400       235      5.95      1400       237      5.90 
   103.su2cor        1400       235      5.95      1400       237      5.90*
   103.su2cor        1400       235      5.95*     1400       239      5.85 
   104.hydro2d       2400       397      6.05      2400       395      6.08*
   104.hydro2d       2400       395      6.08*     2400       395      6.08 
   104.hydro2d       2400       395      6.08      2400       395      6.08 
   107.mgrid         2500       382      6.55      2500       371      6.74*
   107.mgrid         2500       384      6.52      2500       373      6.71 
   107.mgrid         2500       382      6.54*     2500       371      6.74 
   110.applu         2200       300      7.34      2200       294      7.49 
   110.applu         2200       300      7.33      2200       294      7.48*
   110.applu         2200       300      7.34*     2200       294      7.48 
   125.turb3d        4100       473      8.68      4100       335     12.2  
   125.turb3d        4100       471      8.71      4100       333     12.3  
   125.turb3d        4100       471      8.71*     4100       333     12.3 *
   141.apsi          2100       213      9.86      2100       194     10.8  
   141.apsi          2100       213      9.86      2100       194     10.8  
   141.apsi          2100       213      9.86*     2100       194     10.8 *
   145.fpppp         9600       657     14.6       9600      1082      8.87 
   145.fpppp         9600       660     14.6       9600      1087      8.83*
   145.fpppp         9600       657     14.6 *     9600      1148      8.36 
   146.wave5         3000       225     13.3       3000       213     14.1 *
   146.wave5         3000       225     13.3 *     3000       213     14.1  
   146.wave5         3000       225     13.4       3000       215     13.9  
   ========================================================================
   101.tomcatv       3700       280     13.2       3700       271     13.7  
   102.swim          8600       387     22.2       8600       377     22.8  
   103.su2cor        1400       235      5.95      1400       237      5.90 
   104.hydro2d       2400       395      6.08      2400       395      6.08 
   107.mgrid         2500       382      6.54      2500       371      6.74 
   110.applu         2200       300      7.34      2200       294      7.48 
   125.turb3d        4100       471      8.71      4100       333     12.3  
   141.apsi          2100       213      9.86      2100       194     10.8  
   145.fpppp         9600       657     14.6       9600      1087      8.83 
   146.wave5         3000       225     13.3       3000       213     14.1  


for 3.0-20010525:

                     Base      Base      Base      Peak      Peak      Peak
   Benchmarks    Ref Time  Run Time     Ratio  Ref Time  Run Time     Ratio
   ------------  --------  --------  --------  --------  --------  --------
   101.tomcatv       3700       296     12.5       3700       290     12.7 *
   101.tomcatv       3700       295     12.5 *     3700       290     12.7  
   101.tomcatv       3700       295     12.5       3700       293     12.6  
   102.swim          8600       385     22.3 *     8600       386     22.3  
   102.swim          8600       387     22.2       8600       386     22.3 *
   102.swim          8600       385     22.3       8600       386     22.3  
   103.su2cor        1400       235      5.95      1400       238      5.87*
   103.su2cor        1400       235      5.96*     1400       238      5.88 
   103.su2cor        1400       235      5.96      1400       240      5.82 
   104.hydro2d       2400       400      5.99      2400       395      6.08 
   104.hydro2d       2400       398      6.02*     2400       395      6.08 
   104.hydro2d       2400       398      6.03      2400       395      6.08*
   107.mgrid         2500       368      6.79*     2500       321      7.78*
   107.mgrid         2500       368      6.80      2500       323      7.73 
   107.mgrid         2500       370      6.76      2500       321      7.78 
   110.applu         2200       300      7.33*     2200       286      7.68*
   110.applu         2200       300      7.33      2200       287      7.67 
   110.applu         2200       300      7.33      2200       286      7.69 
   125.turb3d        4100       579      7.08      4100       314     13.1  
   125.turb3d        4100       581      7.05      4100       312     13.2  
   125.turb3d        4100       579      7.08*     4100       312     13.1 *
   141.apsi          2100       216      9.71      2100       196     10.7  
   141.apsi          2100       216      9.71*     2100       196     10.7  
   141.apsi          2100       217      9.70      2100       196     10.7 *
   145.fpppp         9600       602     15.9       9600       845     11.4  
   145.fpppp         9600       599     16.0       9600       833     11.5  
   145.fpppp         9600       602     16.0 *     9600       836     11.5 *
   146.wave5         3000       215     13.9       3000       204     14.7  
   146.wave5         3000       216     13.9 *     3000       204     14.7 *
   146.wave5         3000       217     13.8       3000       205     14.7  
   ========================================================================
   101.tomcatv       3700       295     12.5       3700       290     12.7  
   102.swim          8600       385     22.3       8600       386     22.3  
   103.su2cor        1400       235      5.96      1400       238      5.87 
   104.hydro2d       2400       398      6.02      2400       395      6.08 
   107.mgrid         2500       368      6.79      2500       321      7.78 
   110.applu         2200       300      7.33      2200       286      7.68 
   125.turb3d        4100       579      7.08      4100       312     13.1  
   141.apsi          2100       216      9.71      2100       196     10.7  
   145.fpppp         9600       602     16.0       9600       836     11.5  
   146.wave5         3000       216     13.9       3000       204     14.7  


Index Nav: [Date Index] [Subject Index] [Author Index] [Thread Index]
Message Nav: [Date Prev] [Date Next] [Thread Prev] [Thread Next]