SPECFP95 comparison: 2.95.3 vs 3.0-20010525 on SPARC
Dan Nicolaescu
dann@godzilla.ICS.UCI.EDU
Mon May 28 11:18:00 GMT 2001
Hi!
Here are the results for the floating point benchmarks from SPEC95. A
short description for all of them is included at the end of this
message. All the benchmarks are in F77.
These are what SPEC calls "validated results", ie each benchmark is
run 3 times, and the results have to be similar.
The same is true for the results that appear at:
http://gcc.gnu.org/ml/gcc/2001-05/msg01438.html
and for those timing was even more consistent.
The machine is in multi-user mode, so that might affect the results.
What's the use of this kind of benchmarking?
IMHO the main use is that it might help uncover some major
blunders... If there is any desire I could run the benchmarks with
different sets of optimization options.
What can be extrapolated from this relative to GCC's performance on
other applications, or other platforms? Probably not much.
An interesting read if you are interested in bechmarking is:
http://www.cs.virginia.edu/~mccalpin/wwc-keynote.html
(and the author is a member of the SPECcpu committee)
Now here are the numbers (running time in seconds):
2.95.3 3.0-20010525
Base Peak Base Peak
Benchmarks Run Time Run Time Run Time Run Time
------------ -------- -------- -------- --------
101.tomcatv 280 271 295 290
102.swim 387 377 385 386
103.su2cor 235 237 235 238
104.hydro2d 395 395 398 395
107.mgrid 382 371 368 321
110.applu 300 294 300 286
125.turb3d 471 333 579 312
141.apsi 213 194 216 196
145.fpppp 657 1087 602 836
146.wave5 225 213 216 204
The machine used for benchmarking: SUN Blade 100
Processor: 500MHz UltraSPARCIIe
RAM: 1GB
OS: Solaris 2.8
The benchmarks are compiled with 2 sets of options:
for "Base": -O3
for "Peak": -O3 -mcpu=v8 -mtune=ultrasparc
It's interesting to see the spectacular performance gain when
using -mcpu=v8 -mtune=ultrasparc for turb3d, and the drop for
fpppp.
Benchmark descriptions:
101.tomcatv Fluid Dynamics / Geometric Translation Generation of a
two-dimensional boundary-fitted coordinate system around
general geometric domains.
102.swim Weather Prediction Solves shallow water equations using
finite difference approximations. (The only single precision
benchmark in CFP95.)
103.su2cor Quantum Physics Masses of elementary particles are
computed in the Quark-Gluon theory.
104.hydro2d Astrophysics Hydrodynamical Navier Stokes equations are
used to compute galactic jets.
107.mgrid Electromagnetism Calculation of a 3D potential field.
110.applu Fluid Dynamics/Math Solves matrix system with pivoting.
125.turb3d Simulation Simulates turbulence in a cubic area.
141.apsi Weather Predication Calculates statistics on temperature
and pollutants in a grid.
145.fpppp Chemistry Performs multi-electron derivatives.
146.wave Electromagnetics Solve's Maxwell's equations on a cartesian
mesh.
Complete SPEC reports:
(note: SPEC scores are computed as a geometric mean of the "Ratio")
for 2.95.3
Base Base Base Peak Peak Peak
Benchmarks Ref Time Run Time Ratio Ref Time Run Time Ratio
------------ -------- -------- -------- -------- -------- --------
101.tomcatv 3700 280 13.2 3700 271 13.7
101.tomcatv 3700 280 13.2 3700 271 13.7 *
101.tomcatv 3700 280 13.2 * 3700 273 13.6
102.swim 8600 389 22.1 8600 377 22.8 *
102.swim 8600 387 22.2 * 8600 377 22.8
102.swim 8600 387 22.2 8600 378 22.8
103.su2cor 1400 235 5.95 1400 237 5.90
103.su2cor 1400 235 5.95 1400 237 5.90*
103.su2cor 1400 235 5.95* 1400 239 5.85
104.hydro2d 2400 397 6.05 2400 395 6.08*
104.hydro2d 2400 395 6.08* 2400 395 6.08
104.hydro2d 2400 395 6.08 2400 395 6.08
107.mgrid 2500 382 6.55 2500 371 6.74*
107.mgrid 2500 384 6.52 2500 373 6.71
107.mgrid 2500 382 6.54* 2500 371 6.74
110.applu 2200 300 7.34 2200 294 7.49
110.applu 2200 300 7.33 2200 294 7.48*
110.applu 2200 300 7.34* 2200 294 7.48
125.turb3d 4100 473 8.68 4100 335 12.2
125.turb3d 4100 471 8.71 4100 333 12.3
125.turb3d 4100 471 8.71* 4100 333 12.3 *
141.apsi 2100 213 9.86 2100 194 10.8
141.apsi 2100 213 9.86 2100 194 10.8
141.apsi 2100 213 9.86* 2100 194 10.8 *
145.fpppp 9600 657 14.6 9600 1082 8.87
145.fpppp 9600 660 14.6 9600 1087 8.83*
145.fpppp 9600 657 14.6 * 9600 1148 8.36
146.wave5 3000 225 13.3 3000 213 14.1 *
146.wave5 3000 225 13.3 * 3000 213 14.1
146.wave5 3000 225 13.4 3000 215 13.9
========================================================================
101.tomcatv 3700 280 13.2 3700 271 13.7
102.swim 8600 387 22.2 8600 377 22.8
103.su2cor 1400 235 5.95 1400 237 5.90
104.hydro2d 2400 395 6.08 2400 395 6.08
107.mgrid 2500 382 6.54 2500 371 6.74
110.applu 2200 300 7.34 2200 294 7.48
125.turb3d 4100 471 8.71 4100 333 12.3
141.apsi 2100 213 9.86 2100 194 10.8
145.fpppp 9600 657 14.6 9600 1087 8.83
146.wave5 3000 225 13.3 3000 213 14.1
for 3.0-20010525:
Base Base Base Peak Peak Peak
Benchmarks Ref Time Run Time Ratio Ref Time Run Time Ratio
------------ -------- -------- -------- -------- -------- --------
101.tomcatv 3700 296 12.5 3700 290 12.7 *
101.tomcatv 3700 295 12.5 * 3700 290 12.7
101.tomcatv 3700 295 12.5 3700 293 12.6
102.swim 8600 385 22.3 * 8600 386 22.3
102.swim 8600 387 22.2 8600 386 22.3 *
102.swim 8600 385 22.3 8600 386 22.3
103.su2cor 1400 235 5.95 1400 238 5.87*
103.su2cor 1400 235 5.96* 1400 238 5.88
103.su2cor 1400 235 5.96 1400 240 5.82
104.hydro2d 2400 400 5.99 2400 395 6.08
104.hydro2d 2400 398 6.02* 2400 395 6.08
104.hydro2d 2400 398 6.03 2400 395 6.08*
107.mgrid 2500 368 6.79* 2500 321 7.78*
107.mgrid 2500 368 6.80 2500 323 7.73
107.mgrid 2500 370 6.76 2500 321 7.78
110.applu 2200 300 7.33* 2200 286 7.68*
110.applu 2200 300 7.33 2200 287 7.67
110.applu 2200 300 7.33 2200 286 7.69
125.turb3d 4100 579 7.08 4100 314 13.1
125.turb3d 4100 581 7.05 4100 312 13.2
125.turb3d 4100 579 7.08* 4100 312 13.1 *
141.apsi 2100 216 9.71 2100 196 10.7
141.apsi 2100 216 9.71* 2100 196 10.7
141.apsi 2100 217 9.70 2100 196 10.7 *
145.fpppp 9600 602 15.9 9600 845 11.4
145.fpppp 9600 599 16.0 9600 833 11.5
145.fpppp 9600 602 16.0 * 9600 836 11.5 *
146.wave5 3000 215 13.9 3000 204 14.7
146.wave5 3000 216 13.9 * 3000 204 14.7 *
146.wave5 3000 217 13.8 3000 205 14.7
========================================================================
101.tomcatv 3700 295 12.5 3700 290 12.7
102.swim 8600 385 22.3 8600 386 22.3
103.su2cor 1400 235 5.96 1400 238 5.87
104.hydro2d 2400 398 6.02 2400 395 6.08
107.mgrid 2500 368 6.79 2500 321 7.78
110.applu 2200 300 7.33 2200 286 7.68
125.turb3d 4100 579 7.08 4100 312 13.1
141.apsi 2100 216 9.71 2100 196 10.7
145.fpppp 9600 602 16.0 9600 836 11.5
146.wave5 3000 216 13.9 3000 204 14.7
More information about the Gcc
mailing list