Need higher resolution times for linpack benchmark
Tim Prince
n8tm@aol.com
Mon Dec 14 14:29:00 GMT 2009
N.M. Maclaren wrote:
> On Dec 13 2009, Delbert Franz wrote:
>> On Friday 11 December 2009, Steve Kargl wrote:
>>>
>>> On a slightly different note, if your running an archaic synthetic
>>> benchmark that completes at the resolution of your timing routines,
>>> then you might consider the merits of said benchmark. That is,
>>> change the 100x100 matrix size to 1000x1000 or larger as needed.
>>
>> Yes, Steve, the benchmark may be archaic in the eyes of all the
>> "youngsters", but it is not archaic because here is a report that just
>> came out last month:
>> http://www.netlib.org/benchmark/performance.ps
>
> It's archaic, and there is no way that I am a "youngster"! I agree with
> Steve that most uses of it are just plain crap. However, I agree with
> you that it still has its uses.
>
> When I was benchmarking supercomputers, I included it (with a variety of
> sizes, if I recall), as one of a suite of benchmarks, and ran it both in
> serial and with one copy on each processor. Several vendors commented
> that it could be vastly improved, to which my response was that I was
> using it as a baseline test of the compiler's optimisation on typical
> antiquated code. I also included similar tests of the BLAS and LAPACK,
> which I also ran in serial and parallel, to see what the tuned libraries
> delivered. The differences were as you would expect :-)
>
>
> Regards,
> Nick Maclaren.
>
>
>
If you're looking for archaic benchmarks which adjust themselves to the
timer resolution, there's Livermore Fortran Kernels. If using CPU_TIME
or the archaic etime, it adjusts its repetitions up to 20 minutes, yet
doesn't produce as useful a result as does a microsecond resolution
timer with a 5 second run. Supposing that you are testing the ability
of the compiler to parallelize, you want an elapsed timer, such as
omp_get_wtime(), not CPU_TIME or the archaic etime() or secnds().
As to 100x100 linpack, the original SpecFP forced several compiler
vendors to include the KAP preprocessor/optimizer so as to defeat it by
gaining cache locality. That in turn forced introduction of new
versions of SpecFP.
Speaking of archaic, my employer-sponsored OS installation doesn't know
how to display postscript, after all these years of development. I
won't vote on whether the OS or .ps is archaic.
More information about the Fortran
mailing list