[GCC 3.x] Performance testing for QA

[Sasi Péter <Peter dot Sasi at t-systems dot co dot hu>]

Dear GCC people,

Allow me the humble question to ask you if it would possible to employ a simple yet efficient testing method from real life as opposed to the SPEC* (artificial) test?
Specifically I was thinking of running a few encoding/decoding/manipulation runs with mplayer on sample multimedia streams.

Main reasons I could think of are:
- Easy to test: all you need (sources, sample files) is available free at www.mplayerhq.hu (for Linux(intel, alpha), Solaris, Irix, etc.)
- Important for masses: it is one of the most widely used free software in the area gaining probably the most momentum nowadays (amongst performace hungry software)
- There is a lot of space for improvements: even the 2.95 series perform better than the ongoing 3.x series, but if going for the long term Intel's compiler currently wins hands down

I know it is not a very scientific measurement, still it does apply to a lot of people, andd is a reason why a lot of people still stick to the older versions.
New features are really an important thing to have, still they should not make it instead of the good performance, but exploiting it.

Summarizing the above:
- Do you think such measurements are feasible/worth and can supply usable input for the development?
- Do you lack the interest, the resources, or what else?
- Ifyou are not interested, is there a reasoning behind that? (point me to RTFM if applicable)
- In case of positive answers do you think profiling, code analysis or what else could be the way to improve the current situation? (get 3.x to the perf. level of 2.95.x)

Please CC my personal address in your reply, since I am not subscribed to any of your mailing lists.

Thank you for your precious time.

Best regards,

Peter
-- Sasi Péter                   E-mail:  peter.sasi@t-systems.co.hu 
   Sr. Systems Engineer       Internet: <http://www.t-systems.co.hu/> 
   T-Systems Unisoftware Ltd.              Phone:  +36 (1)  456 54 13 
   Hungary                                 Fax:    +36 (1)  456 54 99 
Postal address: H-1453 Budapest 92, Pf.28. Mobile: +36 (30) 280 34 31 
Address: H-1097 Budapest, Könyves Kálmán krt. 12-14. 3.em., Lurdy-Ház