This is the mail archive of the
gcc@gcc.gnu.org
mailing list for the GCC project.
Re: Testing compiler reliability using Csmith
- From: Kyrill Tkachov <kyrylo dot tkachov at foss dot arm dot com>
- To: Radu Ometita <radu dot ometita at iohk dot io>, "gcc at gcc dot gnu dot org" <gcc at gcc dot gnu dot org>
- Cc: Philip Wadler <philip dot wadler at iohk dot io>
- Date: Fri, 07 Dec 2018 15:54:28 +0000
- Subject: Re: Testing compiler reliability using Csmith
- References: <9E61E004-96ED-48F7-8DCC-8739096F2310@iohk.io>
Hi Radu,
On 06/12/18 22:10, Radu Ometita wrote:
Hello everyone!
We are working on writing a paper about testing the reliability of C compilers by using Csmith (a random C99 program generator).
A previous testing effort, using Csmith, found 79 GCC bugs, and 25 of those have been marked by developers as P1 (https://www.flux.utah.edu/download?uid=114 <https://www.flux.utah.edu/download?uid=114>): . However, after this paper was published we are unaware of any further testing using Csmith, and we would like to ask you, if you are aware of any such efforts or further results.
We've had a large amount of really good bug reports come out of the research at:
https://people.inf.ethz.ch/suz/emi/index.html
If I understand the research correctly, the seed programs are either csmith-generated or taken from the GCC testsuite
and the mutations applied to them expose compiler bugs.
Thanks,
Kyrill
Best regards,
Radu Ometita,
Functional compilers engineer @IOHK