This is the mail archive of the
gcc-help@gcc.gnu.org
mailing list for the GCC project.
Re: Two questions of gcc testing
- From: "Pranav Bhandarkar" <pranav dot bhandarkar at gmail dot com>
- To: "Paul Li" <paulur at gmail dot com>
- Cc: gcc-help at gcc dot gnu dot org
- Date: Mon, 17 Dec 2007 12:34:28 +0530
- Subject: Re: Two questions of gcc testing
- References: <20d714960712162205w5c54aa27q6b43678dd4b68eaa@mail.gmail.com>
Hi,
> 2. how do the test cases get the oracles (i.e. how to decide the
> testing output is Pass, Fail, ...)?
IMHO, it depends. Like in the dg tests ( gcc.dg) there are ways of
specifying in the testcase itself as to what the test aims to check.
For e.g with a /* { dg-final { scan-assembler "add a, b" } } */ we say
that if the instruction add a, b is present in the assembly the test
has passed. For torture tests (gcc.c-torture) usually a testcase that
exits with a non-zero values is said to have failed. See
http://gcc.gnu.org/wiki/HowToPrepareATestcase for more details.
HTH,
Pranav