This is the mail archive of the
gcc@gcc.gnu.org
mailing list for the GCC project.
Re: GCC Buildbot Update - Definition of regression
- From: David Malcolm <dmalcolm at redhat dot com>
- To: gcc at gcc dot gnu dot org
- Date: Fri, 13 Oct 2017 16:04:30 -0400
- Subject: Re: GCC Buildbot Update - Definition of regression
- Authentication-results: sourceware.org; auth=none
- Authentication-results: ext-mx08.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com
- Authentication-results: ext-mx08.extmail.prod.ext.phx2.redhat.com; spf=fail smtp.mailfrom=dmalcolm at redhat dot com
- Dmarc-filter: OpenDMARC Filter v1.3.2 mx1.redhat.com D0613C059B85
- References: <3b204c53-7613-ffe2-172b-69ad2a781ceb@linki.tools> <alpine.DEB.2.20.1710102111080.20946@digraph.polyomino.org.uk> <726e85ce-9ded-e9b4-6412-edb1da76c768@linki.tools> <CAKdteOYgCJarP+XAvJyYCt3Ei-8-=g8miFJrw_YSc_LBO4gm6A@mail.gmail.com> <cc914915-803d-ae65-0fc5-adc7f7d86d4f@linki.tools> <CAKdteOZn4arbq1S4vAi16-+GHXkYkM8qT=OpcJjUfS5EwP=Bsg@mail.gmail.com> <83c99ad7-a4b5-e733-4e95-5ef995412c1a@linki.tools> <1507727591.29092.33.camel@redhat.com> <alpine.DEB.2.20.1710111602020.2980@stedding.saclay.inria.fr>
On Wed, 2017-10-11 at 16:17 +0200, Marc Glisse wrote:
> On Wed, 11 Oct 2017, David Malcolm wrote:
>
> > On Wed, 2017-10-11 at 11:18 +0200, Paulo Matos wrote:
> > >
> > > On 11/10/17 11:15, Christophe Lyon wrote:
> > > >
> > > > You can have a look at
> > > > https://git.linaro.org/toolchain/gcc-compare-results.git/
> > > > where compare_tests is a patched version of the contrib/
> > > > script,
> > > > it calls the main perl script (which is not the prettiest thing
> > > > :-)
> > > >
> > >
> > > Thanks, that's useful. I will take a look.
> >
> > You may also want to look at this script I wrote:
> >
> > https://github.com/davidmalcolm/jamais-vu
> >
> > (it has Python classes for working with DejaGnu output)
>
> By the way, David, how do you handle comparisons for the jit
> testsuite? jv
> gives
>
> Tests that went away in build/gcc/testsuite/jit/jit.sum: 81
> -----------------------------------------------------------
>
> PASS: t
> PASS: test-
> PASS: test-arith-overflow.c
> PASS: test-arith-overflow.c.exe iteration 1 of 5: verify_uint_over
> PASS: test-arith-overflow.c.exe iteration 2 of 5: verify_uint_o
> PASS: test-arith-overflow.c.exe iteration 3 of 5: verify
> [...]
>
> Tests appeared in build/gcc/testsuite/jit/jit.sum: 78
> -----------------------------------------------------
>
> PASS: test-arith-overflow.c.exe iteration 1
> PASS: test-arith-overflow.c.exe iteration 2 of
> PASS: test-arith-overflow.c.exe iteration 4 of 5: verify_u
> PASS: test-combination.
> PASS: test-combination.c.exe it
> [...]
>
> The issue is more likely in the testsuite, but I assume you have a
> workflow that allows working around the issue?
I believe the issue here is PR jit/69435 ("Truncated lines in
jit.log").
I suspect that the attachment in comment #2 there ought to fix it
(sorry that this issue stalled; in the meantime I've been simplying
verifying the absence of FAILs and checking the number of PASSes in
jit.sum).
Dave