Format for auto-regression testers to submit new fails for inclusion into bugzilla

Daniel Berlin dberlin@dberlin.org
Fri Jun 11 02:52:00 GMT 2004


My thinking is we just need something like the below (this was done 
without *tons* of thought, so please feel free to smash it to bits), 
and this is what is currently implemented.
WE can extend it as necessary
i haven't started to deal with what we do when a regression occurs, we 
fix it, then it occurs again later.  It's hard to handle this case 
because we don't know when a given regression tester is going to run, 
so we can't just immediately rename the bug summary to reflect the 
actual problem, or a new bug might be created by the next regression 
tester to dtect the failure (though we could just mark those as dups, i 
guess).

All emails in the below format go to gcc-bugzilla-regression@gcc.gnu.org

Bugzilla auto-regression tester bug submit format, version 0.1
All fields are required.
All versions much match those in Bugzilla (that means it is 3.4.0, not 
3.4), or I will injure you.
All invalid emails are ignored with no reply (since it's an automatic 
script on one end sending to an automatic script on the other end)
Blank lines are ignored
Field names are not case sensitive
Field order is ignored, except for comment. The comment is generated 
in-order.
All fields may only appear once, except EmailCC and Comment, which may 
appear multiple times
TestName is expected to be just the name of the test, as printed by 
dejagnu, with nothing else
The format of each line of the email is

BLANK
| <field name>:<any amount of leading whitespace><field data><any 
amount of trailing whitespace><EOL>

Field names are:
TargetTriplet
HostTriplet
BuildTriplet
TestName
FailureDate
Comment
EmailCC
Version

A valid email would therefore be:

TargetTriplet: powerpc-eabisim
HostTriplet: i686-pc-linux-gnu
BuildTriplet: i686-pc-linux-gnu
TestName: g++.old-deja/g++.pt/overload11.C
EmailCC: dberlin@dberlin.org
EmailCC: Ibrokethetest@brokentest.net
FailureDate: 06-09-2004
Version: 3.4.0
Comment: On 06-09-2004 at 3pm, the autocrasher detected a new failure 
during make check
Comment: ChangeLog of patches since the last time the autocrasher was 
run follows:
Comment: 2004-06-09  Daniel Berlin <dberlin@dberlin.org>
Comment: 		* (a.c): Innocuous change
Comment: 2004-06-09  IBrokeTheTest <ibrokethetest@brokentest.net>
Comment:		* (toplev.c): Fix for cris-linux-gnu


If you need something to test that your emails are in the proper 
format, checkout wwwdocs/bugzilla/contrib/regress-submit.pl, and remove 
the database stuff it does at the end.
If those regexes catch it, it's valid.




More information about the Gcc mailing list