[Bug testsuite/64983] Incomplete summary when regtesting with dejagnu 1.5.2.

[dominiq at lps dot ens.fr]

https://gcc.gnu.org/bugzilla/show_bug.cgi?id=64983

Dominique d'Humieres <dominiq at lps dot ens.fr> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|UNCONFIRMED                 |NEW
   Last reconfirmed|                            |2015-02-09
                 CC|                            |howarth at bromo dot med.uc.edu,
                   |                            |iains at gcc dot gnu.org,
                   |                            |mrs at gcc dot gnu.org
     Ever confirmed|0                           |1

--- Comment #1 from Dominique d'Humieres <dominiq at lps dot ens.fr> ---
With dejagnu 1.5.1, the summary looks like

...
        === g++ tests ===


Running target unix/-m32
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/pch/pch.C  -O2 -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C -O2 assembly comparison
WARNING: program timed out.
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m32 ===

# of expected passes        88065
# of unexpected failures    8
# of expected failures        320
# of unsupported tests        3647

Running target unix/-m64
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/pch/pch.C  -O2 -g -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C  -g -I. -Dwith_PCH (internal compiler error)
FAIL: g++.dg/pch/pch.C  -g -I. -Dwith_PCH (test for excess errors)
FAIL: g++.dg/pch/pch.C  -g assembly comparison
FAIL: g++.dg/pch/pch.C -O2 -g assembly comparison
WARNING: program timed out.
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m64 ===

# of expected passes        89465
# of unexpected failures    11
# of expected failures        320
# of unsupported tests        3888

        === g++ Summary ===

# of expected passes        177530
# of unexpected failures    19
# of expected failures        640
# of unsupported tests        7535
/opt/gcc/build_w/gcc/testsuite/g++/../../xg++  version 5.0.0 20150207
(experimental) [trunk revision 220502p20] (GCC) 

...

as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg00877.html.

With dejagnu 1.5.2, it looks like

...
        === g++ tests ===


Running target unix/-m32
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m32 ===

# of expected passes        20311
# of expected failures        61
# of unsupported tests        62

Running target unix/-m64
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++11  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++14  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/debug/dwarf2/imported-decl-2.C  -std=gnu++98  scan-assembler-times
ascii "AAAA\\\\\\\\0".*ascii "BBBB\\\\\\\\0".*DIE .0x[0-9a-f]*.
DW_TAG_imported_declaration 1
FAIL: g++.dg/tm/pr47573.C  -std=gnu++11 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++14 (test for excess errors)
FAIL: g++.dg/tm/pr47573.C  -std=gnu++98 (test for excess errors)

        === g++ Summary for unix/-m64 ===

# of expected passes        20191
# of expected failures        61
# of unsupported tests        80

        === g++ Summary ===

# of expected passes        40502
# of expected failures        122
# of unsupported tests        142
/opt/gcc/build_w/gcc/testsuite/g++/../../xg++  version 5.0.0 20150207
(experimental) [trunk revision 220502p20] (GCC) 

...

as in https://gcc.gnu.org/ml/gcc-testresults/2015-02/msg01002.html.

AFAICT the *.log files contain the right information which are not processed
the same way by dejagnu 1.5.1 and 1.5.2 when using contrib/test_summary.