libstdc++ testsuite "misbehaving"

[Thomas Schwinge <thomas at codesourcery dot com>]

Hi!

Updating my GCC trunk working tree from r212389 (2014-07-09) to r214918
(2014-09-04), I notice that (only) in libstdc++ testing, and only for the
second multilib of ÂRUNTESTFLAGS='--target_board=unix\{,-m32\}'Â (so, the
32-bit x86 one), a lot of PASSes "disappear" (compile tests only?).  Has
anyone seen this before, and/or an explanation for this?

Here's a diff of the sum file that shows how the Âunix variant behaves
as expected, but for the Âunix/-m32Â one a lot of PASSes disappear, and
in the latter's summary the Â# of expected passes is basically cut into
half:

    [...]
     Native configuration is x86_64-unknown-linux-gnu
     
                    === libstdc++ tests ===
     
     Schedule of variations:
         unix
         unix/-m32
     
     Running target unix
    [...]
                    === libstdc++ Summary for unix ===
     
    -# of expected passes           9368
    -# of unexpected failures       1
    +# of expected passes           9552
     # of expected failures         69
    -# of unsupported tests         536
    +# of unsupported tests         535
     Running target unix/-m32
     Running /home/thomas/tmp/source/gcc/trunk/source/libstdc++-v3/testsuite/libstdc++-abi/abi.exp ...
    -FAIL: libstdc++-abi/abi_check
    +PASS: libstdc++-abi/abi_check
     Running /home/thomas/tmp/source/gcc/trunk/source/libstdc++-v3/testsuite/libstdc++-dg/conformance.exp ...
    -PASS: 17_intro/freestanding.cc (test for excess errors)
     PASS: 17_intro/freestanding.cc execution test
    -PASS: 17_intro/headers/c++1998/49745.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/all.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/all_c++200x_compatibility.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/all_no_exceptions.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/all_no_rtti.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/all_pedantic_errors.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/complex.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/operator_names.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/stdc++.cc (test for excess errors)
     PASS: 17_intro/headers/c++1998/stdc++_assert_neg.cc  (test for errors, line 34)
    -PASS: 17_intro/headers/c++1998/stdc++_assert_neg.cc (test for excess errors)
    -PASS: 17_intro/headers/c++1998/stdc++_multiple_inclusion.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/42319.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/all_no_exceptions.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/all_no_rtti.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/all_pedantic_errors.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/operator_names.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/stdc++.cc (test for excess errors)
    -PASS: 17_intro/headers/c++200x/stdc++_multiple_inclusion.cc (test for excess errors)
    -PASS: 17_intro/shared_with_static_deps.cc (test for excess errors)
    -PASS: 17_intro/static.cc (test for excess errors)
    -PASS: 17_intro/using_namespace_std.cc (test for excess errors)
     PASS: 17_intro/using_namespace_std_tr1_neg.cc  (test for errors, line 66)
     PASS: 17_intro/using_namespace_std_tr1_neg.cc  (test for errors, line 66)
    -PASS: 17_intro/using_namespace_std_tr1_neg.cc (test for excess errors)
    -PASS: 18_support/50594.cc (test for excess errors)
     PASS: 18_support/50594.cc execution test
    -PASS: 18_support/bad_alloc/cons_virtual_derivation.cc (test for excess errors)
     PASS: 18_support/bad_alloc/cons_virtual_derivation.cc execution test
    [...]
                    === libstdc++ Summary for unix/-m32 ===
     
    -# of expected passes           9376
    -# of unexpected failures       1
    -# of expected failures         69
    -# of unsupported tests         532
    +# of expected passes           4146
    +# of unexpected successes      1
    +# of expected failures         61
    +# of unsupported tests         531
     
                    === libstdc++ Summary ===
     
    -# of expected passes           18744
    -# of unexpected failures       2
    -# of expected failures         138
    -# of unsupported tests         1068
    +# of expected passes           13698
    +# of unexpected successes      1
    +# of expected failures         130
    +# of unsupported tests         1066


GrÃÃe,
 Thomas

Attachment: pgp0JoDCv_2Gb.pgp
Description: PGP signature