[Bug testsuite/42933] New: Test suite reports excess unexpected failures when using RUNTESTFLAGS to pass extra options

[bgarvin at acm dot org]

While investigating configuration-dependent behavior in GCC, I ran the test
suite twice as shown below.  In the first case, RUNTESTFLAGS passes no extra
flags, and the summary shows 13 unexpected failures.  In the second case I send
a great many options and get 188 unexpected failures.  I am willing to provide
more details and to minimize the flags on the most recent release (rather than
r152840), but first somebody should check whether this is ``reason: invalid.'' 
In particular, are there restrictions on what flags should be passed with
RUNTESTFLAGS?  -std=c++0x, for instance, jumps out at me as maybe off-limits.

Thanks,
Brady


$ svn -r152840 co svn://gcc.gnu.org/svn/gcc/tags/gcc_4_4_2_release
# (output snipped)

$ mkdir 4_4_2_binary

$ cd 4_4_2_binary

$ ../gcc_4_4_2_release/configure
# (output snipped)

$ make
# (output snipped)

$ ./gcc/xgcc -v
Using built-in specs.
Target: x86_64-unknown-linux-gnu
Configured with: ../gcc_4_4_2_release/configure
Thread model: posix
gcc version 4.4.2 (GCC)

$ make check RUNTESTFLAGS="--target_board=unix"
# (output snipped)

$ make check
RUNTESTFLAGS="--target_board=unix/-fno-peephole2/-fno-crossjumping/-fno-expensive-optimizations/-fno-split-wide-types/-falign-loops/-fno-defer-pop/-fno-forward-propagate/-std=c++0x/-fno-regmove/-m32/-fno-reorder-functions/-fno-ipa-cp/-fno-ipa-reference/-fno-tree-dce/-fno-cse-follow-jumps/-fno-merge-constants/-ftree-sra/-fno-tree-dominator-opts/-fno-tree-builtin-call-dce/-fno-tree-ccp/-fno-align-functions/-fno-tree-dse/-fno-optimize-register-move/-fno-guess-branch-probability/-ftree-pre/-fno-tree-sink/-ftree-vrp/-finline-small-functions/-fno-ipa-pure-const/-fno-if-conversion2/-fno-reorder-blocks/-fno-align-labels/-fno-optimize-sibling-calls/-fno-omit-frame-pointer/-fno-strict-aliasing/-fno-gcse/-fno-caller-saves/-fno-tree-copy-prop/-fno-rerun-cse-after-loop/-fno-align-jumps/-fno-tree-ch/-fno-tree-copyrename/-fno-schedule-insns2/-fno-thread-jumps/-fno-if-conversion/-O2/-fno-tree-ter/-fno-tree-fre/-fno-cprop-registers/-fno-delete-null-pointer-checks"
# (output snipped)


-- 
           Summary: Test suite reports excess unexpected failures when using
                    RUNTESTFLAGS to pass extra options
           Product: gcc
           Version: 4.4.2
            Status: UNCONFIRMED
          Severity: normal
          Priority: P3
         Component: testsuite
        AssignedTo: unassigned at gcc dot gnu dot org
        ReportedBy: bgarvin at acm dot org
 GCC build triplet: x86_64-unknown-linux-gnu
  GCC host triplet: x86_64-unknown-linux-gnu
GCC target triplet: x86_64-unknown-linux-gnu


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=42933