can dg testsuite lie?

[Robert Lipe <robertl at dgii dot com>]

I was working with John on a testsuite entry and started to doubt my sanity.
Now I'm doubting that of the testsuite.

In gcc/testsuite/gcc.dg, I added two tests:

$ cat rjl1.c rjl2.c
/* { dg-do run { target i?86-*-* } } */
main()
{
        abort();
}
/* { dg-do run { target i?86-*-* } } */
main()
{
        exit(1);
}

I ran the same command with the same testsuite and the same egcs on both
native OpenServer 5.0.4 and native RedHat 5.0.

$  runtest --tool=gcc  dg.exp=rjl*.c
Test Run By robertl on Thu Jun  4 16:40:34 1998
Native configuration is i586-pc-sco3.2v5.0.4

                === gcc tests ===

Running target unix
Using /usr/local/bin/../share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/local/bin/../share/dejagnu/config/unix.exp as generic interface file for target.
Using /home/play/egcs/gcc/testsuite/config/default.exp as tool-and-target-specific interface file.
Running /home/play/egcs/gcc/testsuite/gcc.dg/dg.exp ...
FAIL: gcc.dg/rjl1.c execution test
FAIL: gcc.dg/rjl2.c execution test

                === gcc Summary ===

# of expected passes            2
# of unexpected failures        2
/home/play/negcs/gcc/xgcc version egcs-2.91.34 19980603 (gcc2 ss-980502 experimental)

That looks believable.   They both failed.

$ runtest --tool=gcc  dg.exp=rjl*.c
WARNING: Couldn't find the global config file.
Test Run By robertl on Thu Jun  4 16:45:47 1998
Native configuration is i686-pc-linux-gnu

                === gcc tests ===

Running target unix
Using /usr/progressive/bin/../../share/dejagnu/baseboards/unix.exp as board description file for target.
Using /usr/progressive/bin/../../share/dejagnu/config/unix.exp as generic interface file for target.
Using /net/rjlhome/home/play/egcs/gcc/testsuite/config/default.exp as tool-and-target-specific interface file.
Running /net/rjlhome/home/play/egcs/gcc/testsuite/gcc.dg/dg.exp ...

                === gcc Summary ===

# of expected passes            4
/home/robertl/tmp/negcs/gcc/xgcc version egcs-2.91.34 19980603 (gcc2 ss-980502 experimental)


Huh???

If I look at runtest -v output, I see it is trying to run the binaries:

Testing gcc.dg/rjl1.c
dest in standard_file is rjlgemini
doing compile
output is
spawning command ./a.out
Shell closed.
Testing gcc.dg/rjl2.c
dest in standard_file is rjlgemini
doing compile
output is
spawning command ./a.out
Shell closed.



Any ideas what's going on?

Thanx,
RJL