Re: Testsuites and Test Results

[Ranjit Mathew <rmathew at hotmail dot com>]

> Ranjit> 3. For some weird reason that is not immediately
> Ranjit>    obvious to me by looking at the testsuite/Makefile,
> Ranjit>    my DejaGNU "runtest" is not picked up by make.
> Ranjit>    "runtest" is in "/usr/local/bin" and it definitely
> Ranjit>    is in my PATH.
> 
> I haven't had this problem.  I usually run make check from the
> libjava build directory though.

After digging around a bit, I finally found out that for
some reason, my runtest from DejaGNU does not accept
"runtest TCLVAR=VALUE" style invocations and that's what's
causing these problems!

FYI, I have DejaGNU 1.4.2, expect 5.34.1 and Tcl 8.3.

The testsuite Makefile ultimately sets RUNTEST to 
"runtest INTERPRETER=yes" and since this command fails,
the Makefile reports that runtest was not found.

So the fix was to remove "INTERPRETER=yes" from the
command line and move it to the generated "site.exp"
as a "set INTERPRETER yes" and sure enough, everything
ran fine after this. 


> Ranjit> 4. Even after this, only about 85 tests are actually
> Ranjit>    run (all PASS-es).
> 
> Which ones appear to be missing?

After the fix, all the libjava tests run for me with
the following results (3.3 for i686-pc-linux-gnu):

		=== libjava Summary ===

# of expected passes		2987
# of unexpected failures	2
# of expected failures		16
# of untested testcases		14
...
FAIL: SyncTest execution - gij test
FAIL: SyncTest execution - gij test
...
UNTESTED: Where execution from source compiled test
UNTESTED: Where output from source compiled test
UNTESTED: Where -O execution from source compiled test
UNTESTED: Where -O output from source compiled test
UNTESTED: inner_1 execution from source compiled test
UNTESTED: inner_1 output from source compiled test
UNTESTED: inner_1 -O execution from source compiled test
UNTESTED: inner_1 -O output from source compiled test
UNTESTED: SyncTest output - gij test
UNTESTED: SyncTest output - gij test
UNTESTED: pr8823 execution from bytecode->native test
UNTESTED: pr8823 output from bytecode->native test
UNTESTED: pr8823 -O execution from bytecode->native test
UNTESTED: pr8823 -O output from bytecode->native test

Ranjit.

-- 
Ranjit Mathew        Email: rmathew AT hotmail DOT com
Bangalore,           
INDIA.               Web: http://ranjitmathew.tripod.com/