[Bug testsuite/38821] New: [4.4 Regression] Testsuite for libjava is truncated

[rob1weld at aol dot com]

I built gcc version 4.4.0 20090104 (experimental) (GCC) and configured with:

../gcc_trunk/configure --enable-languages=ada,c,c++,fortran,java,objc,obj-c++
--enable-shared --disable-static --enable-decimal-float --with-long-double-128
--enable-nls --with-included-gettext --enable-gather-detailed-mem-stats
--with-stabs --enable-debug -enable-largefile --enable-symvers
--without-system-zlib --enable-gtk-cairo --enable-qt-peer --enable-xmlj
--enable-gconf-peer --enable-gjdoc --enable-java-awt=gtk,xlib,qt,x
--enable-gc-debug --enable-libgcj-debug --enable-objc-gc
--enable-libstdcxx-debug --disable-stage1-checking --enable-checking=release
--without-system-libunwind --with-gnu-as --with-as=/usr/local/bin/as
--with-gnu-ld --with-ld=/usr/local/bin/ld


I ran "make -i check" and got this sort of result for libjava:

Using /usr/share/src/gcc_trunk/libjava/testsuite/config/default.exp as
tool-and-target-specific interface file.
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.cni/cni.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.jar/jar.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.jni/jni.exp ...
Running
/usr/share/src/gcc_trunk/libjava/testsuite/libjava.jvmti/jvmti-interp.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.jvmti/jvmti.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.lang/lang.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.loader/loader.exp
...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.mauve/mauve.exp ...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.special/special.exp
...
Running /usr/share/src/gcc_trunk/libjava/testsuite/libjava.verify/verify.exp
...

                === libjava Summary ===

# of expected passes        2468
# of unexpected failures    55
# of untested testcases     55

----------

I built gcc version 4.2.3 (release) and configured with:

../gcc_4.2.3/configure --prefix=/usr/gnu --libdir=/usr/gnu/lib
--libexecdir=/usr/gnu/lib --mandir=/usr/gnu/share/man --infodir=/usr/share/info
--with-as=/usr/gnu/bin/as --with-gnu-as --with-ld=/usr/ccs/bin/ld
--without-gnu-ld --enable-languages=ada,c,c++,fortran,java,objc,obj-c++
--enable-multilib --enable-shared --disable-static --enable-decimal-float
-disable-nls

I ran "make -i check" and got this sort of result for libjava:

Using /usr/share/src/gcc_4.2.3/libjava/testsuite/config/default.exp as
tool-and-target-specific interface file.
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.cni/cni.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.compile/compile.exp
...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.jacks/jacks.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.jar/jar.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.jni/jni.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.jvmti/jvmti.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.lang/lang.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.loader/loader.exp
...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.mauve/mauve.exp ...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.special/special.exp
...
Running /usr/share/src/gcc_4.2.3/libjava/testsuite/libjava.verify/verify.exp
...

                === libjava Summary ===

# of expected passes            6978
# of unexpected failures        13
# of expected failures          12
# of untested testcases         18

----------

When you compare gcc version 4.4.0 20090104 with gcc version 4.2.3 (release)
you notice that the trunk adds test
"libjava/testsuite/libjava.jvmti/jvmti-interp.exp"
and is missing both tests "libjava/testsuite/libjava.compile/compile.exp"
and "libjava/testsuite/libjava.jacks/jacks.exp". 


The 4.2.3 version passed 6978 tests (with a couple of dozen 'not-pass'
results).
The Trunk version passed 2468 tests (with four dozen 'not-pass' results).

The Trunk was compiled with a few more complicated java configuration yet
there were fewer tests for the Trunk compared with the 4.2.x series.


I have looked at some results from / to:
http://gcc.gnu.org/ml/gcc-testresults/2008-03/
http://gcc.gnu.org/ml/gcc-testresults/2009-01/

and it seems that 4.4 is with far fewer tests than prior versions.


Thanks,
Rob


-- 
           Summary: [4.4 Regression] Testsuite for libjava is truncated
           Product: gcc
           Version: 4.4.0
            Status: UNCONFIRMED
          Severity: major
          Priority: P3
         Component: testsuite
        AssignedTo: unassigned at gcc dot gnu dot org
        ReportedBy: rob1weld at aol dot com


http://gcc.gnu.org/bugzilla/show_bug.cgi?id=38821