[PATCH v2] [libstdc++] Run tests on RTEMS

[Sebastian Huber]

On 01/09/15 23:07, Jeff Law wrote:
> On 09/01/2015 05:02 AM, Sebastian Huber wrote:
>> v2: Include all options and not only "dg-do run ...".
>>
>> libstdc++-v3/ChangeLog
>> 2015-09-01  Sebastian Huber <sebastian.huber@embedded-brains.de>
>>
>>     testsuite/*: Use 's/\*-\*-cygwin\* /&*-*-rtems* /' to add RTEMS
>>     target selector to all tests that run on Cygwin.
> So presumably those tests actually run correctly :-)

Not all, but its not that bad:

Target is arm-unknown-rtems4.11
Host   is arm-unknown-rtems4.11
Build  is x86_64-pc-linux-gnu

                 === libstdc++ tests ===

Schedule of variations:
rtems-arm-realview_pbx_a9_qemu/-march=armv7-a/-mthumb/-mfpu=neon/-mfloat-abi=hard

Running target 
rtems-arm-realview_pbx_a9_qemu/-march=armv7-a/-mthumb/-mfpu=neon/-mfloat-abi=hard
Using 
/scratch/git-rtems-testing/dejagnu/boards/rtems-arm-realview_pbx_a9_qemu.exp 
as board description file for target.
Using /usr/share/dejagnu/config/sim.exp as generic interface file for 
target.
Using /usr/share/dejagnu/baseboards/basic-sim.exp as board description 
file for target.
Using 
/home/EB/sebastian_h/archive/gcc-git/libstdc++-v3/testsuite/config/default.exp 
as tool-and-target-specific interface file.
Running 
/home/EB/sebastian_h/archive/gcc-git/libstdc++-v3/testsuite/libstdc++-abi/abi.exp 
...
Running 
/home/EB/sebastian_h/archive/gcc-git/libstdc++-v3/testsuite/libstdc++-dg/conformance.exp 
...
FAIL: 25_algorithms/copy/streambuf_iterators/wchar_t/4.cc execution test
FAIL: 25_algorithms/find/istreambuf_iterators/wchar_t/2.cc execution test
FAIL: 25_algorithms/random_shuffle/moveable.cc execution test
FAIL: 27_io/basic_istream/extractors_other/wchar_t/2.cc execution test
FAIL: 27_io/basic_istream/get/wchar_t/2.cc execution test
FAIL: 27_io/basic_istream/ignore/wchar_t/3.cc execution test
FAIL: 27_io/basic_istream/seekg/wchar_t/sstream.cc execution test
FAIL: 27_io/basic_istream/tellg/wchar_t/sstream.cc execution test
FAIL: 27_io/basic_ostream/inserters_other/wchar_t/1.cc execution test
FAIL: 27_io/basic_stringbuf/setbuf/char/4.cc execution test
FAIL: 27_io/objects/wchar_t/12048-1.cc execution test
FAIL: 27_io/objects/wchar_t/12048-2.cc execution test
FAIL: 27_io/objects/wchar_t/12048-3.cc execution test
FAIL: 27_io/objects/wchar_t/12048-4.cc execution test
WARNING: program timed out.
FAIL: 30_threads/async/42819.cc execution test
WARNING: program timed out.
FAIL: 30_threads/async/49668.cc execution test
WARNING: program timed out.
FAIL: 30_threads/async/any.cc execution test
WARNING: program timed out.
FAIL: 30_threads/async/async.cc execution test
WARNING: program timed out.
FAIL: 30_threads/condition_variable/members/3.cc execution test
FAIL: 30_threads/shared_timed_mutex/try_lock/3.cc execution test
WARNING: program timed out.
FAIL: 30_threads/thread/native_handle/cancel.cc execution test
FAIL: 30_threads/timed_mutex/try_lock_until/57641.cc execution test
FAIL: tr1/8_c_compatibility/complex/50880.cc (test for excess errors)
WARNING: tr1/8_c_compatibility/complex/50880.cc compilation failed to 
produce executable
FAIL: tr1/8_c_compatibility/complex/functions.cc (test for excess errors)
Running 
/home/EB/sebastian_h/archive/gcc-git/libstdc++-v3/testsuite/libstdc++-prettyprinters/prettyprinters.exp 
...
Running 
/home/EB/sebastian_h/archive/gcc-git/libstdc++-v3/testsuite/libstdc++-xmethods/xmethods.exp 
...

                 === libstdc++ Summary ===

# of expected passes            9029
# of unexpected failures        24
# of expected failures          65
# of unsupported tests          726

One issue is a thread cancel/exit misbehaviour/deviation from glibc in 
RTEMS. Another issue is that the files under libstdc++-v3/testsuite/data 
are currently not available in our test driver which uses Qemu.

>
> I don't think the ChangeLog is strictly OK according to standards. 
> Every file changed is supposed to be listed.  I know it's a pain, but 
> until we change those requirements it's probably best to stick with 
> current standards.
>
> GIven a context diff or a unidiff, contrib/mklog can generate a 
> skeleton ChangeLog entry for all the referenced files.
>
> I think
>
>     * firstfile: What changed.
>     * secondfile: Likewise.
>     * thirdfile: Likewise.
>
> Is fine.
>
> OK with the fixed ChangeLog.
>
> jeff

My first ChangeLog look like this, but then I found this:

2014-05-23  Jonathan Wakely  <jwakely@redhat.com>

     PR libstdc++/60793
     * testsuite/*: Use 's/\*-\*-freebsd\* /&*-*-dragonfly* /' to add
     dragonfly target selector to all tests that run on freebsd.

I will fix the ChangeLog.

-- 
Sebastian Huber, embedded brains GmbH

Address : Dornierstr. 4, D-82178 Puchheim, Germany
Phone   : +49 89 189 47 41-16
Fax     : +49 89 189 47 41-09
E-Mail  : sebastian.huber@embedded-brains.de
PGP     : Public key available on request.

Diese Nachricht ist keine geschäftliche Mitteilung im Sinne des EHUG.