This is the mail archive of the
libstdc++@sources.redhat.com
mailing list for the libstdc++ project.
Re: interpreting testsuite results?
- To: libstdc++ at sources dot redhat dot com
- Subject: Re: interpreting testsuite results?
- From: Benjamin Kosnik <bkoz at redhat dot com>
- Date: Wed, 11 Oct 2000 10:50:00 -0700
Here are results for me, from this morning. These are pretty good.
There are two unexpected failures, three expected failures, and two
--gc-sections related failures.
-benjamin
host: Linux 2.2.16-22 #1 Tue Aug 22 16:49:06 EDT 2000 i686
compiler: gcc version 2.97 20001008 (experimental)
compiler flags: -g -B../../gcc/ -DDEBUG_ASSERT -ffunction-sections -fdata-sections -Wl,--gc-sections
date: 20001011
pass/fail results: 168/14
p == pass/fail execution test
ctime == time to compile and link
etime == time for executable to run
text == size of the executable text section
data == size of the executable data section
total == size of the executable
(First static, then shared.)
p ctime etime text data total name
+ 1 0.001 267257 34372 1337211 17_intro/header_ciso646.cc
+ 0 0.010 697 286 12810 17_intro/header_ciso646.cc
+ 3 0.001 266570 34108 1516674 17_intro/header_fstream.cc
+ 2 0.009 298 72 196536 17_intro/header_fstream.cc
+ 2 0.001 266570 34108 1473063 17_intro/header_iomanip.cc
+ 1 0.009 298 60 151801 17_intro/header_iomanip.cc
+ 1 0.001 266570 34108 1436183 17_intro/header_ios.cc
+ 1 0.009 298 60 115648 17_intro/header_ios.cc
+ 0 0.001 266570 34108 1338486 17_intro/header_iosfwd.cc
+ 0 0.009 298 8 15783 17_intro/header_iosfwd.cc
+ 3 0.002 544397 43980 4731909 17_intro/header_iostream.cc
+ 2 0.009 444 60 150347 17_intro/header_iostream.cc
+ 2 0.001 266570 34108 1470615 17_intro/header_istream.cc
+ 1 0.009 298 60 149353 17_intro/header_istream.cc
+ 1 0.001 266570 34108 1437004 17_intro/header_ostream.cc
+ 2 0.010 298 60 115742 17_intro/header_ostream.cc
+ 6 0.002 544637 43973 4814842 17_intro/headers.cc
+ 4 0.019 797 76 234825 17_intro/headers.cc
+ 1 0.001 266570 34108 1470713 17_intro/header_sstream.cc
+ 2 0.009 298 60 149451 17_intro/header_sstream.cc
+ 2 0.001 266570 34108 1435996 17_intro/header_streambuf.cc
+ 2 0.010 298 60 115461 17_intro/header_streambuf.cc
+ 1 0.001 291791 34774 1472359 18_support/numeric_limits.cc
+ 0 0.008 1277 285 50950 18_support/numeric_limits.cc
+ 1 0.001 299327 35363 1491862 20_util/auto_ptr.cc
+ 0 0.010 8263 865 68330 20_util/auto_ptr.cc
+ 3 0.002 321711 35996 2043741 21_strings/append.cc
+ 3 0.011 21015 1140 296052 21_strings/append.cc
+ 4 0.001 321487 35286 1853506 21_strings/capacity.cc
+ 4 0.009 27811 688 356838 21_strings/capacity.cc
+ 2 0.001 303855 35234 1699816 21_strings/char_traits.cc
+ 2 0.009 10067 624 190918 21_strings/char_traits.cc
+ 2 0.001 303359 34912 1678634 21_strings/compare.cc
+ 2 0.009 9395 300 165707 21_strings/compare.cc
+ 3 0.002 309647 35139 1754730 21_strings/ctor_copy_dtor.cc
+ 2 0.011 16215 524 263702 21_strings/ctor_copy_dtor.cc
+ 2 0.002 300111 35062 1668635 21_strings/element_access.cc
+ 2 0.011 6519 444 154907 21_strings/element_access.cc
+ 2 0.001 322415 35260 1949570 21_strings/find.cc
+ 2 0.009 9907 396 160061 21_strings/find.cc
+ 3 0.002 312127 35925 1762109 21_strings/insert.cc
+ 3 0.011 18567 1320 272060 21_strings/insert.cc
+ 6 0.029 551373 45765 4898884 21_strings/inserters_extractors.cc
+ 5 0.032 25021 1928 371255 21_strings/inserters_extractors.cc
+ 3 0.001 307999 35460 1708271 21_strings/invariants.cc
+ 2 0.009 14291 864 201095 21_strings/invariants.cc
+ 2 0.001 315295 36853 1734287 21_strings/nonmember.cc
+ 3 0.009 21475 2256 234018 21_strings/nonmember.cc
+ 2 0.001 300943 34780 1671057 21_strings/operations.cc
+ 2 0.009 7523 232 160275 21_strings/operations.cc
+ 3 0.001 311471 34966 1768491 21_strings/replace.cc
+ 2 0.009 17667 348 266918 21_strings/replace.cc
+ 1 0.001 300015 34930 1666348 21_strings/rfind.cc
+ 1 0.009 6323 308 152487 21_strings/rfind.cc
+ 3 0.002 303807 34934 1708317 21_strings/substr.cc
+ 2 0.014 10311 340 206872 21_strings/substr.cc
+ 4 0.002 545296 44261 4806568 22_locale/codecvt_char_char.cc
+ 3 0.009 2573 400 230727 22_locale/codecvt_char_char.cc
- 5 0.000 549440 44709 4846549 22_locale/codecvt_unicode_char.cc
- 3 0.000 9779 860 278025 22_locale/codecvt_unicode_char.cc
(function-sections related)
- 5 0.000 549760 44645 4848326 22_locale/codecvt_unicode_wchar_t.cc
- 4 0.000 9971 796 278671 22_locale/codecvt_unicode_wchar_t.cc
(function-sections related)
+ 4 0.002 545696 44549 4809548 22_locale/codecvt_wchar_t_char.cc
+ 3 0.009 2893 700 232876 22_locale/codecvt_wchar_t_char.cc
- 5 0.000 550960 45125 4847224 22_locale/ctor_copy_dtor.cc
- 4 0.000 12867 1284 288585 22_locale/ctor_copy_dtor.cc
(expected fail, named locale related)
+ 4 0.002 545376 44069 4786787 22_locale/ctype.cc
+ 3 0.009 1565 184 207254 22_locale/ctype.cc
+ 4 0.002 545888 45221 4784643 22_locale/ctype_char_members.cc
+ 3 0.009 2246 1372 206519 22_locale/ctype_char_members.cc
+ 4 0.002 546144 45541 4787484 22_locale/ctype_wchar_t_members.cc
+ 3 0.217 2390 1696 208470 22_locale/ctype_wchar_t_members.cc
+ 6 0.002 552701 45989 4967718 22_locale/facet.cc
+ 6 0.010 38207 2181 462845 22_locale/facet.cc
+ 4 0.002 545712 44165 4824397 22_locale/global_templates.cc
+ 3 0.010 6547 304 261743 22_locale/global_templates.cc
+ 5 0.002 545392 44133 4827212 22_locale/operators.cc
+ 3 0.010 7782 288 268183 22_locale/operators.cc
+ 4 0.002 545760 44197 4804119 22_locale/static_members.cc
+ 3 0.009 7478 348 242752 22_locale/static_members.cc
+ 4 0.004 550749 44389 4835562 23_containers/bitset_ctor.cc
+ 3 0.011 15383 520 283264 23_containers/bitset_ctor.cc
+ 5 0.287 566029 44773 4864075 23_containers/bitset_shift.cc
+ 3 0.289 26391 908 298552 23_containers/bitset_shift.cc
- 2 0.289 0 0 0 23_containers/map_operators.cc
- 2 0.289 0 0 0 23_containers/map_operators.cc
(expected fail, negative test)
+ 4 0.000 552333 43980 4828343 23_containers/multiset.cc
+ 3 0.000 9018 68 249981 23_containers/multiset.cc
- 2 0.000 0 0 0 23_containers/set_operators.cc
- 1 0.000 0 0 0 23_containers/set_operators.cc
(expected fail, negative test)
+ 2 0.001 300463 34646 1553268 23_containers/vector_capacity.cc
+ 1 0.009 9987 160 134072 23_containers/vector_capacity.cc
+ 4 0.003 578830 44076 4893300 23_containers/vector_ctor.cc
+ 4 0.009 35427 136 312994 23_containers/vector_ctor.cc
+ 2 0.004 546590 44172 4676010 23_containers/vector_element_access.cc
+ 1 0.010 3239 220 96298 23_containers/vector_element_access.cc
+ 2 0.001 309983 34614 1654803 23_containers/vector_modifiers.cc
+ 3 0.009 19379 136 234466 23_containers/vector_modifiers.cc
+ 3 0.002 548317 44933 4809844 24_iterators/istreambuf_iterator.cc
+ 2 0.010 13725 1088 257120 24_iterators/istreambuf_iterator.cc
+ 6 0.001 327551 34815 1948357 24_iterators/iterator.cc
+ 4 0.012 33875 212 445681 24_iterators/iterator.cc
+ 1 0.001 268469 34024 1389285 25_algorithms/lower_bound.cc
+ 1 0.009 2181 136 65785 25_algorithms/lower_bound.cc
+ 1 0.001 267381 34230 1369837 25_algorithms/min_max.cc
+ 0 0.010 821 160 46240 25_algorithms/min_max.cc
+ 4 0.000 548797 43980 4861180 26_numerics/binary_closure.cc
+ 3 0.000 4937 68 281447 26_numerics/binary_closure.cc
+ 1 0.001 266963 34108 1342207 26_numerics/buggy_complex.cc
+ 0 0.009 691 8 19733 26_numerics/buggy_complex.cc
+ 1 0.001 274205 36181 1371079 26_numerics/c_math.cc
+ 0 0.021 605 129 22983 26_numerics/c_math.cc
+ 5 0.003 557277 45605 4990387 26_numerics/complex_inserters_extractors.cc
+ 3 0.028 16909 1608 261065 26_numerics/complex_inserters_extractors.cc
+ 3 0.001 292719 34492 1533117 26_numerics/valarray.cc
+ 1 0.009 1929 16 111166 26_numerics/valarray.cc
+ 5 0.003 554927 45765 4861827 27_io/filebuf.cc
+ 3 0.010 19085 1936 306889 27_io/filebuf.cc
+ 4 0.002 544975 44581 4810849 27_io/filebuf_members.cc
+ 4 0.009 6781 736 249366 27_io/filebuf_members.cc
+ 1 0.001 268946 34386 1443983 27_io/fpos.cc
+ 2 0.009 2386 364 122153 27_io/fpos.cc
+ 5 0.098 545199 44613 4809464 27_io/ifstream_members.cc
+ 3 0.130 7149 772 247616 27_io/ifstream_members.cc
- 4 0.006 545453 44453 4793820 27_io/ios_base_callbacks.cc
- 2 0.014 10941 580 241179 27_io/ios_base_callbacks.cc
(unexpected fail)
+ 4 0.003 545181 44389 4787950 27_io/ios_base_members_static.cc
+ 2 0.009 8515 540 229819 27_io/ios_base_members_static.cc
+ 3 0.002 546429 44933 4791044 27_io/ios_ctor.cc
+ 2 0.010 10445 1060 235359 27_io/ios_ctor.cc
+ 5 777.000 548141 44677 4885177 27_io/ios_manip_basefield.cc
+ 4 777.000 18429 816 348253 27_io/ios_manip_basefield.cc
- 6 0.000 548973 44677 4889252 27_io/ios_manip_fmtflags.cc
- 4 0.000 19949 804 354283 27_io/ios_manip_fmtflags.cc
(unexpected fail)
+ 3 0.004 546077 44613 4740971 27_io/ios_members.cc
+ 2 0.011 6861 724 176801 27_io/ios_members.cc
+ 2 0.001 266570 34108 1470418 27_io/istream.cc
+ 1 0.009 298 60 149156 27_io/istream.cc
+ 6 0.003 560605 46597 4903426 27_io/istream_extractor_arith.cc
+ 5 1.000 31325 2744 366598 27_io/istream_extractor_arith.cc
+ 4 0.003 550461 45509 4807019 27_io/istream_extractor_char.cc
+ 3 0.019 15901 1624 254335 27_io/istream_extractor_char.cc
+ 5 0.003 550063 45189 4874849 27_io/istream_extractor_other.cc
+ 4 0.010 18255 1312 331783 27_io/istream_extractor_other.cc
+ 4 0.003 546333 44709 4799802 27_io/istream_manip.cc
+ 2 0.009 11437 864 246684 27_io/istream_manip.cc
+ 6 0.003 553629 44997 4883232 27_io/istream_seeks.cc
+ 4 0.010 23005 1156 342552 27_io/istream_seeks.cc
+ 4 0.002 545341 44517 4794191 27_io/istream_sentry.cc
+ 2 0.009 9469 648 237979 27_io/istream_sentry.cc
+ 6 0.029 557885 47749 4899797 27_io/istream_unformatted.cc
+ 5 0.040 27437 3864 360262 27_io/istream_unformatted.cc
+ 4 0.002 545437 44613 4816594 27_io/istringstream_members.cc
+ 3 0.009 13133 768 270693 27_io/istringstream_members.cc
+ 6 0.000 544941 44197 4840566 27_io/narrow_stream_objects.cc
+ 5 0.000 1293 360 262916 27_io/narrow_stream_objects.cc
+ 4 0.111 545231 44613 4808405 27_io/ofstream_members.cc
+ 3 0.155 7149 772 246525 27_io/ofstream_members.cc
+ 2 0.001 266570 34108 1436807 27_io/ostream.cc
+ 1 0.009 298 60 115545 27_io/ostream.cc
+ 7 0.010 558013 46661 4969012 27_io/ostream_inserter_arith.cc
+ 6 0.033 40573 2792 464644 27_io/ostream_inserter_arith.cc
+ 5 0.042 552989 45669 4890354 27_io/ostream_inserter_char.cc
+ 5 0.058 24989 1808 357156 27_io/ostream_inserter_char.cc
+ 5 0.009 547085 45157 4860941 27_io/ostream_inserter_other.cc
+ 4 0.019 14141 1288 314931 27_io/ostream_inserter_other.cc
+ 4 0.002 547773 44773 4819183 27_io/ostream_manip.cc
+ 3 0.009 15837 912 273980 27_io/ostream_manip.cc
+ 5 0.002 545469 44645 4853349 27_io/ostream_seeks.cc
+ 4 0.009 12829 808 306100 27_io/ostream_seeks.cc
+ 4 0.002 545181 44549 4793345 27_io/ostream_unformatted.cc
+ 2 0.009 9235 700 237336 27_io/ostream_unformatted.cc
+ 4 0.004 550013 45733 4772797 27_io/streambuf.cc
+ 3 0.010 15213 1848 220424 27_io/streambuf.cc
+ 4 0.003 559248 45733 4830166 27_io/stringbuf.cc
+ 3 0.011 27133 1856 283176 27_io/stringbuf.cc
+ 5 0.003 548573 45125 4833398 27_io/stringstream.cc
+ 3 0.017 17878 1264 291989 27_io/stringstream.cc
+ 6 0.000 544941 44421 4841093 27_io/wide_stream_objects.cc
+ 4 0.000 1293 560 263425 27_io/wide_stream_objects.cc
+ 4 0.002 544397 43980 4811067 ext/headers.cc
+ 3 0.009 444 192 229615 ext/headers.cc
testrun == 581