Re: [Consult] tile: How to construct testsuite for tile architecture without hardware.

[john dot frankish at laposte dot net]

----- Mail original ----- 
De: "Chen Gang" <xili_gchen_5257@hotmail.com> 
Ã: "Chris Metcalf" <cmetcalf@ezchip.com>, walt@tilera.com 
Cc: "Jeff Law" <law@redhat.com>, "gcc-help" <gcc-help@gcc.gnu.org>, "Mike Stump" <mikestump@comcast.net>, "Michael Eager" <eager@eagerm.com>, "Richard Henderson" <rth@redhat.com>, "Peter Maydell" <peter.maydell@linaro.org>, "Andreas FÃrber" <afaerber@suse.de>, rth@twiddle.net 
EnvoyÃ: Dimanche 18 Octobre 2015 09:23:45 
Objet: Re: [Consult] tile: How to construct testsuite for tile architecture without hardware. 

Hello all: 

After fix one qemu issue about floating point insns, correct the related 
environments (make some symbol links), and reconfig building options (so 
support g++), the current gcc testsuite result are: 

=== gcc Summary === 

# of expected passes 78156 
# of unexpected failures 98 
# of unexpected successes 1 
# of expected failures 120 
# of unresolved testcases 1 
# of unsupported tests 1384 

=== g++ Summary === 

# of expected passes 83999 
# of unexpected failures 78 
# of unexpected successes 2 
# of expected failures 277 
# of unsupported tests 3568 

[root@localhost build-gcc-tile]# gcc/xgcc -v 
Using built-in specs. 
COLLECT_GCC=gcc/xgcc 
Target: tilegx-gchen-linux 
Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c,c++ --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib --disable-libquadmath --disable-libgomp --disable-libatomic 
Thread model: posix 
gcc version 6.0.0 20151012 (experimental) (GCC) 
[root@localhost build-gcc-tile]# gcc/xg++ -v 
Using built-in specs. 
COLLECT_GCC=gcc/xg++ 
Target: tilegx-gchen-linux 
Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c,c++ --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib --disable-libquadmath --disable-libgomp --disable-libatomic 
Thread model: posix 
gcc version 6.0.0 20151012 (experimental) (GCC) 



Welcome any ideas, suggestions, and completions. 

Thanks. 


On 10/17/15 14:39, Chen Gang wrote: 
> 
> After rebuild gcc/binutils with the latest code and correct the building 
> config parameters, the gcc testsuite result is: 
> 
> === gcc Summary === 
> 
> # of expected passes 77855 
> # of unexpected failures 162 
> # of unexpected successes 1 
> # of expected failures 120 
> # of unresolved testcases 131 
> # of unsupported tests 1477 
> 
> root@localhost tile]# /upstream/release-tile/bin/tilegx-gchen-linux-gcc -v 
> Using built-in specs. 
> COLLECT_GCC=/upstream/release-tile/bin/tilegx-gchen-linux-gcc 
> COLLECT_LTO_WRAPPER=/upstream/release-tile/libexec/gcc/tilegx-gchen-linux/6.0.0/lto-wrapper 
> Target: tilegx-gchen-linux 
> Configured with: ../gcc/configure --target=tilegx-gchen-linux --disable-nls --enable-languages=c --enable-threads --enable-shared --enable-libssp --prefix=/upstream/release-tile --with-headers=/upstream/release-tile/include --with-sysroot=/upstream/release-tile --disable-multilib 
> Thread model: posix 
> gcc version 6.0.0 20151012 (experimental) (GCC) 
> 
> Welcome any members' ideas, suggestions, and completions. 
> 
> 
> Thanks. 
> 
> 
> On 10/5/15 19:59, Chen Gang wrote: 
>> After fix the tillegx qemu's fsingle floating point insns issue, the gcc test suite result is: 
>> 
>> === gcc Summary === 
>> 
>> # of expected passes 77272 
>> # of unexpected failures 365 
>> # of unexpected successes 7 
>> # of expected failures 113 
>> # of unresolved testcases 141 
>> # of unsupported tests 1476 
>> 
>> And I shall continue to analyze the left issues, next. :-) 
>> 
>> 
>> Thanks. 
>> -- 
>> Chen Gang 
>> 
>> Open, share, and attitude like air, water, and life which God blessed 
>> 
>> 
>> ---------------------------------------- 
>>> From: xili_gchen_5257@hotmail.com 
>>> To: cmetcalf@ezchip.com; walt@tilera.com 
>>> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net 
>>> Subject: RE: [Consult] tile: How to construct testsuite for tile architecture without hardware. 
>>> Date: Sun, 4 Oct 2015 19:55:44 +0800 
>>> 
>>> After finish additional 7 qemu patches, our tilegx qemu can test the gcc 
>>> testsuite successfully (no any unimplementation issues). The test result 
>>> is: 
>>> 
>>> === gcc Summary === 
>>> 
>>> # of expected passes 77012 
>>> # of unexpected failures 622 
>>> # of unexpected successes 7 
>>> # of expected failures 113 
>>> # of unresolved testcases 143 
>>> # of unsupported tests 1476 
>>> 
>>> 
>>> For the 622 left issues: 
>>> 
>>> - Maybe still tilegx implementation issue, e.g. 
>>> 
>>> the floating point single mul instruction cann't get the result which 
>>> tilegx gcc expected (it is only related with calculating: float32_mul 
>>> calculation result is not match tilegx gcc expected). 
>>> 
>>> - Maybe envorintments configuration issues, e.g. 
>>> 
>>> for gcc guality_check, it may call gdb outside, so I need config the 
>>> related gdb correctlly. 
>>> 
>>> - Maybe tilegx gcc issues, e.g. 
>>> 
>>> for some UNKNOWN instructions, probably generated by incorrect jump 
>>> instructions, one sample is "-fpic -mcmodel=large" for gcc nested-5 
>>> test. 
>>> 
>>> Next, I shall: 
>>> 
>>> - continue to fix the left 622 issues, and send related patches to 
>>> qemu-devel mailing list or gcc-patches mailing list. 
>>> 
>>> - then rewrite floating point instructions, and try to let the related 
>>> code merged into qemu mainline with qemu members' help (at present, 
>>> floating point implementation is a temporary implementation). 
>>> 
>>> - at last, try to finish all left unimplemented instructions (there are 
>>> still some unimplement insns left, but at present, gcc testsuite does 
>>> not use them), and start tilegx qemu system mode, next. 
>>> 
>>> 
>>> Welcome any members' ideas, suggestion, and completions. :-) 
>>> 
>>> 
>>> Thanks. 
>>> 
>>> Chen Gang 
>>> 
>>> Open, share, and attitude like air, water, and life which God blessed 
>>> 
>>> 
>>> ---------------------------------------- 
>>>> Date: Thu, 1 Oct 2015 12:12:48 +0800 
>>>> From: xili_gchen_5257@hotmail.com 
>>>> To: cmetcalf@ezchip.com; walt@tilera.com 
>>>> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net 
>>>> Subject: Re: [Consult] tile: How to construct testsuite for tile architecture without hardware. 
>>>> 
>>>> 
>>>> At present, tilegx is integrated into qemu master branch successfully 
>>>> with the much help by qemu members. 
>>>> 
>>>> But sorry, I did not finish gcc testsuite in time, the main excuse is 
>>>> 
>>>> - I am busy on the normal work -- sometimes, have to do overtime work. 
>>>> (my company started up an urgent project, but couldn't find suitable 
>>>> persons for it in short time, so I have to do it during these days). 
>>>> 
>>>> Next, in Chinese National Day, I have enough free time resources on open 
>>>> source, hope I finish our gcc testsuite within Chinese National Day (it 
>>>> is from 2015-10-01 -- 2015-10-07). 
>>>> 
>>>> Thanks. 
>>>> 
>>>> On 8/30/15 11:50, Chen Gang wrote: 
>>>>> 
>>>>> Oh, sorry again, I did not finish qemu test within this month, again. 
>>>>> Current status is: 
>>>>> 
>>>>> === gcc Summary === 
>>>>> 
>>>>> # of expected passes 76725 
>>>>> # of unexpected failures 790 
>>>>> # of unexpected successes 7 
>>>>> # of expected failures 113 
>>>>> # of unresolved testcases 142 
>>>>> # of unsupported tests 1483 
>>>>> 
>>>>> 
>>>>> My main excuses are: 
>>>>> 
>>>>> - We are lack of tilegx floating point insns related documents, we have 
>>>>> to 'guess' implementation details. At last, we found ways to process 
>>>>> it (we spent more than a half month free time resources for it). 
>>>>> 
>>>>> - My related qemu code need be refactor before merging into qemu master 
>>>>> tree. At present, we are refactoring and merging tilegx code to qemu 
>>>>> master tree (mainly by qemu related members). 
>>>>> 
>>>>> Hope I can finish qemu tilegx gcc testsuite within next month (I guess, 
>>>>> it should be done in time). 
>>>>> 
>>>>> - Test the refactored and merged code again, based on it, I continue to 
>>>>> fix gcc testsuite related issues. 
>>>>> 
>>>>> - Fix all 700+ gcc testsuite issues (10+ for pending issues, and the 
>>>>> others are for UN-implementation insns issues, I guess). 
>>>>> 
>>>>> 
>>>>> Thanks. 
>>>>> 
>>>>> 
>>>>> On 7/30/15 05:01, Chen Gang wrote: 
>>>>>> On 7/20/15 06:26, Chen Gang wrote: 
>>>>>>> Hello all: 
>>>>>>> 
>>>>>>> At present (after a half year), with the much help of QEMU members, 
>>>>>>> tilegx linux-user can work (manually using busybox's sh, ls, cp, mv, vi 
>>>>>>> are OK). 
>>>>>>> 
>>>>>>> Next, I shall start gcc testsuite with qemu tilegx linux-user, hope I 
>>>>>>> can finish within this month (2015-07-31). 
>>>>>>> 
>>>>>> 
>>>>>> Sorry, I can not finish the qemu test within this month. The reason is 
>>>>>> my tilegx qemu is still lack of some instructions implementation, next, 
>>>>>> I should finish them firstly (I implemented most insns, but not all). 
>>>>>> 
>>>>>> === gcc Summary === 
>>>>>> 
>>>>>> # of expected passes 69830 
>>>>>> # of unexpected failures 4312 
>>>>>> # of unexpected successes 2 
>>>>>> # of expected failures 108 
>>>>>> # of unresolved testcases 1776 
>>>>>> # of unsupported tests 1567 
>>>>>> 
>>>>>> More than 4K failures are because tilegx qemu lacks of instruction's 
>>>>>> implementation, and also more than 10 issues are for TIMEOUT (I guess, 
>>>>>> my original tilegx qemu instruction's implementation still has bugs). 
>>>>>> 
>>>>>> I shall try to finish it within next month, although I am not quite sure 
>>>>>> (it needs enough time resources on it, but I am lack of time resources: 
>>>>>> I can only spend less 1 hour per work day and 2 hours per week end day). 
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> Thanks. 
>>>>>> 
>>>>>>> Thanks. 
>>>>>>> 
>>>>>>> On 1/24/15 21:31, Chen Gang S wrote: 
>>>>>>>> Hello Maintainers: 
>>>>>>>> 
>>>>>>>> The result of gcc testsuite for tile without qemu is below, I guess the 
>>>>>>>> environments construction is OK: 
>>>>>>>> 
>>>>>>>> === gcc Summary === 
>>>>>>>> 
>>>>>>>> # of expected passes 66650 
>>>>>>>> # of unexpected failures 42 
>>>>>>>> # of unexpected successes 1 
>>>>>>>> # of expected failures 107 
>>>>>>>> # of unresolved testcases 16558 
>>>>>>>> # of unsupported tests 1771 
>>>>>>>> 
>>>>>>>> Based on normal testsuite and microblaze testsuite configuration, it is 
>>>>>>>> easy to config gcc testsuite for tile. Thank gcc testsuit member and 
>>>>>>>> microblaze member very much. :-) 
>>>>>>>> 
>>>>>>>> - Copy the original microblaze exp file as tile exp file. Export tile 
>>>>>>>> ip to /etc/hosts. 
>>>>>>>> 
>>>>>>>> - Change the related compiler name and related patch to tile in tile 
>>>>>>>> exp file. 
>>>>>>>> 
>>>>>>>> - Use tile cflag "-m64 -mcpu=tilegx -mcmodel=large -mlittle-endian" 
>>>>>>>> instead of the original microblaze cflag, in tile exp file. 
>>>>>>>> 
>>>>>>>> If OK, I shall try to make a tile patch within this month. Next month, 
>>>>>>>> I shall start tile qemu (I am preparing for it within this month). After 
>>>>>>>> communicate with qemu members, I guess, it is possible to finish it. 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Welcome any ideas, suggestions, and completions. 
>>>>>>>> 
>>>>>>>> Thanks. 
>>>>>>>> 
>>>>>>>> On 1/20/15 10:02, Chen Gang S wrote: 
>>>>>>>>> On 1/20/15 00:10, Chris Metcalf wrote: 
>>>>>>>>>> On 1/17/2015 4:52 AM, Chen Gang S wrote: 
>>>>>>>>>>> Hello Maintainers: 
>>>>>>>>>>> 
>>>>>>>>>>> I am trying to make gcc patches for tile, and need testsuite without 
>>>>>>>>>>> related hardware, so I consult: 
>>>>>>>>>> 
>>>>>>>>>> Unfortunately, at the current time, the simulator is only available as part of the commercial Multicore Development Environment package. A qemu port for tile hardware would certainly be welcome, but to my knowledge, no one has completed such a port yet. ISA and ABI documentation for tilegx are available at www.tilera.com/scm. 
>>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> OK, thank you very much, and the documentation is really valuable to me. 
>>>>>>>>> 
>>>>>>>>> After finish gcc tile testsuite (hope I can finish within this month), 
>>>>>>>>> I shall continue for tile qemu, I should try my best for it, hope I can 
>>>>>>>>> finish: "can run gcc testsuite with the tile qemu". 
>>>>>>>>> 
>>>>>>>>> At present, it is really very hard to me, but for me, it is my duty (I 
>>>>>>>>> met it, and it was within my original boarder). 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> For me, nothing is impossible, if God blessed. 
>>>>>>>>> 
>>>>>>>>> 
>>>>>>>>> Thanks. 
>>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>>> Thanks. 
>>>>>>> 
>>>>>> 
>>>>> 
>>>>> -- 
>>>>> Chen Gang 
>>>>> 
>>>>> Open, share, and attitude like air, water, and life which God blessed 
>>>>> 
>>>>> 
>>>> 
>>>> -- 
>>>> Chen Gang (éå) 
>>>> 
>>>> Open, share, and attitude like air, water, and life which God blessed 
>>> 
>> 
>> 
> 

-- 
Chen Gang (éå) 

Open, share, and attitude like air, water, and life which God blessed 

[test - apologies, but I am unable to post, so maybe I can reply]