RE: [Consult] tile: How to construct testsuite for tile architecture without hardware.

[Chen Gang <xili_gchen_5257 at hotmail dot com>]

After fix the tillegx qemu's fsingle floating point insns issue, the gcc test suite result is:

		=== gcc Summary ===

# of expected passes		77272
# of unexpected failures	365
# of unexpected successes	7
# of expected failures		113
# of unresolved testcases	141
# of unsupported tests		1476

And I shall continue to analyze the left issues, next. :-)


Thanks.
--
Chen Gang

Open, share, and attitude like air, water, and life which God blessed


----------------------------------------
> From: xili_gchen_5257@hotmail.com
> To: cmetcalf@ezchip.com; walt@tilera.com
> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net
> Subject: RE: [Consult] tile: How to construct testsuite for tile architecture without hardware.
> Date: Sun, 4 Oct 2015 19:55:44 +0800
>
> After finish additional 7 qemu patches, our tilegx qemu can test the gcc
> testsuite successfully (no any unimplementation issues). The test result
> is:
>
> === gcc Summary ===
>
> # of expected passes 77012
> # of unexpected failures 622
> # of unexpected successes 7
> # of expected failures 113
> # of unresolved testcases 143
> # of unsupported tests 1476
>
>
> For the 622 left issues:
>
> - Maybe still tilegx implementation issue, e.g.
>
> the floating point single mul instruction cann't get the result which
> tilegx gcc expected (it is only related with calculating: float32_mul
> calculation result is not match tilegx gcc expected).
>
> - Maybe envorintments configuration issues, e.g.
>
> for gcc guality_check, it may call gdb outside, so I need config the
> related gdb correctlly.
>
> - Maybe tilegx gcc issues, e.g.
>
> for some UNKNOWN instructions, probably generated by incorrect jump
> instructions, one sample is "-fpic -mcmodel=large" for gcc nested-5
> test.
>
> Next, I shall:
>
> - continue to fix the left 622 issues, and send related patches to
> qemu-devel mailing list or gcc-patches mailing list.
>
> - then rewrite floating point instructions, and try to let the related
> code merged into qemu mainline with qemu members' help (at present,
> floating point implementation is a temporary implementation).
>
> - at last, try to finish all left unimplemented instructions (there are
> still some unimplement insns left, but at present, gcc testsuite does
> not use them), and start tilegx qemu system mode, next.
>
>
> Welcome any members' ideas, suggestion, and completions. :-)
>
>
> Thanks.
>
> Chen Gang
>
> Open, share, and attitude like air, water, and life which God blessed
>
>
> ----------------------------------------
>> Date: Thu, 1 Oct 2015 12:12:48 +0800
>> From: xili_gchen_5257@hotmail.com
>> To: cmetcalf@ezchip.com; walt@tilera.com
>> CC: law@redhat.com; gcc-help@gcc.gnu.org; mikestump@comcast.net; eager@eagerm.com; rth@redhat.com; peter.maydell@linaro.org; afaerber@suse.de; rth@twiddle.net
>> Subject: Re: [Consult] tile: How to construct testsuite for tile architecture without hardware.
>>
>>
>> At present, tilegx is integrated into qemu master branch successfully
>> with the much help by qemu members.
>>
>> But sorry, I did not finish gcc testsuite in time, the main excuse is
>>
>> - I am busy on the normal work -- sometimes, have to do overtime work.
>> (my company started up an urgent project, but couldn't find suitable
>> persons for it in short time, so I have to do it during these days).
>>
>> Next, in Chinese National Day, I have enough free time resources on open
>> source, hope I finish our gcc testsuite within Chinese National Day (it
>> is from 2015-10-01 -- 2015-10-07).
>>
>> Thanks.
>>
>> On 8/30/15 11:50, Chen Gang wrote:
>>>
>>> Oh, sorry again, I did not finish qemu test within this month, again.
>>> Current status is:
>>>
>>> === gcc Summary ===
>>>
>>> # of expected passes 76725
>>> # of unexpected failures 790
>>> # of unexpected successes 7
>>> # of expected failures 113
>>> # of unresolved testcases 142
>>> # of unsupported tests 1483
>>>
>>>
>>> My main excuses are:
>>>
>>> - We are lack of tilegx floating point insns related documents, we have
>>> to 'guess' implementation details. At last, we found ways to process
>>> it (we spent more than a half month free time resources for it).
>>>
>>> - My related qemu code need be refactor before merging into qemu master
>>> tree. At present, we are refactoring and merging tilegx code to qemu
>>> master tree (mainly by qemu related members).
>>>
>>> Hope I can finish qemu tilegx gcc testsuite within next month (I guess,
>>> it should be done in time).
>>>
>>> - Test the refactored and merged code again, based on it, I continue to
>>> fix gcc testsuite related issues.
>>>
>>> - Fix all 700+ gcc testsuite issues (10+ for pending issues, and the
>>> others are for UN-implementation insns issues, I guess).
>>>
>>>
>>> Thanks.
>>>
>>>
>>> On 7/30/15 05:01, Chen Gang wrote:
>>>> On 7/20/15 06:26, Chen Gang wrote:
>>>>> Hello all:
>>>>>
>>>>> At present (after a half year), with the much help of QEMU members,
>>>>> tilegx linux-user can work (manually using busybox's sh, ls, cp, mv, vi
>>>>> are OK).
>>>>>
>>>>> Next, I shall start gcc testsuite with qemu tilegx linux-user, hope I
>>>>> can finish within this month (2015-07-31).
>>>>>
>>>>
>>>> Sorry, I can not finish the qemu test within this month. The reason is
>>>> my tilegx qemu is still lack of some instructions implementation, next,
>>>> I should finish them firstly (I implemented most insns, but not all).
>>>>
>>>> === gcc Summary ===
>>>>
>>>> # of expected passes 69830
>>>> # of unexpected failures 4312
>>>> # of unexpected successes 2
>>>> # of expected failures 108
>>>> # of unresolved testcases 1776
>>>> # of unsupported tests 1567
>>>>
>>>> More than 4K failures are because tilegx qemu lacks of instruction's
>>>> implementation, and also more than 10 issues are for TIMEOUT (I guess,
>>>> my original tilegx qemu instruction's implementation still has bugs).
>>>>
>>>> I shall try to finish it within next month, although I am not quite sure
>>>> (it needs enough time resources on it, but I am lack of time resources:
>>>> I can only spend less 1 hour per work day and 2 hours per week end day).
>>>>
>>>>
>>>>
>>>> Thanks.
>>>>
>>>>> Thanks.
>>>>>
>>>>> On 1/24/15 21:31, Chen Gang S wrote:
>>>>>> Hello Maintainers:
>>>>>>
>>>>>> The result of gcc testsuite for tile without qemu is below, I guess the
>>>>>> environments construction is OK:
>>>>>>
>>>>>> === gcc Summary ===
>>>>>>
>>>>>> # of expected passes 66650
>>>>>> # of unexpected failures 42
>>>>>> # of unexpected successes 1
>>>>>> # of expected failures 107
>>>>>> # of unresolved testcases 16558
>>>>>> # of unsupported tests 1771
>>>>>>
>>>>>> Based on normal testsuite and microblaze testsuite configuration, it is
>>>>>> easy to config gcc testsuite for tile. Thank gcc testsuit member and
>>>>>> microblaze member very much. :-)
>>>>>>
>>>>>> - Copy the original microblaze exp file as tile exp file. Export tile
>>>>>> ip to /etc/hosts.
>>>>>>
>>>>>> - Change the related compiler name and related patch to tile in tile
>>>>>> exp file.
>>>>>>
>>>>>> - Use tile cflag "-m64 -mcpu=tilegx -mcmodel=large -mlittle-endian"
>>>>>> instead of the original microblaze cflag, in tile exp file.
>>>>>>
>>>>>> If OK, I shall try to make a tile patch within this month. Next month,
>>>>>> I shall start tile qemu (I am preparing for it within this month). After
>>>>>> communicate with qemu members, I guess, it is possible to finish it.
>>>>>>
>>>>>>
>>>>>> Welcome any ideas, suggestions, and completions.
>>>>>>
>>>>>> Thanks.
>>>>>>
>>>>>> On 1/20/15 10:02, Chen Gang S wrote:
>>>>>>> On 1/20/15 00:10, Chris Metcalf wrote:
>>>>>>>> On 1/17/2015 4:52 AM, Chen Gang S wrote:
>>>>>>>>> Hello Maintainers:
>>>>>>>>>
>>>>>>>>> I am trying to make gcc patches for tile, and need testsuite without
>>>>>>>>> related hardware, so I consult:
>>>>>>>>
>>>>>>>> Unfortunately, at the current time, the simulator is only available as part of the commercial Multicore Development Environment package. A qemu port for tile hardware would certainly be welcome, but to my knowledge, no one has completed such a port yet. ISA and ABI documentation for tilegx are available at www.tilera.com/scm.
>>>>>>>>
>>>>>>>
>>>>>>> OK, thank you very much, and the documentation is really valuable to me.
>>>>>>>
>>>>>>> After finish gcc tile testsuite (hope I can finish within this month),
>>>>>>> I shall continue for tile qemu, I should try my best for it, hope I can
>>>>>>> finish: "can run gcc testsuite with the tile qemu".
>>>>>>>
>>>>>>> At present, it is really very hard to me, but for me, it is my duty (I
>>>>>>> met it, and it was within my original boarder).
>>>>>>>
>>>>>>>
>>>>>>> For me, nothing is impossible, if God blessed.
>>>>>>>
>>>>>>>
>>>>>>> Thanks.
>>>>>>>
>>>>>>
>>>>>
>>>>> Thanks.
>>>>>
>>>>
>>>
>>> --
>>> Chen Gang
>>>
>>> Open, share, and attitude like air, water, and life which God blessed
>>>
>>>
>>
>> --
>> Chen Gang (éå)
>>
>> Open, share, and attitude like air, water, and life which God blessed
>