This is the mail archive of the
gcc@gcc.gnu.org
mailing list for the GCC project.
RE: How to properly build and run testsuite?
- From: "Andrew Dean via gcc" <gcc at gcc dot gnu dot org>
- To: Jonathan Wakely <jwakely dot gcc at gmail dot com>
- Cc: "gcc at gcc dot gnu dot org" <gcc at gcc dot gnu dot org>
- Date: Thu, 21 Nov 2019 22:21:48 +0000
- Subject: RE: How to properly build and run testsuite?
- Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=microsoft.com; dmarc=pass action=none header.from=microsoft.com; dkim=pass header.d=microsoft.com; arc=none
- Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=36j38AltVwJcT/mR7ju8xruZUXTAYX+MawcN0BnTbWM=; b=SabHVPmGGlq+s0lGAmvKSHz6luLPfz1yiZs6o228D4R6kF3XB2l4DO7gfUxdTzNBFJBu78puokRJmJB99Iq0Zl8f5OCrhM1azj4+FAndQ0NunBDaR4qJu9zYRnf8ryRVHqaU4UOElBydQwDJw1Q09BLVGKl0xEaizUkPeGFhi3kyRh/zsAD5dc3m+iGzhNDaJ4lKE8OO/h8F5wzpEhEGk/LKZS+HqpU9ZyUtFhFu0XKvsFgPBBj8MTSfndhMd29KGIPcxpGKJmK8k0m+Fi11SQ43AxDpl5+T6ZCz4mnHWzTEcKcAST99a3RlmON088wBEYaAKmn4W2NF5s6crqiJsg==
- Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=Em4uRyYUvQdQETuWM1GS5pI6BTqgTvDfxrW6jsusTG4jSFJC7W27ffa2t9I03iGTpXps1YkRbvhh5/KpygWzklrAj2rG0wTDgZ4nyqLZfaq05NAdeCU9QffS5ZHh+DEmkUrdGdGk9V/b2495rnbbLORQyK0kvro+NiqXcOVmZ89QHEKNgOM5q6lKx0UXDDEZcb0vl8D12F5vrdeOYpF8GHpMeoZePL1Jgvq70zTQnF1CHRPSPeSLF331ssUT1eXf31RWEQ4qY518y7wVXMt0hkJffDJWQ9sYaiXtksOqOkQhNybQ7soXQmsE9/syN4fSj8skU6gTek9NN2TuEBpYIg==
- References: <SN2PR00MB01252D007750B4B68672C6B8EA4E0@SN2PR00MB0125.namprd00.prod.outlook.com> <CAH6eHdT4VNb27W3q9Fx8yiLOPT0jLYavOLNo+jTMz4LZ55jHww@mail.gmail.com> <SN2PR00MB0125AA68BC87A118883A9188EA4E0@SN2PR00MB0125.namprd00.prod.outlook.com> <CAH6eHdR-GzNv0wngJAwt063ZKa3Vd-aTajieOU7gGeO6hB3++w@mail.gmail.com>
- Reply-to: Andrew Dean <Andrew dot Dean at microsoft dot com>
> > > > Whereas the most recent reported results (10.0.0 20191118) show
> > > > only 2
> > > unexpected failures and no unexpected successes in the gcc summary.
> > >
> > > Which results are you looking at?
> > > Two failures sounds very low, it's probably not running the guality
> > > tests which usually fail.
> > >
> > I searched the mailing list for x86_64-pc-linux-gnu to make sure I was
> > comparing apples to apples, and this was the most recent report:
> > https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgcc.
> > gnu.org%2Fml%2Fgcc-testresults%2F2019-
> 11%2Fmsg01190.html&data=02%7
> >
> C01%7CAndrew.Dean%40microsoft.com%7Cb89abb6ea9f34a0916d908d76ed0
> 3783%7
> >
> C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C637099712871926073
> &sda
> >
> ta=KooYFswCjKMaV%2FQ3D6tc03WAej8MfQ4Zl9H9kjtR%2B6Y%3D&rese
> rved=0
>
> Yes, I thought you might be looking at that one. That has:
> # of unsupported tests 7126
> which seems high. Here's a more typical set of results:
> https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fgcc.gnu
> .org%2Fml%2Fgcc-testresults%2F2019-
> 11%2Fmsg01255.html&data=02%7C01%7CAndrew.Dean%40microsoft.co
> m%7Cb89abb6ea9f34a0916d908d76ed03783%7C72f988bf86f141af91ab2d7c
> d011db47%7C1%7C0%7C637099712871926073&sdata=ujcoGkSL45wodz
> A50F7NvlyHPGzt8MKnTQbUzye3JIw%3D&reserved=0
>
> The one you looked at is built on an EC2 instance, so might be missing
> something (GDB?) needed for the guality tests.
>
> So I don't think you're doing anything wrong, you just got unlucky and looked at
> one which skips most of the tests that are failing for you.
Thanks for your help!