This is the mail archive of the
gcc-patches@gcc.gnu.org
mailing list for the GCC project.
Re: [PATCH] gcc parallel make check
- From: Mike Stump <mikestump at comcast dot net>
- To: VandeVondele Joost <joost dot vandevondele at mat dot ethz dot ch>
- Cc: Jakub Jelinek <jakub at redhat dot com>, "gcc at gcc dot gnu dot org" <gcc at gcc dot gnu dot org>, "fortran at gcc dot gnu dot org" <fortran at gcc dot gnu dot org>, "gcc-patches at gcc dot gnu dot org" <gcc-patches at gcc dot gnu dot org>
- Date: Wed, 10 Sep 2014 11:19:56 -0700
- Subject: Re: [PATCH] gcc parallel make check
- Authentication-results: sourceware.org; auth=none
- References: <908103EDB4893A42920B21D3568BFD93150F4103 at MBX23 dot d dot ethz dot ch> <20140905143740 dot GL17454 at tucnak dot redhat dot com> <908103EDB4893A42920B21D3568BFD93150F414C at MBX23 dot d dot ethz dot ch>,<20140905145304 dot GM17454 at tucnak dot redhat dot com>,<908103EDB4893A42920B21D3568BFD93150F7F45 at MBX23 dot d dot ethz dot ch> <908103EDB4893A42920B21D3568BFD93150F816B at MBX23 dot d dot ethz dot ch>
On Sep 9, 2014, at 8:14 AM, VandeVondele Joost <joost.vandevondele@mat.ethz.ch> wrote:
> Attached is a further revision of the patch, now dealing with check-c++.
So when last I played in this area, I wanted a command line tool that would bin-pack from the command line. I would then grab the seconds per for each .exp, and bin pack to the fixed N, where N was the core count or related to it like, like N+1, N*1.1+1, N*2, ceil(N*1.1)). Then, I would just have 60-100 bins, and that -j64 run would be nicer. The only reason why I didn’t push that patch up was I didn’t know of any such program. :-( I mention this in case someone knows of such a tool that is open source, hopefully GNU software. The idea being, if a user has a 64 cores or want the .exp files to be more balanced on their target, they can be bothered to download the tool, don’t have it, and you get something a little more static.
Another way is to just make the buckets 60 seconds apiece. This way, have nice box, 60 seconds to test, otherwise, the test time is at most 1 minute unbalanced.