This is the mail archive of the
gcc-patches@gcc.gnu.org
mailing list for the GCC project.
Re: [PATCH][LTO] Streamer re-org (what's left)
- From: Jan Hubicka <hubicka at ucw dot cz>
- To: Richard Biener <rguenther at suse dot de>
- Cc: Jan Hubicka <hubicka at ucw dot cz>, gcc-patches at gcc dot gnu dot org
- Date: Fri, 15 Aug 2014 20:43:04 +0200
- Subject: Re: [PATCH][LTO] Streamer re-org (what's left)
- Authentication-results: sourceware.org; auth=none
- References: <alpine dot LSU dot 2 dot 11 dot 1408071337320 dot 20733 at zhemvz dot fhfr dot qr> <alpine dot LSU dot 2 dot 11 dot 1408071541180 dot 20733 at zhemvz dot fhfr dot qr> <alpine dot LSU dot 2 dot 11 dot 1408111049480 dot 20733 at zhemvz dot fhfr dot qr> <20140814163337 dot GA27831 at kam dot mff dot cuni dot cz> <alpine dot LSU dot 2 dot 11 dot 1408150938570 dot 20733 at zhemvz dot fhfr dot qr> <20140815081438 dot GA29797 at atrey dot karlin dot mff dot cuni dot cz> <alpine dot LSU dot 2 dot 11 dot 1408151036340 dot 20733 at zhemvz dot fhfr dot qr>
>
> Yeah, the 2MB was just a "guess", I'll change it to 64k blocks. Note
> the original code exponentially increased block size to not have
> too many blocks (for whatever reason). A 800MB compressed decl section
> would need 12800 64k blocks. But in the end it matters only that
> the block allocations are "efficient" for the memory allocator
> (so don't allocate 1-byte blocks). Our internal overhead is
> one pointer (to point to the next buffer).
>
> Of course in the end I want to implement streaming right into the
> file rather than queuing up the whole compressed data (or
> mmapping it).
Yep, would be nice for WPA stream out memory usage. Also getting rid of the
gcc->gas->object file way for slim LTO files may be huge win for kernel
times...
>
> Btw, I'll first try to get rid of the separate string section
> which would also make it compressed again and be less awkwardly
> abusing the data-streamer.
Sounds good :)
Honza
>
> Richard.