c-family: token streamer

[Nathan Sidwell]

This is	broken out of modules patch 01-langhooks.diff, I realized that
this part is independent, and removes some duplicated code -- migrated
to the token_streamer class.

         gcc/c-family/
         * c-ppoutput.c (scan_translation_unit): Use token_streamer, remove
         code duplicating that functionality.

pushing to trunk
-- 
Nathan Sidwell
-------------- next part --------------
A non-text attachment was scrubbed...
Name: 01a-langhooks.diff
Type: text/x-patch
Size: 3902 bytes
Desc: not available
URL: <https://gcc.gnu.org/pipermail/gcc-patches/attachments/20201117/5a040228/attachment-0001.bin>