robots.txt

Gerald Pfeifer pfeifer@dbai.tuwien.ac.at
Tue Mar 9 15:04:00 GMT 1999


I noticed that we don't (yet) have a robots.txt file for the egcs web
server. 

How about the following for now?

  User-Agent: *
  Disallow: /cgi-bin/

If there are no objections, I'll commit that in a couple of days...

Gerald
-- 
Gerald Pfeifer (Jerry)      Vienna University of Technology
pfeifer@dbai.tuwien.ac.at   http://www.dbai.tuwien.ac.at/~pfeifer/




More information about the Gcc mailing list