Add a /robots.txt file to both get rid of error messages
authoropenssl <openssl>
Tue, 23 Mar 1999 07:38:54 +0000 (07:38 +0000)
committeropenssl <openssl>
Tue, 23 Mar 1999 07:38:54 +0000 (07:38 +0000)
commit6e90b5c1d9ef44dddc6b0431d2db2436ddd2c316
treed66ca9d31a8cd305e3bd48c39f131fd353218273
parent2e882c04ce572546432f1d963866cfa59292ca27
Add a /robots.txt file to both get rid of error messages
(requests to this file resulting in 404 not found) and
to make sure at least some robots don't crawl under
/source/ too much (our cgiweb stuff causes high load).
robots.txt [new file with mode: 0644]