[TYPO3-core] FR: robots.txt

[Sebastian Böttger]

Because I sometime find information from typo3conf with Google, which 
normally is not wanted, I' suggest a robots.txt which disallows the 
TYPO3 folders by default. Attached is a robots.txt which disallows

User-agent: *
Disallow: /uploads/
Disallow: /typo3temp/
Disallow: /typo3/
Disallow: /t3lib/
Disallow: /typo3conf/


To be discussed: should the fileadmin also be included?

Best regards
Sebastian
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: robots.txt
Url: http://lists.netfielders.de/pipermail/typo3-team-core/attachments/20090916/74d5d17f/attachment-0001.txt