[Typo3] Robots.txt and indexed search

Jody Cleveland Cleveland at winnefox.org
Thu Jun 2 17:28:44 CEST 2005


I'm running typo 3.7 on a redhat 3.0AS server.

I've got the Indexed Search Engine version 1.2.8 running in there too.
It's setup to also index external files, which is does well. There are a
few files I don't want indexed, which I've got listed in a robots.txt
file. How do I get typo's indexed search to honor robots.txt for
searching external files?

Jody Cleveland
Computer Support Specialist
cleveland at winnefox.org

More information about the TYPO3-english mailing list