[TYPO3-core] RFC: Bug #7787: Yahoo, MSN, Ask.com and Alexa are not recognized in TypoScript robot condition

[Martin Kutschker]

Ok, but the list is a bit short. Some links to make it longer:

http://www.user-agents.org/
http://www.botsvsbrowsers.com/category/1/index.html
http://www.robotstxt.org/db.html
http://www.jafsoft.com/searchengines/webbots.html

Masi

Oliver Hader schrieb:
> REMINDER #1
> 
> I'm going to commit this issue today if nobody objects.
> It's a nobrainer...
> 
> olly
> 
> 
> Oliver Hader schrieb:
>> This is a SVN patch request.
>>
>> Problem:
>> Yahoo, MSN, Ask.com and Alexa are not recognized in TypoScript robot 
>> condition.
>>
>> Solution:
>> Add parts of the user agent string of the HTTP header to recognize 
>> them correctly:
>> * Yahoo -> slurp
>> * MSN -> msnbot
>> * Ask.com -> teoma
>> * Alexa -> ia_archiver
>>
>> Comments:
>> Thanks to Peter Knoell for pointing out this issue.
>>
>> Bugtracker references:
>> http://bugs.typo3.org/view.php?id=7787
>>
>> Branch: Trunk
>>
>>
>> olly