[TYPO3-typo3org] Please allow indexing of wiki content on forge by search engines

[Steffen Gebert]

> Please allow indexing of wiki content on forge.typo3.org by search engines.
>
> There's so many helpful documentation in the project wikis which can't
> be found via search engines.
After you mentioned this, I reported two issues yesterday:

* forge not indexed by Google
   http://forge.typo3.org/issues/26980
   Probably because the UA filter you mentioned

* robots.txt disallow indexing
   http://forge.typo3.org/issues/26981
   This disallows indexing of the issue trackers. So nobody will find 
TYPO3 bugs *yeah*

> There's some mechanism which filters by UA strings and redirects
> searchbots to 403 page.
I suppose it's from the times, when bots indexed forge and made it 
really slow. Wget access is also disallowed. This really has to be changed.

Kind regards
Steffen

-- 
Steffen Gebert
TYPO3 v4 Core Team Member

TYPO3 .... inspiring people to share!
Get involved: http://typo3.org