[TYPO3-typo3org] Please allow indexing of wiki content on forge by search engines

Steffen Gebert steffen.gebert at typo3.org
Mon May 23 18:09:02 CEST 2011

> Please allow indexing of wiki content on forge.typo3.org by search engines.
> There's so many helpful documentation in the project wikis which can't
> be found via search engines.
After you mentioned this, I reported two issues yesterday:

* forge not indexed by Google
   Probably because the UA filter you mentioned

* robots.txt disallow indexing
   This disallows indexing of the issue trackers. So nobody will find 
TYPO3 bugs *yeah*

> There's some mechanism which filters by UA strings and redirects
> searchbots to 403 page.
I suppose it's from the times, when bots indexed forge and made it 
really slow. Wget access is also disallowed. This really has to be changed.

Kind regards

Steffen Gebert
TYPO3 v4 Core Team Member

TYPO3 .... inspiring people to share!
Get involved: http://typo3.org

More information about the TYPO3-team-typo3org mailing list