[TYPO3-typo3org] robots.txt at typo3.org - searchable extensions' source code

[Krystian Szymukowicz]

hello

are there any specific reason why robots.txt looks like this?

User-agent: *
Disallow: /extensions/repository/view/

In depth of typo3.org/extensions/repository/view/* there is a huge 
amount of working code examples that may be easily searched and be very 
useful for beginner programmers.
Unfortunately with such robots.txt soon it will be not possible.


Are there any chance to make it searchable again?

If this is performance issue maybe there should be "extension source 
archive". Only pure source code without any other information about 
extensions. Static files - no performance issue. Updated once a 3 month.

It could be placed for example under: typo3.org/extensions/source-archive/

I can make such archive and keep it up to date.


--
greetings
Krystian Szymukowicz