[Typo3-dev] extension "crawler"

Peter Russ peter.russ at 4many.net
Wed Jun 8 17:15:59 CEST 2005


Stefan Beylen wrote:

> Ben Wardle wrote:
> 
>> with wget --spider it won't even save the content in the first place :-)
>>
>> Using --load-cookies=FILE it shld prob also be possible to spider 
>> restricted access sections of your site...
> 
> 
> thanks!
> I am just wondering why the extension "crawler" takes so long to develop 
> then...what else can it do once finished?

Only ideas:
- show me ALL images
- show me ALL Links
- advanced menu structure
etc.

Regs. Peter.




More information about the TYPO3-dev mailing list