[Typo3-dev] Web crawler for indexed search plugin !!

[Andreas Schwarzkopf]

Hi Guarav,

a perfect solution for this is the good old wget. It is Open Source and 
a part of all Linux distributions and can also be used on windows. It 
has very many useful parameters and can do almost everything related 
with crawling pages.

grtx Andreas

Gaurav Prasad schrieb:
> Hi,
>     I was wondering if there is any php based crawler which crawl all 
> links in typo3 site to index it
> may be we can integrate this with indexed search engine later on
> 
> I was also looking at http://www.phpmini.com/crawler.php
> 
> have any attempted this before or if there is better solution pl tell me
> 
> regards.
> gaurav


-- 
----------------------------------------------------------
----------------------------------------------------------

      Andreas Schwarzkopf

      @rtplan[21] webconcepts & solutions

      mailto:schwarzkopf at artplan21.de
      http://www.artplan21.de
      fon: +49 +30 - 447 35 228
      fax: +49 +30 - 447 35 227

      Dirschauer Str. 14
      D-10245 Berlin

      TYPO3 und andere Content-Management-Systeme:
      http://www.artplan21.info

----------------------------------------------------------