[TYPO3] crawler not indexing no cache or tt_products pages
Andrew Davis
andrew at avagraphique.com
Tue Jun 12 17:20:37 CEST 2007
this is not the issue
it seems that the crawler will only index pages that are cachable.
which seems like there is something wrong here:
1. My normal pages will index using crawler.
2. if i set a normal page to NO CACHE, then crawler wont index it.
3. If i have a page with tt_products plugin, even with special crawler
config set in page tsconfig, it still does not index.
4. I can hide the plugin on that same page, and it will index.
so my question is, how does one index non cacheable pages? with crawler
config i thought it would just follow the lnk¶meters and then index
the pages one by one in the queue..... am i missing something here?!
thanks,
andrew
Andrew Davis wrote:
> my site is hosted on a solaris platform....
>
> would the crawler extension not work as it is running some command line
> stuff?
>
> would I see some errors or would it just appear to work right and not?
>
> I am trying to troubleshoot my weird crawler problem. it appears to work
> but when trying to index tt_products pages, it generates correct urls to
> crawl, i run now and in crawler log it shows a run tie, and then STATUS
> OK, but it doesnt seem to be actually indexing anything...
>
>
> any ideas?
>
> thanks,
> andrew
More information about the TYPO3-english
mailing list