[Typo3] Weirdness with google indexing

[Bernhard Kraft]

Boris Senker wrote:

> Nevertheless, here is what happens. When you submit a site to Google (or it 
> gets to it following some link to your site), the initial robot visits, 
> checking for instructions, checking if site is 'there', if it's elligible 
> for main indexing etc. and adds it to the Big Pappa Crawler ie. main Google 
> indexer's queue. Then you wait your turn, depending where one of Google's 
> big crawler robots are at the moment in their cyclic runs. While your site 
> waits in the queue, a little Google bot comes from time to time seeing if it 
> is still there until the big one arrives.
> 
> This waiting can last from 2 days to 2 months, depending on where the big 
> indexer is when you submit a site in it's cyclic run. I don't have any 
> information on the current Googlebot cycle timings, writing you as it used 
> to be.

Where have you got that deep insight into google indexing mechanisms from ?
Is that somewhere online to read ?


greets,
Bernhard