the problem was that the URL was not built completely. It did not have the domain appended, this was fixed with the following setting placed down in the url {...} block: typolink.forceAbsoluteUrl = 1 this is now indexing the documents, appending the domain to the front of the URL.