[TYPO3-dev] linkvalidator's memory footprint

[Xavier Perseguers]

Hi,

>> Why does linkvalidator use up that much RAM? Does it possibly hold
>> stuff in memory where there is no need to?
>
> Might be, the code is not optimal, but I think the real problem is that you
> are checking a link that links to a large file.
>
> Do to some problems with web servers not supporting HTTP/HEAD (e.g.
> amazon.com) we have to use GET on the links. But this loads the whole link
> into memory. So if you link to a large file, you are in trouble :/

Just an idea, could we have some kind of "dynamic" list of such servers 
(not hardcoded) that would allow to only fallback to GET if really needed?

-- 
Xavier Perseguers
Release Manager TYPO3 4.6

TYPO3 .... inspiring people to share!
Get involved: http://typo3.org