[TYPO3-performance] DataHandler high memory consumption

[Jigal van Hemert]

Hi,

On 02/11/2014 17:53, Lukas Krieger wrote:
> i am using the DataHandler in order to import pages into Typo3 but i
> have some problems with the php memory consumption.
>
> Creating X pages result in X MB Memory usage
> 54 Pages => 21MB
> 118 Pages => 41MB
> 150 Pages => 50MB
> 281 Pages => 88MB
>
> You can say, the DataHandler instance need 0,33MB for each record.
[...]
> Is there any solution to use less memory or even to free the memory
> which the DataHandler is using?
> Did someone of you experienced the same problem?

In one project I did a rather large import of pages and content using 
DataHandler. Because it would be used for many thousands of pages and 
their content elements I made two scheduler tasks to handle this.
This way I didn't notice any dramatic memory usage, simply because only 
a limited number of records would be imported.

It could be that the DataHandler object adds data for each record to 
some internal structures. It would be interesting to see where this occurs.
A workaround could be to destroy the variable with the DataHandler at 
some point and instantiate a new object.

-- 
Jigal van Hemert
TYPO3 CMS Active Contributor

TYPO3 .... inspiring people to share!
Get involved: typo3.org