[TYPO3-mvc] Import Script Problems

[Nikolas Hagelstein]

Hi,

> how did you solve it in the end? I'm currently also in need of a import
> script and I'm not sure if I should do it the "Extbase way" using
> objects and a lot of SQL overhead or just good old PHP/SQL.

I got a project that makes heavy use of external data(csv files/
webservices) that needs to be imported/update regulary.
Currently I  am doing the extbase way, and it works quite well - around 20k
relations in a few seconds. If performance is really an issue, there is
nothing against a high speed plain SQL importer..

For a single initial import I would go for plain sql but for regular imports
the extbase way seems way more maintainable to me. 

One thing for regular imports : Extbase isn't capable of cli dispatching at
the moment, therefore you should use a single fe import controller and
trigger it via a cron job. (Pulling up the whole framework from a native cli
script is real pain)

In order to avoid exceeding  php memory or execution limits, you could  tick
this import controller every few minutes and let it do its job "chunkwise"
(e.g. read cvs file to a temp table and process x rows at time or similar).

Cheers,
Nikolas