[TYPO3-dev] problem:: report & analysis: 4.1.2 is coming with codepage inconsistancy

[Oliver Friesen]

Hi Martin,

thanks for your report.

> Problem:
> In a freshly installed Dummy-TYPO3-4.1.2 all UTF-8 installation you
> will find that your MySql-dump will contain UTF-8 errors right away.
> 
> Analysis:
> I did a check on all SQL-files coming with 4.1.2. With two exceptions
> they're all Ascii and therefore do fit Latin-1 and UTF-8 as well. But
> the two files [file_001] and [file_002] are different. See below.
> 
> ----- Begin of analysis dump: -----
> isAscii,isLatin1,isUtf8,filename
> 0,1,0, [file_001]./typo3/sysext/cms/ext_tables_static+adt.sql
> 0,1,1,[file_002]./typo3/sysext/tsconfig_help/ext_tables_static+adt.sql
> ----- End of analysis dump. -----

No wonder as these are the only files containing more than just the DB
structure.

> [file_002] is UTF-8 encoded and since I'm using an all UTF-8
> installation works fine.

Are there no errors, or did you verify that it contains UTF8 data all over
the place?

> [file_001] is the problem. It is - in general - Latin-1 encoded except
> for six times where the byte sequence ï, ¿, ½ occurs.
> These 3 bytes are UTF-8 for Unicode � which is the 'unkown
> value' symbol.

The static templates... :-) They are most likely not needed at all, and we
might soon be going to drop them completely, so I wouldn't care too much
about them...

> Fix:
> 
> Step 1: I opened [file_001] in Latin-1 mode and replaced six times the
> three bytes '\xef\xbf\xbd' by three quotations marks ('???'). This
> will keep file size the same and later on allow to spot these six
> instances.
> 
> Step 2: I converted [file_001] to UTF-8.
> 
> Step 3: Using the installer I imported the static data again.
> 
> Result: The MySql-dump doesn't contain errors any more.

Can you please make a diff of your changes and post them in the bugtracker?
Thanks in advance!

- michael
-- 
Use a newsreader! Check out
http://typo3.org/community/mailing-lists/use-a-news-reader/
_______________________________________________
TYPO3-dev mailing list
TYPO3-dev at lists.netfielders.de
http://lists.netfielders.de/cgi-bin/mailman/listinfo/typo3-dev