[TYPO3-english] indexed_search with non western language

[Stefanos Karasavvidis]

do you have "set names utf8" for the [setDBinit] setting of the install
tool?

sk

On 11/22/2010 10:23 AM, Historia wrote:
> Another try with a new dummy. All set to UTF-8 and then imported the
> website with t3d. Nothing changed. Website is perfect but Database
> content ist still not utf8 coded.
> 
> So Typo3 is converting the utf8 content to something else. No more idea
> where to search.
> 
> Herbert
> 
> Am 19.11.2010 14:36, schrieb Historia:
>> Ok, giving up,
>>
>> I created a new Database did a iconv from latin to utf8, set all to utf8
>> lost practically all my content and put in new content in Amharic.
>>
>> The content is still not utf-8 according to webbrowsing with phpmyadmin
>> and when I put content directly in the database it is shown nicely but
>> neverless not found with the fe search.
>>
>> So I have to give up with the Introductionpackage and have another try
>> with Dummy. Is there nobody out there with similar problems in Kyrillic,
>> Thai or chinese?
>>
>> Herbert
>>
>> Am 19.11.2010 10:01, schrieb Historia:
>>> Hello Stefan,
>>>
>>> no, doesn't work. The code in the database is stored in another format.
>>> I have no idea about the real coding of the entries. Typo3 somehow
>>> recodes the entries so they come out as utf in FE and BE, but they are
>>> recoded in the database. tt-content and index are the same strange
>>> characters.
>>>
>>> So I think solr will be no option either.
>>>
>>> Herbert
>>>
>>>
>>> Am 18.11.2010 17:36, schrieb Stefan Frömken:
>>>> Hello Herbert,
>>>>
>>>> Have you truncated the cache_*-tables? You can do this with
>>>> phpmyadmin-extension.
>>>>
>>>> UTF-8 will be default in TYPO3 4.5.0 at the end of january.
>>>>
>>>> Stefan
>>>>
>>>> Am 18.11.2010 15:21, schrieb Historia:
>>>>> Hello Stefan
>>>>>
>>>>> did the clidispatch from the backend, cleared the cache and visited
>>>>> lots
>>>>> of pages. Nothing is found. I have to set up a new website with the
>>>>> dummy package to check if there is some other issue about the coding.
>>>>>
>>>>> I wonder why not all is utf-8 in the system as default.
>>>>>
>>>>> Herbert
>>>>>
>>>>> Am 18.11.2010 15:56, schrieb Stefan Frömken:
>>>>>> Am 18.11.2010 13:43, schrieb Historia:
>>>>>>> Hello,
>>>>>>>
>>>>>>> I made a website with Amharic (Ethiopia) and English. All is
>>>>>>> based on
>>>>>>> the Introductionpackage 4.4.4 with an own template. I have it
>>>>>>> local on
>>>>>>> Windows and live on a Suse 11 Rootserver.
>>>>>>>
>>>>>>> indexed search is not working with Amharic script.
>>>>>>> In the indexing page the amharic script is not coded in the right
>>>>>>> way,
>>>>>>> however in DB check I can properly search in Amharic with the right
>>>>>>> coding.
>>>>>>> Database is set to unicode general charset utf-8
>>>>>>> [BE][forceCharset] = utf-8
>>>>>>>
>>>>>>> Is there some other issue related to the search?
>>>>>>>
>>>>>>> thanks Herbert
>>>>>> It seems that you have installed indexed_search before you have
>>>>>> changed
>>>>>> Charset. In this case all words were saved with wrong characterset in
>>>>>> cache_* tables, but they are correct in tt_content-table and on
>>>>>> website,
>>>>>> too.
>>>>>> If I'm right...than I prefer to truncate all data in cache_* tables
>>>>>> and
>>>>>> execute scheduler with crawler-task or _cli_dispatch or visit each
>>>>>> page
>>>>>> manually. But please backup your database first!
>>>>>>
>>>>>> Stefan
>>>>>
>>>>