[TYPO3-english] indexed_search with non western language

[Historia]

Thanks for answering this post, but I also have done this
SET NAMES utf8;

The real strange thing for me is the functioning of the search in the 
backend. However the project was halted for some time and I had other 
tasks to do and I was only starting this week again. I will set up a new 
site from scratch on 4.5. The guys from our Animation unit want 
something even more playful. This is a good time to start over.

I will tell about the experience next week if the network here in 
Ethiopia is working fast enough;-)


Am 07.02.2011 12:50, schrieb Stefanos Karasavvidis:
> do you have "set names utf8" for the [setDBinit] setting of the install
> tool?
>
> sk
>
> On 11/22/2010 10:23 AM, Historia wrote:
>> Another try with a new dummy. All set to UTF-8 and then imported the
>> website with t3d. Nothing changed. Website is perfect but Database
>> content ist still not utf8 coded.
>>
>> So Typo3 is converting the utf8 content to something else. No more idea
>> where to search.
>>
>> Herbert
>>
>> Am 19.11.2010 14:36, schrieb Historia:
>>> Ok, giving up,
>>>
>>> I created a new Database did a iconv from latin to utf8, set all to utf8
>>> lost practically all my content and put in new content in Amharic.
>>>
>>> The content is still not utf-8 according to webbrowsing with phpmyadmin
>>> and when I put content directly in the database it is shown nicely but
>>> neverless not found with the fe search.
>>>
>>> So I have to give up with the Introductionpackage and have another try
>>> with Dummy. Is there nobody out there with similar problems in Kyrillic,
>>> Thai or chinese?
>>>
>>> Herbert
>>>
>>> Am 19.11.2010 10:01, schrieb Historia:
>>>> Hello Stefan,
>>>>
>>>> no, doesn't work. The code in the database is stored in another format.
>>>> I have no idea about the real coding of the entries. Typo3 somehow
>>>> recodes the entries so they come out as utf in FE and BE, but they are
>>>> recoded in the database. tt-content and index are the same strange
>>>> characters.
>>>>
>>>> So I think solr will be no option either.
>>>>
>>>> Herbert
>>>>
>>>>
>>>> Am 18.11.2010 17:36, schrieb Stefan Frömken:
>>>>> Hello Herbert,
>>>>>
>>>>> Have you truncated the cache_*-tables? You can do this with
>>>>> phpmyadmin-extension.
>>>>>
>>>>> UTF-8 will be default in TYPO3 4.5.0 at the end of january.
>>>>>
>>>>> Stefan
>>>>>
>>>>> Am 18.11.2010 15:21, schrieb Historia:
>>>>>> Hello Stefan
>>>>>>
>>>>>> did the clidispatch from the backend, cleared the cache and visited
>>>>>> lots
>>>>>> of pages. Nothing is found. I have to set up a new website with the
>>>>>> dummy package to check if there is some other issue about the coding.
>>>>>>
>>>>>> I wonder why not all is utf-8 in the system as default.
>>>>>>
>>>>>> Herbert
>>>>>>
>>>>>> Am 18.11.2010 15:56, schrieb Stefan Frömken:
>>>>>>> Am 18.11.2010 13:43, schrieb Historia:
>>>>>>>> Hello,
>>>>>>>>
>>>>>>>> I made a website with Amharic (Ethiopia) and English. All is
>>>>>>>> based on
>>>>>>>> the Introductionpackage 4.4.4 with an own template. I have it
>>>>>>>> local on
>>>>>>>> Windows and live on a Suse 11 Rootserver.
>>>>>>>>
>>>>>>>> indexed search is not working with Amharic script.
>>>>>>>> In the indexing page the amharic script is not coded in the right
>>>>>>>> way,
>>>>>>>> however in DB check I can properly search in Amharic with the right
>>>>>>>> coding.
>>>>>>>> Database is set to unicode general charset utf-8
>>>>>>>> [BE][forceCharset] = utf-8
>>>>>>>>
>>>>>>>> Is there some other issue related to the search?
>>>>>>>>
>>>>>>>> thanks Herbert
>>>>>>> It seems that you have installed indexed_search before you have
>>>>>>> changed
>>>>>>> Charset. In this case all words were saved with wrong characterset in
>>>>>>> cache_* tables, but they are correct in tt_content-table and on
>>>>>>> website,
>>>>>>> too.
>>>>>>> If I'm right...than I prefer to truncate all data in cache_* tables
>>>>>>> and
>>>>>>> execute scheduler with crawler-task or _cli_dispatch or visit each
>>>>>>> page
>>>>>>> manually. But please backup your database first!
>>>>>>>
>>>>>>> Stefan
>>>>>>
>>>>>