convert latin1 to utf8

windstory · 08-20-2010, 02:09 AM

convert latin1 to utf8

I have a problem at convert latin1 to utf8.

There are so many unreadable characters at latin1 db, and these characters could not convert into utf8 also. So I could not import to new utf8 db.

Is it possible to convert these character to utf8 to import to utf8 db?

bathory · 08-20-2010, 02:25 AM

Hi,

You can use iconv to transform a sql file from one encoding to another.
First run "iconv -l" to see what character sets are supported and then use the one that matches you sql dump (usually ISO8859-1 is the same as LATIN1)

Code:

iconv -f ISO8859-1 -t UTF8 file.sql > file-utf8.sql

windstory · 08-20-2010, 03:44 AM

bathory/

I have tried "iconv -f ISO8859-1 -t UTF8 my-dump.sql > mydump-utf8.sql", but when importing there is an error.

mysql -uroot -p my-db < mydump-utf8.sql

Quote:

,'http://www.google.co.kr/search?hl=ko&inlang=ko&ie=EUC-KR&newwindow=1&q=?깊????泥댁?ㅼ??? 湲곕??臾?,'Mozilla/4.0

bathory · 08-20-2010, 04:25 AM

You might add the "--default-character-set=latin1" when you run mysqldump to dump your database and then run iconv (adding -c will omit invalid characters):

Code:

mysqldump -u root -p --mysqldump -u root -p my-db > my-dump.sql
iconv -c -f LATIN1 -t UTF8 my-dump.sql > mydump-utf8.sql

windstory · 08-20-2010, 08:44 AM

bathory/

This is output of "mysqldump -u root -p --mysqldump -u root -p my-db > my-dump.sql".

mysqldump: unknown option '--mysqldump'

And "--default-character-set=latin1" after "iconv -c -f LATIN1 -t UTF8 my-dump.sql > mydump-utf8.sql" are also same result.

bathory · 08-20-2010, 08:52 AM

Oups sorry, I guess I've somehow messed copy/paste. Anyway here it is:

Code:

mysqldump -u root -p --default-character-set=latin1 my-db > my-dump.sql
iconv -c -f LATIN1 -t UTF8 my-dump.sql > mydump-utf8.sql

windstory · 08-20-2010, 09:18 PM

Quote:

Originally Posted by bathory

Oups sorry, I guess I've somehow messed copy/paste. Anyway here it is:

Code:

mysqldump -u root -p --default-character-set=latin1 my-db > my-dump.sql
iconv -c -f LATIN1 -t UTF8 my-dump.sql > mydump-utf8.sql

Thanks, I tried yout codes but same result comes.

bathory · 08-21-2010, 08:33 AM

Sorry to hear that. This iconv method was always working for me converting greek (iso8859-7) to utf8.
Anyway you might take a look at this (original here) to find other ways converting euc-kr to utf8

Regards

windstory · 08-21-2010, 07:32 PM

Quote:

Originally Posted by bathory

Sorry to hear that. This iconv method was always working for me converting greek (iso8859-7) to utf8.
Anyway you might take a look at this (original here) to find other ways converting euc-kr to utf8

Regards

Thanks you for your kind further information.

I'll study and try.