syslog and utf-8

phuna · 07-18-2006, 04:18 AM

Hi all,
I use syslog for my program to log all information. Now I encounter a problem with Japanese and UTF-8 encoding: all UTF-8 characters written to syslog are not readable, like this:

æ\226°ã\201\227ã\201\204ã\203\225ã\202(c)ã\203«ã\203\200

If I use EUC encoding, there's no problem.
I've read somewhere that syslog can only handle 7-bit characters, is it right?
Is there any way to make UTF-8 string readable in syslog?

Any help would be appreciated.

Thanks in advance.

--
Nguyen Anh Phu

ugenn · 07-19-2006, 01:19 AM

I suspect your current locale is set to EUC, that's why utf shows as garbage. syslog should handle none 8-bit clean fine. Afterall, EUC isn't 8-bit clean either.

phuna · 07-19-2006, 02:17 AM

Thanks for your reply.

I've tried to set system locale to ja_JP.UTF-8 and jp_JP.EUC-JP, in both case, UTF-8 strings always unreadable. EUC string works as expected, it's readable if locale is EUC, unreadable if locale is UTF-8

ugenn · 07-19-2006, 04:56 AM

do you have the locale files for ja_JP.utf8 installed?
check your /usr/lib/locale directory.

phuna · 07-19-2006, 08:46 PM

I found nothing in /usr/lib/locale directory only 1 file named locale-archive.

Code:

$ file /usr/lib/locale/locale-archive
/usr/lib/locale/locale-archive: PDP-11 separate I&D executable not stripped

I'm using Debian 3.1 and I use "dpkg-reconfigure locales" to install locales, after that I switch system locale from GDM menu.
I found that in /usr/share/locale there are:

Code:

$ ls
af	       be  da		en_AU  et     gl  is	 lg	       ml     nn     pl_PL  se	     sv  uz	  zh_CN
all_languages  bg  de		en_CA  et_EE  gu  it	 li	       mn     no     pt     sk	     ta  uz@Latn  zh_CN.GB2312
am	       bn  de.UTF-8	en_GB  eu     he  it_IT  locale.alias  mr     no_NO  pt_BR  sl	     tg  vi	  zh_HK
ang	       br  de_AT	en_US  eu_ES  hi  ja	 lt	       ms     no_nb  pt_PT  sp	     th  wa	  zh_TW
ar	       bs  el		eo     fa     hr  ka	 lv	       nb     nso    rm     sq	     tk  xh	  zh_TW.Big5
as	       ca  en		es     fi     hu  kn	 mg	       ne     or     ro     sr	     tl  yi	  zu
az	       cs  en@boldquot	es_ES  fr     ia  ko	 mi	       nl     pa     ru     sr@Latn  tr  yo
az_IR	       cy  en@quot	es_MX  ga     id  l10n	 mk	       nl_NL  pl     rw     sr@ije   uk  zh

Are they locale files? If not, where can I find locale files on my system?