[SOLVED] malformed utf-8 character

qrange · 06-15-2011, 05:54 AM

please help.
I need some software that will check .xml file and tell me which character is malformed in 'utf-8'.

I am using perl for some parsing.

thanks.

qrange · 06-16-2011, 09:26 AM

this has been resolved. if i understood correctly the problem was that software and parser for xml truncated to certain number of bytes and utf8 uses more bytes for a single letter (what a waste). so the last one became 'malformed'.

MTK358 · 06-16-2011, 09:45 AM

Quote:

Originally Posted by qrange

utf8 uses more bytes for a single letter (what a waste).

It's not a waste.

It uses only one byte for ASCII characters, then adds more bytes as needed only for certain characters.

If not for encodings like UTF-8 that have variable-length characters, every character would have to be big enough to store the highest posible value. Now that would be a waste.