Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yeah, looks like Textmate is simply running the UTF-8 algorithm over UTF-16 code units, so each surrogate is being turned into a single UTF-8 code unit (which decodes to an invalid character).

It turns out that this is such a common mistake that there's even a name for this encoding, CESU-8: http://en.wikipedia.org/wiki/CESU-8



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: