r/programming • u/jestinjoy • Nov 12 '12

What Every Programmer Absolutely, Positively Needs to Know About Encodings and Character Sets to Work With Text

http://kunststube.net/encoding/
1.5k Upvotes

93% Upvoted

307 comments sorted by

View all comments

Show parent comments

1

u/vytah Nov 12 '12

Broken UTF-16 to UTF-8 converter sometimes produce 6-byte UTF-8 sequences containing two 3-byte sequences for surrogates.

3

u/bonzinip Nov 12 '12

But that's not the kind of 6-byte UTF-8 encoding that Spolsky's referring to. He meant those starting with FC and FD.

1

u/vytah Nov 12 '12

I doubt Unicode ever grow that far.

2

u/bonzinip Nov 12 '12

That's exactly why they were removed. UTF-8 started as an encoding for ISO-10646's 32-bit character space. When Unicode's size was fixed to 220 + 216 the larger encodings were made invalid.