Provide an API that support wide characters about hashids.c

[tzvetkoff]

Well, to all my understanding, Hashids was (at least at first) meant to encode IDs to a URL-compatible string.
Wide characters, along with UTF8, are something that's much more complicated to even consider.
From what I've checked, only the JS implementation got this correctly.
And if we're thinking of multibyte support, we'd better go with UTF8.

[tzvetkoff]

@ivanakimov, can you give us a follow-up?
Do we need multibyte support in Hashids?
Also, if needed, don't we need to (shoot in the dark) release it as, say, 2.0, and give the users the ability to define their own "separators" - "cfhistuCFHISTU" works well for english words, but try that in cyrillic.

[thedrow]

The Python implementation handles Unicode correctly as well.

[jd327]

@tzvetkoff I'm not sure I'm qualified to talk about best way to implement this in C, but regarding the custom separators, that would have to be a part of the next major release (along with faster consistent shuffle, and better handling of large numbers).

It's on my todo.

[randolf]

For URL compatibility you'll want to look into PunyCode.

Of course, Unicode characters somewhat defeats the purpose of shortening numbers down to shorter strings since more 8-bit bytes are needed to store Unicode sequences.

[edescourtis]

Any progress on this?

[thedrow]

No. I didn't have a need for it eventually.
Feel free to contribute :)