Digits ('0', '1', etc.) are interpreted as emojis about rust-unic

[eyeplum]

Looks like there might be a bug when generating https://github.com/open-i18n/rust-unic/blob/master/unic/emoji/char/tables/emoji.rsv#L6 so that U+0030..U+0039 were mistakenly extracted out from the original UCD file (https://github.com/open-i18n/data-unicode-ucd/blob/master/data/EmojiSources.txt).

I believe U+0030..U+0039 are only considered as emojis when they are followed by U+20E3.

[eyeplum]

I believe the cause is that https://github.com/open-i18n/rust-unic/blob/master/gen/src/source/emoji/emoji_data.rs#L54 reuses the regex for parsing other binary properties (source::ucd::BINARY_PROPERTIES_REGEX) however the UCD file for emoji sources has a slightly different format (or rather the code points are represented as a sequence instead of a range).

[estebank]

This might also be the reason # is considered an emoji, which caused a parsing regression when trying to recover identifiers with emoji in rustc. We're side-stepping the issue by ensuring ASCII chars are never considered emoji in our end.

[thomcc]

I'm not aware of the specifics of the unicode standard, but I believe that '0' is not an emoji.

Unfortunately, they (along with #, *, among others) have the Emoji unicode property, so this is somewhat incorrect. I don't think this is a bug so much as a non-intuitive API.