surrealdb / lexicmp

Library for comparing and sorting strings lexicographically

lexicmp

The lexicmp library enables comparing and sorting strings using lexicographical and natural sorting semantics. This means that any Unicode characters such as á or ß are treated like their closest ASCII character: á is treated as a, ß is treated as ss. This library also ensures that emojis are transliterated before being sorted. When using natural sorting, numbers are sorted naturally, ensuring that 50 is sorted before 100, skipping characters that aren't alphanumeric, ensuring that f-5 is next to f5. If different strings have the same ASCII representation (e.g. "Foo" and "fóò"), it falls back to the default method from the standard library, ensuring that sorting is always deterministic, and constitute a total order.

Features

• Compare strings lexicographically
• Compare strings naturally with support for numbers
• Compare strings sensitively and case insensitively
• Compare strings, skipping non-alphanumeric characters
• Compare strings lexicographically and naturally together
• Handle unicode characters, foreign languages, and emoji characters
• Does not allocate memory on the heap, instead using iterators

Original

This code is forked originally from lexical-sort, licensed under the Apache 2.0 and MIT licenses.

lexicmp's Issues

Panic due to attempt to multiply with overflow

Hi,

when comparing strings using natural_lexical_cmp, the code can cause a attempt to multiply with overflow panic when the strings contain a number long enough to overflow a u64.

It might be best to just fall back to simple character comparison if a number exceeds a certain length.