Add

• unic-ucd-name_aliases: Unicode Name Alias character properties.

Changed

• unic-cli: Fallback to Name Alias for characters without Name value.

Fixed

• ucd-ident: Use correct data table for PatternWhitespace property.
  [GH-254]

Misc

• Use external git submodules for source data.

• Migrate to Rust 2018 Edition.

Add

• unic-ucd-name_aliases: Unicode Name Alias character properties.

Changed

• unic-cli: Fallback to Name Alias for characters without Name value.

Fixed

• ucd-ident: Use correct data table for PatternWhitespace property. [GH-254]

Misc

• Use external git submodules for source data.

• Migrate to Rust 2018 Edition.

New Components

• unic-ucd-block: List of all Unicode Blocks and the property assigning a block to each character.

• unic-ucd-hangul: Unicode Hangul Syllable detection and Composition/Decomposition algorithms.

Other Updates

• unic-ucd-name: Complete implementation for Unicode Name Property, with addition of Hangul and CJK Han names, as defined by The Unicode Standard.

Notes

• This is the last release of the project before migration to Rust 2018 Edition.

• Special thanks for Yan Li (@eyeplum) for implementing most of the features in this release.

Added

• unic-ucd-block: List of all Unicode Blocks and the property assigning a block to each character.

• unic-ucd-hangul: Unicode Hangul Syllable detection and Composition/Decomposition algorithms.

Changed

• unic-ucd-name: Complete implementation for Unicode Name Property, with addition of Hangul and CJK Han names, as defined by The Unicode Standard.

Misc

• This is the last release of the project before migration to Rust 2018 Edition.

• Special thanks for Yan Li (@eyeplum) for implementing most of the features in this release.

UNIC Applications

UNIC Applications are binary creates hosting in the same repository as unic super-crate, under the apps/ directory. These creates are not internal parts of the unic library, but tools designed and developed for the general audience, also serving as a test bed for the UNIC API. We are starting with CLI applications, and possibly expanding it to GUI and WEB applications, as well.

• [unic-cli] The new UNIC CLI application provides command-line tools for working with Unicode characters and strings. In this release, first versions of unic-echo and unic-inspector commands are implemented.

New Components

Character Property

• [unic-ucd-common ] Common character properties (alphabetic, alphanumeric, control, numeric, and white_space).
• [unic-ucd-ident] Unicode Identifier character properties.
• [unic-ucd-segment] Unicode Segmentation character properties.
• [unic-emoji-char] Unicode Emoji character properties.

String Algorithm

• [unic-segment] Implementation of Unicode Text Segmentation algorithms (Grapheme Cluster and Word boundaries).

Other Updates

This release was delayed for a couple of cycles, because of the problems with running tests in a workspace with a mix of std and no-std creates. The issue is resolved as of 1.22.0.

• Enable no_std for many of the existing components.
• Bumped minimum Rust to 1.22.0.
• Lots of small fixes for data types and internal structure updates.

Added

UNIC Applications

UNIC Applications are binary creates hosting in the same repository as unic super-crate, under the apps/ directory. These creates are not internal parts of the unic library, but tools designed and developed for the general audience, also serving as a test bed for the UNIC API. We are starting with CLI applications, and possibly expanding it to GUI and WEB applications, as well.

• unic-cli The new UNIC CLI application provides command-line tools for working with Unicode characters and strings. In this release, first versions of unic-echo and unic-inspector commands are implemented.

New Components

Character Property:

• unic-ucd-common : Common character properties (alphabetic, alphanumeric, control, numeric, and white_space).

• unic-ucd-ident: Unicode Identifier character properties.

• unic-ucd-segment: Unicode Segmentation character properties.

• unic-emoji-char: Unicode Emoji character properties.

String Algorithm:

• unic-segment: Implementation of Unicode Text Segmentation algorithms (Grapheme Cluster and Word boundaries).

Misc

This release was delayed for a couple of cycles, because of the problems with running tests in a workspace with a mix of std and no-std creates. The issue is resolved as of 1.22.0.

• Enable no_std for many of the existing components.

• Bumped Minimum Rust Version needed to 1.22.0.

• Lots of small fixes for data types and internal structure updates.

New components and modules

Abstractions for working with characters

• [unic-char-range] Range and iterator types for characters, plus a chars!() macro. (Used as chars!('a'..'e'), chars!('a'..='e'), or chars!(..).)
• [unic-char-property] New component based on the module previously in unic-utils, with new support for binary character properties.

Extending Unicode Character Database properties

• [unic-ucd-name] New minimal implementation of Unicode character names (Name property).
• [unic-ucd-case] New basic implementation of Unicode character case properties.
• [unic-ucd-bidi] Add Bidi_Mirrored and Bidi_Control properties.

Dropped components and modules

• Drop unic-utils's iter_all_chars() in favor of unic-char-range types and macros.

Other updates

• All tables are now generated by the Rust pipeline! 🎉
• The Rust table generation has been cleaned up to a very nice level of polish! ✨
• [unic-utils] Restructure tables into a dedicated type, rather than a mix of traits and "blessed" std types.

Added

Abstractions for working with characters:

• unic-char-range: Range and iterator types for characters, plus a chars!() macro. (Used as chars!('a'..'e'), chars!('a'..='e'), or chars!(..).)

• unic-char-property: New component based on the module previously in unic-utils, with new support for binary character properties.

Extending Unicode Character Database properties:

• unic-ucd-name: New minimal implementation of Unicode character names (Name property).

• unic-ucd-case: New basic implementation of Unicode character case properties.

• unic-ucd-bidi: Add Bidi_Mirrored and Bidi_Control properties.

Removed

• Drop unic-utils's iter_all_chars() in favor of unic-char-range types and macros.

Misc

• All tables are now generated by the Rust pipeline! 🎉

• The Rust table generation has been cleaned up to a very nice level of polish! ✨

• unic-utils: Restructure tables into a dedicated type, rather than a mix of traits and "blessed" std types.