edit/tools/grapheme-table-gen
2025-05-22 21:59:10 +02:00
..
src Fix various spelling errors (#206) 2025-05-22 21:59:10 +02:00
Cargo.lock Initial import 2025-03-19 03:13:50 +01:00
Cargo.toml Initial import 2025-03-19 03:13:50 +01:00
README.md Document everything 2025-05-16 01:12:59 +02:00

Grapheme Table Generator

This tool processes Unicode Character Database (UCD) XML files to generate efficient, multi-stage trie lookup tables for properties relevant to terminal applications:

  • Grapheme cluster breaking rules
  • Line breaking rules (optional)
  • Character width properties

Usage

  • Download ucd.nounihan.grouped.zip
  • Run some equivalent of:
    grapheme-table-gen --lang=rust --extended --no-ambiguous --line-breaks path/to/ucd.nounihan.grouped.xml
    
  • Place the result in src/unicode/tables.rs