Tokenizer for most common cases of tokenization

Required Ruby Version

>= 3.0

Authors

David Siaw

Versions

  1. 0.1.0

    1. source

      1. 0.1.0 source July 22, 2026 (6.5 KB)

Pushed by

astrobunny

SHA 256 checksum