tokenkit 0.1.0.pre.1

TokenKit provides lightweight, Unicode-aware word-level tokenization with pattern preservation, backed by Rust for performance.

Gemfile:
=

安裝:
=

版本列表:

0.1.0.pre.1 September 29, 2025 (38.5 KB)

Runtime 相依性套件 (1):

rb_sys ~> 0.9

Development 相依性套件 (5):

rake ~> 13.0

rake-compiler ~> 1.2

rspec ~> 3.0

simplecov ~> 0.22

standard ~> 1.3

Show all transitive dependencies

擁有者:

推送者:

作者:

Chris Petersen

SHA 256 總和檢查碼:

=