tokenizers 0.4.0
Fast state-of-the-art tokenizers for Ruby
Gemfile:
=
复制到剪贴板
已复制!
安装:
=
版本列表:
- 0.5.3 - September 17, 2024 x86_64-linux (5.9 MB)
- 0.5.3 - September 17, 2024 x86_64-linux-musl (5.9 MB)
- 0.5.3 - September 17, 2024 x86_64-darwin (6.2 MB)
- 0.5.3 - September 17, 2024 x64-mingw-ucrt (8.1 MB)
- 0.5.3 - September 17, 2024 arm64-darwin (5.9 MB)
- 0.4.0 - September 21, 2023 (37.5 KB)