riktoken 0.0.1

A pure Ruby implementation of OpenAI's tiktoken library for BPE tokenization

Gemfile:
=

安装:
=

版本列表:

0.0.1 June 04, 2025 (14.5 KB)

Runtime 依赖 (1):

base64 >= 0

显示所有传递性依赖

所有者:

推送者:

作者:

moznion

SHA 256 校验和:

=