Dépendances inversées pour tokenizers Latest version of the following gems require tokenizers
informers 1.2.1
Fast transformer inference for Ruby
2 289 136 Téléchargements
discourse_ai-tokenizers 0.3.1
A Ruby gem providing a consistent interface for various AI/ML tokenizers including Open...
43 240 Téléchargements
llm_memory 0.1.14
LLM Memory is a Ruby gem designed to provide large language models (LLMs) like ChatGPT ...
18 364 Téléchargements
transformers-rb 0.1.6
State-of-the-art transformers for Ruby
2 776 Téléchargements
clip-rb 1.1.0
OpenAI CLIP embeddings, uses ONNX models. Allows to create embeddings for images and text
2 684 Téléchargements
vectorsearch 0.1.2
Vector Search backed by your vector search DB of choice.
1 662 Téléchargements
token_estimator 0.1.2
TokenEstimator is a Rails gem that allows you to count tokens in Excel, CSV, PDF, TXT, ...
986 Téléchargements
kiribi-multilingual_e5-small 0.0.2
Easy to use some onnx models.
233 Téléchargements