red-candle 1.3.0
Ruby gem for running state-of-the-art language models locally. Access LLMs, embeddings, rerankers, and NER models directly from Ruby using Rust-powered Candle with Metal/CUDA acceleration.
Gemfile:
=
install:
=
Runtime Dependencies (1):
rb_sys
>= 0
Development Dependencies (9):
informers
>= 0
minitest
>= 0
rake
>= 0
rake-compiler
>= 0
redcarpet
~> 3.6
rspec
~> 3.13
simplecov
>= 0
yard
>= 0
yard-rustdoc
>= 0
Requirements:
Rust >= 1.85