A RubyLLM plugin that enables local LLM execution using the Red Candle gem. Run quantized GGUF models directly in Ruby without external API calls. Supports streaming, structured output, and multiple model architectures including Gemma, Llama, Qwen, Mistral, and Phi.
Required Ruby Version
>= 3.1.0
Authors
Chris Petersen
