A RubyLLM plugin that enables local LLM execution using the Red Candle gem. Run quantized GGUF models directly in Ruby without external API calls. Supports streaming, structured output, and multiple model architectures including Gemma, Llama, Qwen, Mistral, and Phi.

Required Ruby Version

>= 3.1.0

Authors

Chris Petersen

Versions

  1. 0.2.1

    1. source

      1. 0.2.1 source June 20, 2026 (21.5 KB)
  2. 0.2.0

    1. source

      1. 0.2.0 source March 27, 2026 (21.5 KB)
  3. 0.1.0

    1. source

      1. 0.1.0 source December 11, 2025 (19 KB)

Pushed by

cpetersen

SHA 256 checksum

← Previous version