CompletionKit is a prompt testing platform that runs as a Rails engine or a standalone app. Run prompts against real datasets, score every output with an LLM judge against criteria you define, track prompt versions, and get AI-generated improvement suggestions grounded in your actual results. Includes a web UI, REST API, and a built-in MCP server with 34 tools.
Required Ruby Version
>= 3.2.0
Authors
Damien Bastin
Versions
- 0.28.5 July 17, 2026 (271 KB)
- 0.28.4 July 16, 2026 (271 KB)
- 0.28.3 July 15, 2026 (270 KB)
- 0.28.2 July 15, 2026 (270 KB)
- 0.28.1 July 15, 2026 (270 KB)
- 0.25.1 July 06, 2026 (263 KB)
