CompletionKit is a prompt testing platform that runs as a Rails engine or a standalone app. Run prompts against real datasets, score every output with an LLM judge against criteria you define, track prompt versions, and get AI-generated improvement suggestions grounded in your actual results. Includes a web UI, REST API, and a built-in MCP server with 53 tools.
Required Ruby Version
>= 3.2.0
Authors
Damien Bastin
Versions
-
0.29.1
-
source
- 0.29.1 source October 14, 2026 (300 KB)
-
-
0.29.0
-
source
- 0.29.0 source October 14, 2026 (297 KB)
-
-
0.28.46
-
source
- 0.28.46 source October 14, 2026 (289 KB)
-
-
0.28.45
-
source
- 0.28.45 source October 14, 2026 (288 KB)
-
-
0.28.44
-
source
- 0.28.44 source October 13, 2026 (285 KB)
-