Evalution

Evalution is a local-first development tool. Maintain your prompts directly in your codebase, and use the web playground to edit parameters, switch models, and see results in real time, so what you test is exactly what ships.

📖 Documentation: evalut.io/n/docs

Features

🔍 Auto-discovery — scans your project for .prompt.ts files
🔄 Always in sync — edit prompts in the UI or directly in the source files; they always stay in sync
🎯 Type-safe — full TypeScript support with parameter inference
🔌 Multi-provider — Vercel AI SDK is fully supported, or wire up a different SDK adapter
📊 Tracing — traces for your prompt runs populate in realtime
🧩 Extensible — swap in your own prompt sources, SDK adapters, and trace backends

Getting started

Run this in the root of your project:

npx evalution

Requires Node.js 22.18.0 or higher.

See the documentation for more detailed guidance.

Development

Install dependencies: npm install
Run server and client against the evalution check out: npm run dev
Run against a different path:

npm run dev:server -- ui <path>
npm run dev:client

Other useful commands:

npm test — run unit tests (npm run test:coverage for coverage)
npm run test:ui — run Playwright component tests
npm run typecheck — type-check the project
npm run docs — regenerate the API reference
npm run build — build the server and client

License

AGPL