JSPM

Mastra is a framework for building AI-powered applications and agents with a modern TypeScript stack.

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

SDK for Hamming Evals Framework

Model graded evals with typescript

A library for running evaluations for AI use cases

eval-genius enables evals of arbitrary async code. It is generally intended for making multiple assertions on outputs which are generated nondeterministically. These assertions can be used to score algorithms on their effectiveness.

Umbrage Evals CLI

Modular LLM orchestration framework

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

Test your LLM-powered apps with a TypeScript-native, Vitest-based eval runner. No API key required.

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

Gentrace Evals plugin for Node.JS

Whitecircle.ai tools for judge-style evaluations and rubric scoring.

Whitecircle.ai components for LLM-as-a-judge scoring and rubric-based evals.

Langchain Integration for Hamming SDK

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

The core foundation of the Mastra framework, providing essential components and interfaces for building AI-powered applications.

Evals as an API - The easiest way to evaluate and benchmark AI models and systems