|
EvalView – pytest for AI Agents | Open Source Agent Testing Framework
EvalView is an open-source testing framework that brings pytest-style workflows to AI agents. Generate tests, track regressions, and keep tool-calling agents...
|
80 % |
|
Dan Krawczun
Agentic AI workflows for enterprise teams, built end-to-end: process mapping, requirements, tooling, regression-tested implementation, and adoption support....
|
79 % |
|
Agent Jig — Test your AI agent before your users do.
Evaluation and testing framework for AI agents. Define test scenarios in YAML, run against your agent in CI, get pass/fail scores and regression diffs.
|
79 % |
|
Taso · Test every agent change before production
Compare model, prompt, tool, and MCP changes in repeatable agent evaluations. Inspect release evidence and preview Auto-Eval: production traces into team-rev...
|
79 % |
|
EvalDog — catch LLM regressions before your users do
Hosted prompt & RAG evaluation. Upload your test cases, get a graded pass/fail report in seconds. Plus a zero-token CLI for CI and AI agents.
|
79 % |
|
DProvenanceKit — On-device provenance & signed attestation for Swift AI
Turn every AI run into a queryable, diffable, cryptographically signed trace. Catch the silent regressions on-device AI ships — a dropped tool call, a skippe...
|
79 % |
|
Migration Assurance | Evidence-grade sign-off for model swaps and agent deployments.
Evidence-grade sign-off for model swaps and agent deployments.
|
79 % |
|
DrivBox: Ship AI agents without breaking production
DrivBox tests every agent change against your production baseline, so you catch behavioral regressions, unsafe tool usage, permission changes, and cost incre...
|
78 % |
|
Vizra Evals — Agent Evals for the Laravel AI SDK, Written in Pest
Built for the official Laravel AI SDK: write agent evals as Pest tests, record every run — scores, judge reasoning, cost — and fail CI on regressions instead...
|
78 % |
|
Regres.ai — Regression testing & live monitoring for AI decision systems
Stop AI workflows from quietly drifting. Field-level regression tests and production monitoring for AI decision systems in regulated industries — pharmacy, c...
|
78 % |
|
Veval — LLM Regression Testing
Veval captures real production traces and turns them into a regression baseline. When your prompt changes, know what broke before your users do.
|
78 % |
|
Isolate — Pinpoint which component improved your AI agent
Isolate tells AI developers which part of their agent is working. Run controlled experiments to attribute performance changes to specific components.
|
78 % |
|
ReliAgent — know if your agent's last move actually worked
ReliAgent checks every AI agent tool call for hallucination, repetition loops, schema violations, confidence collapse, and four more failure modes — one POST...
|
78 % |
|
Know when your AI gets worse, before your users do | EvalCore
EvalCore is snapshot testing for AI behavior. Record how your LLM app or agent behaves, then replay it in CI on every change: offline, deterministic, $0.
|
78 % |
|
Coldcache — reproducible AI answers, pinned to a version
An answer engine with live web search, cited sources and streaming answers — where every chat is pinned to an immutable agent version and runs with zero carr...
|
78 % |
|
Provara — The Adaptive LLM Gateway
Routes every request. Learns from every response. Catch provider regressions, cut spend at equal quality, and answer 'why did our bill double?' in one screen...
|
77 % |
|
Orq AI - Ship agent changes without guessing
Orq AI traces every agent run, scores it against your eval suites, and holds the release when a regression shows up. Ship AI agent changes with confidence.
|
77 % |
|
Vynaris — same quality, a fraction of the cost
Cut AI costs drastically without compromising on privacy or reliability. Vynaris routes each request to the cheapest model that clears your quality bar.
|
77 % |
|
Laminar - Open-source observability for AI agents
Open-source platform to trace, evaluate, and debug AI agents. Laminar surfaces agent failures, and helps you fix them.
|
77 % |
|
modelmeter — The AI Changelog
The AI Changelog. Source-verified deprecations, sunsets, silent model swaps, and price changes - with countdowns, migration targets, and receipts. Built for...
|
77 % |
Detected social media networks