Skip to content

iris-eval/mcp-server

MCP Developer Tools

An open‑source MCP server that evaluates AI agent outputs for safety, completeness, relevance and cost.

TypeScript Latest v0.4.4 · 1mo ago Security brief →

Features

  • Trace logging with hierarchical span trees showing latency, token usage and USD cost per tool call (SQLite storage).
  • Built‑in evaluation rules covering completeness, relevance, safety (PII detection, prompt injection), and cost budgets.
  • Real‑time web dashboard for visualizing traces, eval results and budget overruns.

Recent releases

View all 20 releases →
No immediate action
v0.4.4 Breaking risk

Distribution completion

Review required
v0.4.3 Mixed
Auth RBAC Dependencies

SBOMs + dependency updates

Review required
v0.4.0 New feature
Dependencies

SBOMs + provenance

No immediate action
v0.3.0 New feature

Playground act summary pills

No immediate action
v0.2.2 Bug fix

Blog sort by date

Weekly OSS security release digest.

The CVE patches and breaking changes that affected production tools this week. One email, every Sunday.

No spam, unsubscribe anytime.

About

Stars
8
Forks
2
Languages
TypeScript JavaScript CSS
Downloads/week
103 ↓64%
NPM Maintainers
1 Single npm maintainer
Contributors
2
TypeScript
Types included ✓

Install & Platforms

Install via
npm

Beta — feedback welcome: [email protected]