Regression testing for AI agents. Snapshot behavior,diff tool calls,catch regressions in CI. Works with LangGraph, CrewAI, OpenAI, Anthropic.

Benchmarking the gap between AI agent hype and architecture. Three agent archetypes, 73-point performance spread, stress testing, network resilience, and ensemble coordination analysis with statistical validation.

TraitBasis applied to TauBench

Deterministic runtime for agent evaluation

A curated collection of the world’s most advanced benchmark datasets for evaluating Large Language Model (LLM) Agents.

University for AI agents. 92 courses, 4400+ scenarios, any model via OpenRouter. Auto-training loops generate per-model SKILL.md documents. Works with Claude Code, OpenClaw, Cursor, Windsurf. No fine-tuning required.

The open benchmark for AI agent task execution. Claude Code vs Gemini CLI — who wins? Live leaderboard inside.

Deterministic evaluation environment for AI code reviewers covering bugs, security (OWASP), and architecture via FastAPI + OpenEnv.

🧠 Discover and evaluate advanced benchmark datasets for Large Language Model agents to enhance performance assessment in real-world tasks.

A community catalog of autonomous agents and bundles certified by passing TraceCore deterministic episode runs in public CI

AI Arena is a competitive evaluation framework where multiple AI agents answer the same set of questions under identical conditions. Their performance is scored, ranked, and tracked over time using two complementary metrics AIQ and ELO

OWLViz: An Open-World Benchmark for Visual Question Answering

OpenEnv benchmark for broken ELT/ETL pipeline repair, online recovery, and temporal orchestration.

Multimodal evaluation benchmark for AI agents in real-world field operations across 16 trades (HVAC, electrical, plumbing, roofing, solar, mining, oil & gas, marine, telecom, automotive, construction, and more). 194 cases; scores retrieval, code citation, jurisdiction, safety, trajectory, multi-turn, speed; 5-layer contamination defense.

AI benchmark for real-world inbox prioritization and decision-making

🤖 Benchmark AI agent capabilities, bridging the gap between hype and reality with clear metrics and insights for informed development decisions.

BenchClaw - Multi-Dimensional AI Agent Benchmark. Connect any LLM agent (Claude, GPT, Gemini, Kimi, Qwen, DeepSeek...) to the P2PCLAW network and get scored on 10 dimensions + Tribunal IQ. Works as VS Code/Cursor/Windsurf extension, CLI, browser extension, Claude skill, Pinokio app, or plain copy-paste prompt.

Delta-V: A tactical space combat game with realistic vector physics and orbital mechanics. Command your fleet across the inner Solar System.

VeritasOps is a real-world OpenEnv benchmark for training and evaluating AI agents on misinformation moderation, claim verification, spread control, and content safety decision-making.

Agent Trial Bench (ATB) is a continuous evaluation framework for AI agents. It features process-aware grading, multi-trial variance detection, and CI/CD integration. Built with a domain-agnostic architecture, it ships with General and domain-specific plugins out of the box, allowing you to easily add custom vertical-specific validators