Anthropic Adds Plugin Evaluation Framework to Claude Code with 6 Grader Types and CI Integration

Loading…

Anthropic has shipped a plugin evaluation system for Claude Code that includes six distinct grader types, a no-plugin baseline for controlled comparison, and a CI gate that can block deployments when plugin-added skills regress. This gives developers building on top of Claude Code a structured, automated way to verify that their plugins are genuinely improving model capability rather than degrading it. The no-plugin baseline is particularly valuable — it lets teams measure the marginal contribution of each plugin with statistical rigor rather than relying on subjective impression. The CI gate integration means quality checks can be embedded directly into deployment pipelines, making plugin quality a first-class engineering concern. This is a significant tooling upgrade for the growing ecosystem of developers extending Claude Code for production use cases.