# claude plugin eval Command

> It tests how much a plugin helps, with scored cases.

**Field:** Artificial Intelligence  
**Category:** Claude Code  
**Also known as:** claude plugin eval, Plugin evals

## Think of it like

It is like you run in new shoes, then in old ones. Then you see if the new pair helps.

## Definition

claude plugin eval tests whether a plugin does the job it was made for. Each test case is a prompt plus graders that score the answer. Claude Code runs each case several times in a clean session with only that plugin loaded. By default it also runs the case without the plugin, so the report shows how much the plugin helps.

## Example

Lucy changes a skill in her plugin. claude plugin eval shows the new version passes more cases than the old one, and both beat running with no plugin.

## Example code

```bash
claude plugin eval ./my-plugin
```

Run the plugin's test cases.

## Why it matters

A change to a skill can make it worse in ways you do not notice by hand. Scored runs show it.

## Common mistake

Running each case once. Answers vary, so the report runs each case several times. Read the spread, not one result.

## Three principles

- **Prompt plus graders.** Each case.
- **Many runs.** In a clean session.
- **With and without.** Shows the gain.

## Related terms

- [claude plugin validate Command](https://learn.benibix.com/term/ai/claude-plugin-validate-command)
- [Claude Code Plugin](https://learn.benibix.com/term/ai/claude-code-plugin)
- [Claude Code Skill](https://learn.benibix.com/term/ai/claude-code-skill)

## Told apart from

- [claude plugin validate vs claude plugin eval](https://learn.benibix.com/compare/claude-plugin-validate-command-vs-claude-plugin-eval-command): People think a plugin that passes claude plugin validate is a plugin that works. Validate only checks the shape of the files: the manifest, and the skills, agents and commands in the folder. claude plugin eval runs prompts through the plugin many times and scores the answers, with it and without it. So it shows if the plugin helps. A plugin can pass validate and still make Claude worse. Run validate on each change, and eval when what it does changes.

## Taught in

- [The claude plugin Commands](https://learn.benibix.com/learn/ai-claude-code-commands/claude-plugin-commands): Claude Code Commands, 13/17

---

Source: https://learn.benibix.com/term/ai/claude-plugin-eval-command
Author: Behnia Zarei (a developer in Vienna, Austria, who builds and teaches data, AI and business intelligence at BENIBIX)
Publisher: BENIBIX Learn (https://learn.benibix.com/)
Last updated: 2026-11-16
Licence: CC BY 4.0 (https://creativecommons.org/licenses/by/4.0/). Quote freely with attribution.
