Skip to content
BENIBIX Learn

claude plugin eval Command

Also known as claude plugin eval, Plugin evals

It tests how much a plugin helps, with scored cases.

Think of it like

It is like you run in new shoes, then in old ones. Then you see if the new pair helps.

Example

Lucy changes a skill in her plugin. claude plugin eval shows the new version passes more cases than the old one, and both beat running with no plugin.

Why it matters

A change to a skill can make it worse in ways you do not notice by hand. Scored runs show it.

Definition

claude plugin eval tests whether a plugin does the job it was made for. Each test case is a prompt plus graders that score the answer. Claude Code runs each case several times in a clean session with only that plugin loaded. By default it also runs the case without the plugin, so the report shows how much the plugin helps.

Example code

bash
claude plugin eval ./my-plugin
Run the plugin's test cases.

Common mistake

Running each case once. Answers vary, so the report runs each case several times. Read the spread, not one result.

Key takeaways

  1. 1
    Prompt plus graders. Each case.
  2. 2
    Many runs. In a clean session.
  3. 3
    With and without. Shows the gain.

Compare

Learn it properly