GitHub Copilot Evals
InstallSearch /github/evals

What's included

Understand the parts of your Evals installation.

PartWhat it doesSetup
PluginAdds Evals instructions and tools to CopilotInstall the Plugin
SkillsSix skills: Create, Review, Improve, Run, Compare and SetupSkills & agents
ExtensionPuts evals and results in VS CodeVS Code extension
Canvas workbenchProject files, drafts, run controls and visual comparisonSet up Canvas
Command-line runner / CIRuns supported saved tests automaticallyAdd evals to CI
MCP connectionLets your app use the shared Evals toolsMCP setup
SamplesSkills, agents and tools using made-up project dataTry the samples

Canvas is a workbench, not a separate runner. The VS Code extension includes the Plugin.

Terms and developer libraries

A skill supplies repeatable instructions; an agent has a role and tools. MCP connects apps to tools. Evals can test the sample agents and servers; they do not add Evals commands. Core and Runtime are libraries for integration developers. Developer reference.

These layers work together: a plugin can distribute a skill and a tool connection, and an agent can use both. Choose the Evals Plugin for supported Copilot workflows; choose standalone MCP for another local tool-capable host. Compare concrete scenarios and MCP limits.

Packages

Download packages from releases. Read the notes and requirements before installing. Use the file checksums in SHA256SUMS to verify your download matches the published copy.

Run your first eval after setup. Review files before saving and approve execution separately.