eval-audit

Maintained by hamelsmu

Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsure whether evals are trustworthy, or as a starting point when no eval infrastructure exists. Do NOT use when the goal is to build a new evaluator from scratch (u

Current version: Unknown
License: Unknown
Network access: Unknown / not assessed
Review status: Not verified

Problem it solves

This catalog entry helps users find and evaluate eval-audit for the task described by its available catalog summary. Confirm the exact scope in the linked original source when one is available.

When to use it

Consider eval-audit when its available catalog summary matches the task at hand. When available, review the linked original source before use for precise instructions, requirements, and limitations.

eval-audit is listed as an agent skill in RefHub. The listed maintainer is hamelsmu. The available catalog summary is: Audit an LLM eval pipeline and surface problems: missing error analysis, unvalidated judges, vanity metrics, etc. Use when inheriting an eval system, when unsure whether evals are trustworthy, or as a starting point when no eval infrastructure exists. Do NOT use when the goal is to build a new evaluator from scratch (u When available, review the linked original source for exact usage instructions, required tools, and limitations.

Installation and updates

These commands are displayed for copying only and are never executed on RefHub servers. Review the linked upstream source before running them.

Install command

npx skills add hamelsmu/evals-skills --skill eval-audit -y

Agent compatibility

No compatibility test has been recorded

Do not assume agent compatibility until documented test evidence is available.