huggingface-community-evals

Maintained by openai

Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation.

Current version: Unknown
License: Unknown
Network access: Unknown / not assessed
Review status: Not verified

Problem it solves

This catalog entry helps users find and evaluate huggingface-community-evals for the task described by its available catalog summary. Confirm the exact scope in the linked original source when one is available.

When to use it

Consider huggingface-community-evals when its available catalog summary matches the task at hand. When available, review the linked original source before use for precise instructions, requirements, and limitations.

huggingface-community-evals is listed as an agent skill in RefHub. The listed maintainer is openai. The available catalog summary is: Run evaluations for Hugging Face Hub models using inspect-ai and lighteval on local hardware. Use for backend selection, local GPU evals, and choosing between vLLM / Transformers / accelerate. Not for HF Jobs orchestration, model-card PRs, .eval_results publication, or community-evals automation. When available, review the linked original source for exact usage instructions, required tools, and limitations.

Installation and updates

These commands are displayed for copying only and are never executed on RefHub servers. Review the linked upstream source before running them.

Install command

uv --version

Agent compatibility

No compatibility test has been recorded

Do not assume agent compatibility until documented test evidence is available.