huggingface-community-evals

Run evaluations for Hugging Face Hub models locally using inspect-ai and lighteval on your hardware. Intended for backend selection, local GPU evaluations, and choosing between vLLM, Hugging Face Transformers, and accelerate. Not intended for HF Jobs orchestration, model-card PRs, publishing .eval_results, or automating community-evals.