EvalsOpen source

lm-evaluation-harness

EleutherAI's unified framework for benchmarking generative language models.

About the tool

EleutherAI's unified framework for benchmarking generative language models.

The lm-evaluation-harness provides a unified interface for testing language models across hundreds of standardized evaluation tasks, and is the backend used by the Open LLM Leaderboard. It supports config-based task creation and a wide range of model backends under an MIT license.

Pricing: Open source
Category: Evals
Maker: Not publicly supplied
Provenance: Indexed by PageVerified from public information

For the maker

Featured placement starts as soon as payment confirms. Outbound links are marked sponsored while featured.

Feature for 7 days · $39 Feature for 30 days · $99

Backlink artifact

Show the Attested badge.

This badge links to the public evidence record. The link is followed; the verification claim remains limited to the checks shown above.

Embed HTML

<a href="https://pageverified.com/t/lm-evaluation-harness"><img src="https://pageverified.com/badge/lm-evaluation-harness" alt="Attested — verified by PageVerified"></a>

Same category

Similar verified tools.

Verified listing

EvalsPaid

Datadog LLM Observability

LLM and agent observability within the Datadog platform.

Verified 25 Aug 2026 · Indexed by PageVerified

ARVerified listing

EvalsFreemium

Arthur

Enterprise AI monitoring, evaluation, and governance platform.

Verified 25 Aug 2026 · Indexed by PageVerified

Verified listing

EvalsFreemium

Maxim AI

End-to-end agent simulation, evaluation, and observability platform.

Verified 25 Aug 2026 · Indexed by PageVerified