Evidence BenchmarksSubmit a platform

Open benchmarks for evidence synthesis

How accurately do platforms find, read and summarise development research? Each benchmark scores them against what published reviews concluded.

Open to allPut your platform on the leaderboardAnswer the questions, run the public scorer, open a pull request. We publish what you submit.Gold from published reviewsEvery gold value is quoted, with its page, from a published review or dataset. Nobody labels by hand.

Changelog

Nothing yet.

Method

Gold from published work

Every gold value is what a published review, dataset or guideline says, with a verbatim quote and its page. Where the source says nothing, the gold says nothing.

The same questions and scorer

Every platform answers the same questions in the same format, and scores them with the same public scorer.

Trusted, self-run submissions

Each platform runs the benchmark itself and submits its answers and scores. † marks a run whose platform had seen the gold or its sources before answering.

Built 2026-11-20.