Impact measurement & evaluation

Evidence Hierarchy

A ranked ordering of research methods by the strength of evidence they produce, used to judge how much confidence to place in evaluation findings.

Established (concept); adapted use in sustainability · Version 0.1

Expert review openNo editor-accepted expert review yet

Definition

An evidence hierarchy is a rank-ordering of kinds of research methods according to their potential to suffer from systematic bias, with the methods least prone to bias placed at the top. Originating in evidence-based medicine — the term was used in a 1979 Canadian Task Force report to grade interventions by quality of evidence — hierarchies conventionally place systematic reviews and meta-analyses of randomised controlled trials highest, followed by individual trials, cohort and case-control studies, case series and, at the base, expert opinion. Dozens of variants exist, including the Oxford CEBM levels and the GRADE approach to rating certainty of evidence.

References

Overview

What it means

The hierarchy is a heuristic, not a law: a well-run observational study may outweigh a poor trial, and some sustainability questions (ecosystem dynamics, community outcomes) cannot be randomised at all.

Critics argue rigid hierarchies undervalue qualitative and practice-based evidence, which is why impact-measurement practice has adapted the idea into broader "standards of evidence" that match method strength to the claim being made.

How it is used

Used by evaluators, funders and standards bodies to grade the confidence behind impact claims, to set minimum evidence requirements for funding decisions, and to structure evidence reviews.

Why it matters

Sustainability claims are only as credible as the evidence behind them; a shared hierarchy lets editors, investors and policymakers compare claims on a common footing and spot assertions that outrun their support.

**Note:** Sustainability-sector adaptations (standards of evidence used in UK impact measurement) should be verified against current guidance at publication; the core concept above is the established, citable form.

Review

Public comments appear only after editor acceptance. Draft comments stay in the review queue.

0
How people contribute

Reviewers choose the definition or an overview paragraph, leave a comment or replacement, and attach evidence or a source link.

How comments are used

Editors compare reviewer cards side by side. AI may help find agreement, conflicts, unsupported claims and possible source issues.

What gets published

Only an editor-accepted synthesis changes the public page. Reviewer identities are shown only with consent and verification.

No verified experts yet

Submitted reviews stay private until accepted.

Loading verified endorsements… Endorsements are not votes and never determine publication.

Endorse this definition

Endorse the exact version shown here. This is not a vote, and publication remains an editorial decision.

v0.1

Sign-in supplies your email for verification and necessary follow-up; it is not displayed publicly. We do not ask you to enter it again.

Sign in with a passwordless email link before submitting.

Review board

Comment on a specific line. Each reviewer stays separate until an editor accepts a merged draft.

1Separate reviewer cards

Each person comments on the definition or overview in their own draft card, with role, evidence and suggested wording kept together.

2AI comparison

AI can compare comments against the current text, flag conflicting claims, surface missing evidence and identify where reviewers agree.

3Editor synthesis

An editor merges compatible suggestions into a draft change, checks sources, records disagreements and decides what can be published.

Text to reviewChoose the exact definition or overview paragraph.
Reviewer commentDraft only. Not public until editor accepted.
Definition
Reviewer identityYour signed-in account identifies the submission. We use its email only for verification and necessary follow-up, and never display it publicly.
Before you submit

This proposal follows the editorial and AI-assistance rules. The live definition will not change until an editor accepts it.

  • Add the proposed wording or note.
  • Explain why the change is needed.
  • Ready
  • Ready

Sign in with a passwordless email link before submitting.

You can still save a draft, but completing these items makes editorial review faster. Multiple reviewers can suggest changes on the same text. Editors compare, merge, accept or decline them before any public change.