Impact Reporting: Outputs, Outcomes and the Gap Between Them

There is a settled way of talking about measuring charitable impact. It is worth asking how much of it survives contact with the detail.

The vocabulary that matters

Inputs are resources, activities are what the organisation did, outputs are countable products of that activity, and outcomes are changes in the world. Most published figures are outputs: meals served, people reached, calls answered, sessions delivered.

Outputs are easy to count, easy to verify and tell you nothing about whether anybody is better off. Outcomes are the point and are considerably harder to measure, which is why they appear so much less often. Reading any impact claim starts with asking which of these four things the number describes.

The attribution problem

Claiming an outcome requires knowing what would have happened without the intervention, which is not observable for any individual. Robust approaches address this with comparison groups, but those are expensive, sometimes unethical and often impractical at small scale.

Without a comparison, an organisation cannot distinguish its effect from selection, from broader trends, or from other services the same people used. This is not a criticism of charities; it is a genuine methodological difficulty that also constrains government and academic evaluation. Organisations that acknowledge it are more credible than those presenting before-and-after figures as proof.

Numbers that inflate easily

People reached usually counts contacts rather than individuals, so one person attending twelve sessions can appear as twelve. Beneficiary counts may include indirect beneficiaries under expansive definitions, which is legitimate if stated and misleading if not.

On the shop floor, website visits, social media reach and materials distributed are activity metrics presented as impact with striking frequency. Aggregate figures across a whole organisation obscure whether any individual programme worked. The useful discipline is asking what a number would look like if the work had achieved nothing, and whether it would look different.

Monetised impact claims

Some organisations express impact as a monetary return, stating that each unit spent generated some larger social value. These calculations rest on chains of assumptions about valuation, attribution and duration, each of which can shift the result substantially. The approach is useful for internal comparison between options and unreliable for comparing across organisations using different assumptions.

Reports that publish the assumptions and a sensitivity range are doing this honestly, and they are a minority.

A single headline ratio with no methodology behind it should be treated as a marketing claim.

What good reporting looks like

It names a specific outcome, explains how it was measured, states the sample and period, and acknowledges what the measurement cannot show. It describes something that did not work and what changed as a result, which is the strongest available signal of an honest process.

It reports consistently across years, so a reader can see a trend rather than a rotating selection of favourable figures. It distinguishes the organisation's contribution from that of partners and from wider circumstances. Very few reports do all of this, and organisations that do most of it are worth taking seriously.

Proportionality

Demanding rigorous evaluation from every small organisation would consume resources that should be delivering the service. Sensible expectations scale with size, so a local group should be able to describe what it does and who benefits, not run a controlled trial. For larger organisations spending substantial public or donated money, the expectation of real evidence is entirely reasonable.

Over a funding cycle, funders requiring elaborate outcome frameworks from tiny grantees are imposing a cost they have not funded. The right question is whether the organisation knows how it would find out if the work stopped helping.

The takeaway

Ask what would be different if the work had achieved nothing, and see whether the numbers would change.

Unrestricted money is the most useful gift and the least satisfying to make.