Measuring collective impact across a whole ecosystem: three years of Meshpoints

Collective impact measurement evidences change created by many organisations working towards a shared goal, where no single party owns the outcome. It combines shared indicators, network-level metrics and relationship mapping rather than single-programme evaluation. Over three years, the Meshpoints initiative in Western Australia, funded by Lotterywest and led by Spacecubed, has connected more than 185 partner organisations and 86 funded projects, reaching over 13,000 people, with Echo Impact providing the measurement infrastructure throughout.

This article sets out what we have learned about measuring impact at ecosystem scale, and offers a practical framework for backbone organisations facing the same challenge.

What is collective impact measurement?

Collective impact describes a structured approach where organisations from different sectors commit to a common agenda for solving a specific social problem, supported by shared measurement, mutually reinforcing activities and a backbone organisation that coordinates the work.

Collective impact measurement is the evidence layer of that model. Where a single programme evaluates its own participants against its own outcomes, collective impact measurement has to capture change across an entire network: the projects funded, the partnerships formed, the capabilities built and the people ultimately reached. The unit of analysis shifts from the programme to the ecosystem.

That shift breaks most conventional evaluation tools, which assume one organisation, one intervention and one clean line from activity to outcome.

The attribution problem when no one owns the outcome

Ask who caused an outcome in an ecosystem and the honest answer is usually everyone and no one. A community project succeeds because one partner funded it, another hosted it, a third contributed expertise and a fourth connected the founders in the first place. Traditional attribution logic wants a single causal claim, and ecosystems refuse to provide one.

At ecosystem scale, the question stops being who caused the outcome and becomes who contributed to it.

The workable alternative is contribution analysis. Rather than attempting to isolate one actor's causal share, contribution analysis documents each organisation's role in the pathway to an outcome and builds a credible account of how the collective effort produced the change. It requires humility in claims and rigour in records, and it is far better suited to how ecosystems actually work.

How do you measure impact across many organisations?

Shared indicators and a common data layer

The foundational move is agreeing a small set of indicators that every partner reports against in the same way. Without this, the backbone organisation spends its life translating between incompatible spreadsheets. With it, portfolio-level questions become answerable: how many people were reached across all funded projects, which capability areas are growing, where are the gaps.

A common data layer makes shared indicators practical. In Meshpoints, partner organisations, funded projects and the people they reach all live as structured, connected records in one platform rather than in 185 separate documents.

Network and relationship mapping

Ecosystem outcomes travel through relationships. A funding decision in one corner of the network creates a collaboration in another, and the connective tissue is itself a result worth measuring. Mapping which organisations are connected, how those connections form and where the network is thin turns an abstract claim about a stronger ecosystem into something observable. Density of connections, new partnerships formed and bridging ties between previously separate clusters are all measurable network properties.

Longitudinal tracking at the ecosystem level

Ecosystem change is slow, and a single annual snapshot misses most of it. Tracking the same organisations and projects across years reveals trajectories: which funded projects survived, which partnerships persisted beyond their initial grant, and how participation compounds. Three years into Meshpoints, the longitudinal view is what allows credible statements about durability rather than activity.

Inside Meshpoints: three years, 185+ partners, 13,000+ people

Meshpoints is a collective impact initiative focused on strengthening Western Australia's community and innovation ecosystem, funded through $2.6 million in direct grants from Lotterywest. Across three years it has grown to encompass more than 185 partner organisations and 86 funded projects, with a combined reach of over 13,000 people across WA.

Measuring it taught us several things worth passing on.

First, data collection has to be proportionate to partner capacity. Many partners are small community organisations, and a reporting regime designed for acquitting a government grant would have crushed them. Lightweight, standardised check-ins collected more usable data than exhaustive templates ever would have.

Second, the backbone organisation needs its own measurement discipline. Coordination work, convening, brokering introductions and building shared infrastructure is real work with real effects, and it disappears from the record unless it is deliberately captured.

Third, public visibility of the data changes behaviour. Once partners could see the shared picture, including through the WA Innovation Ecosystem Navigator that grew out of this work, the data stopped being a compliance artefact and became a shared asset that partners wanted to keep accurate.

A practical framework for backbone organisations

For organisations coordinating collective impact work, the measurement approach that has held up across three years of Meshpoints looks like this:

1. Agree three to five shared indicators before funding anything, and keep them stable.
2. Stand up a common data layer so every partner, project and outcome is a connected record.
3. Measure the network itself: connections, new partnerships and bridging ties are outcomes.
4. Track longitudinally, because durability is the evidence that distinguishes ecosystem change from activity.
5. Use contribution analysis for outcome claims, and be explicit about the collective nature of the result.
6. Make the shared picture visible to partners, because visibility sustains data quality.

Frequently asked questions

What is the collective impact model? A framework in which organisations across sectors commit to a common agenda, shared measurement and mutually reinforcing activities, coordinated by a backbone organisation, to address a complex social problem no single organisation can solve alone.

How is collective impact measurement different from programme evaluation? Programme evaluation assesses one intervention run by one organisation. Collective impact measurement captures change across a network of organisations working towards a shared goal, which requires shared indicators, network metrics and contribution-based outcome claims.

Who should be responsible for measuring collective impact? The backbone organisation typically holds the measurement infrastructure and discipline, while every partner contributes data against the shared indicators. Measurement fails when it is treated as each partner's private obligation rather than shared infrastructure.

How long does it take to see ecosystem-level change? Meaningful ecosystem indicators, such as durable partnerships and sustained projects, generally need two to three years of longitudinal data before trends separate from noise.

---

Echo Impact provides the measurement infrastructure behind Meshpoints. Read more on longitudinal impact measurement, or explore our ecosystem mapping platform.