Introducing Relevant Return on Resources for Complex Learning Systems 

For years, school districts have been asked a familiar question: What’s the return on investment?

ROI has become shorthand for fiscal responsibility—an expectation that every dollar spent should produce measurable gains. In an era of tightening budgets, declining enrollment, and rising student needs, that pressure makes sense. And to be clear, districts do need decision‑useful evidence about whether investments are working. Public dollars require accountability.

Traditional ROI assumes a relatively direct relationship between an investment and an outcome. It works best when inputs can be clearly defined, implementation conditions are stable, outcomes are measurable within a short timeframe, and the effects of a specific investment can be reasonably isolated. School systems rarely operate under those conditions.

Educational outcomes are not typically produced by a single intervention, program, or expenditure. Rather, they emerge from the interaction of instructional practices, staffing structures, student supports, organizational routines, leadership decisions, family and community conditions, and time. Learning systems are complex systems. They are shaped not only by what is purchased or implemented, but also by how resources are organized, how consistently strategies are enacted, and whether the conditions for success are present.

In public education, traditional ROI is often the wrong starting point. It tends to reduce learning to a linear before‑and‑after calculation, privilege short‑term gains over long‑term capacity, and miss outcomes that matter most to students and communities.  

Relevant Return on Resources offers a better way to ask the accountability question—without oversimplifying how learning systems work.

Consider what this looks like for a single student.  

Imagine a fourth grader who starts the year reading below grade level. Each morning begins with the same quiet calculation: will today be a “good reading day,” or one where the words won’t hold still? In class, the student tries—sometimes guessing, sometimes avoiding attention, sometimes surprising everyone with a line read smoothly. A small-group instructional block provides targeted practice, and a skilled classroom teacher adjusts on the fly to keep the student engaged. Attendance is uneven, shaped by circumstances outside the school’s control, and that inconsistency shows up in the pace of progress.  

By spring, the student’s growth is visible. The student reads more independently, participates more often, and approaches texts with greater confidence. The improvement is meaningful. But what produced that improvement?

Which resources get the credit—the small-group time, the teacher’s expertise, the schedule that made room for extra practice, or the attendance outreach?  

Over what timeframe? Compared to what alternative? The most accurate answer is that progress resulted from the interaction among these factors. The student’s growth cannot be fully attributed to one investment without distorting the conditions that made improvement possible.  

A simple before-and-after ROI calculation doesn’t just flatten the story—it points decision-makers toward the wrong conclusions.

Why Traditional ROI Breaks Down in Public Education

Traditional ROI often asks too small a question and expects too straight an answer. It treats complex learning and support systems as if they were a single input producing a single, predictable output—when in reality, results depend on interactions across people, programs, and time. In public education, ROI often:

• Assumes a mostly linear relationship between an investment and an outcome
• Reduces impact to too few variables to reflect real implementation and context
• Privileges short‑term, easily measured changes over capacity‑building and sustainability
• Misses system interactions—how staffing, schedules, materials, and supports work together

These limitations make ROI a weak guide for decisions about staffing, student supports, professional learning, or instructional coherence in school systems.

The result is often defensive budgeting—and predictable decision errors: cutting supports before they have time to take hold, penalizing high‑need schools with slower early gains, or underinvesting in the enabling conditions (time, staffing, coaching, coordination) that determine whether an initiative works at all.

What Comes Next?

If educational improvement emerges from the interaction of people, time, supports, organizational conditions, and resources, then district leaders need a different way to think about return.

The challenge is not whether schools should be accountable for results. Public dollars require accountability, and leaders need evidence to inform difficult decisions. The challenge is whether traditional ROI asks the right question for complex learning systems.

Rather than focusing narrowly on whether a single program generated a measurable payoff, school systems need an approach that considers who resources are serving, the conditions required for success, and how outcomes emerge over time.

In the next blog, I introduce Relevant Return on Resources (R3)—a framework designed to help districts ask a more complete accountability question while maintaining a focus on student outcomes and responsible stewardship of public resources. 

Keep reading...

Using the Right Tools to Evaluate School Investments- Part 2

Using the Right Tools to Evaluate School Investments- Part 3