: The Importance of Evaluation In her second blog focusing on the implementation process, Stella Jones highlights the significant role that evaluation plays

In our previous blog, we discussed the importance of careful implementation and how for every hour or pound spent, it’s vital to consider whether resources might be used more effectively to benefit pupil outcomes. Evaluation is key to understanding the true impact of any initiative. Without it, we cannot determine if an intervention is genuinely beneficial. The goal is to assess whether its impact is positive, negative or negligible.

Understanding causation versus correlation is crucial when evaluating programmes and initiatives in education. For instance, schools might see a correlation between the introduction of an online reading programme and better reading comprehension scores. However, this correlation doesn’t prove that the online reading programme directly causes improved comprehension. Factors like student motivation and teacher involvement play significant roles. To establish causation, schools could conduct controlled studies comparing students using one to those not using it. This approach ensures decisions about educational interventions are based on solid evidence of effectiveness, not just correlation.

Whenever we make a change, we must evaluate its impact as thoroughly as possible. ​“If it’s worth doing, it’s worth evaluating.”

1. Effectiveness: Evaluation helps determine whether an initiative positively impacts learning. Without this, schools might continue implementing strategies that sound promising but don’t deliver results.

2. Efficiency: Evaluating initiatives can save time and money. It’s often easier to start something new than to discontinue something old. By evaluating, schools can ensure efforts are directed toward the most effective practices.

3. Future Planning: Careful evaluation helps identify improvements for future actions. Knowing what works and what doesn’t, guides better decision-making.

Please see our resource to support evaluation - Evaluation Considerations

Rob Coe notes that while there are many reasons to avoid evaluation, none of them are good. It’s hard, time-consuming, and resource-intensive. Sometimes, ignorance can seem blissful, particularly when we’ve invested heavily in an idea. This ​“IKEA effect” makes us cling to the notion that our efforts must have been worthwhile. However, to truly understand the impact, schools must evaluate honestly, even if it means confronting uncomfortable truths.

Steps for Effective Evaluation

When planning for monitoring and evaluating initiatives, consider the following:

- Activities and Involvement: What were the specific activities? Who was involved, and when did they take place?

- Implementation: Were the initiatives delivered as intended? Were they feasible and well-suited to the context?

- Impact: What changes have occurred at various levels — system, setting, pupil?

By bravely confronting the realities of our initiatives through honest evaluation, we can avoid the trap of recycling ineffective practices and instead, focus on what truly benefits our students. Don’t forget – everything works somewhere; nothing works everywhere.