Why impact measurement for SEMH intervention matters

In education, it is often said that what gets assessed gets addressed and whilst we know measuring social, emotional and mental health (SEMH) difficulties and social and emotional learning (SEL) can be tricky, we believe that evaluating the impact of interventions is vital.

Understanding the mental health and wellbeing needs of children within a school community context is increasingly important to positively impact learning, behaviour and wellbeing. There is growing evidence that children’s SEMH needs have a significant impact on learning engagement, behaviour and attendance, exclusions and ultimately wider outcomes for children and their long-term life path.

To promote inclusion and reduce exclusions, schools should employ a graduated response approach to meeting’s SEMH needs.

Alongside the curriculum targeted interventions and appropriate provision should be in place to maximise children’s capacity to learn, engage in school life and develop the social and emotional skills for learning and beyond.

It’s vital that monitoring and assessment of impact, programme delivery and outcomes for children are ongoing and form part of the review process for children’s experience and skill development.

Impact measurement for SEMH intervention

There is evidence that children’s skills can be improved purposefully through school based SEL programmes, and that these impacts can persist over time.¹

Evidence indicates that, when well implemented, SEL can have positive impacts on a range of outcomes, including:²

  • Improved social and emotional skills
  • Improved academic performance
  • Improved attitudes, behaviour, and relationships with peers
  • Reduced emotional distress (depression, anxiety, stress and social withdrawal)
  • Reduced levels of bullying
  • Reduced conduct problems
  • Improved school connection

Screening and measuring children’s wellbeing is key

It can be a challenge to show the level of impact an intervention is having but gathering relevant data, ensuring children’s voices are heard and having the right means to measure children’s social and emotional skills is central to a school’s capacity to ensure engagement in learning, the development of social and emotional skills, overall achievement, and successful outcomes.

As with all undertakings in education, impact matters and presenting this through data and assessment to show progress and change, ensures prioritisation of approach and resources to ensure the best outcomes for children.

The key benefits of monitoring the impact of SEMH interventions are to:

  • Provide a benchmark, highlight changes and identify progress made over time

  • Evaluate impact, provide insight for reviews, reporting and signposting

  • Create a targeted approach, identify the right intervention programme(s) and allocate resources to ensure qualitative delivery of intervention

It’s best practice to identify which interventions and approaches are making a difference. Carefully monitoring, assessing and reviewing the intervention data helps to meet the changing needs of children and ensure the best possible provision is delivered.

“The development of social and emotional skills, in turn, predicts improved academic engagement and performance, more positive social behaviours, and lower rates of behaviour problems and psychological distress.”

March 2023³

Valuable insight and informative data is important for:

  • Understanding the strengths of the children - and the individuals underlying needs

  • Identifying the most suitable interventions to address needs

  • Identifying children that might need specialist intervention who risk falling through the gaps

  • Allocation of school resources

  • Measurement of progress and change over time

  • Supporting SEND and inclusion strategies

  • Comparing data to see what some teams and schools do to successfully improve outcomes for their school communities

There are several ways children's wellbeing can be assessed, commonly used is the SDQ (Strength and Difficulties Questionnaire),⁴ the world’s most-used tool for assessing mental health of people from 2 to 18 years old, Boxall Profile,⁵ emotional scales, case studies and self-assessment questionnaires etc.

Behaviour and attendance data can also be helpful in demonstrating how an intervention has affected children’s overall wellbeing. But what is really needed is a holistic view of the areas of need for children with SEMH difficulties.

We developed Hamish & Milo Navigator to truly support a whole school approach to assessing and addressing children’s mental health, monitoring the effectiveness of our SEMH interventions and to really ‘hear’ the child’s voice.

Navigator Impact Dashboard is an innovative, cloud software platform with clear easy configuration and data forms for the monitoring and evaluation of our SEMH interventions providing vital insight to support the best outcomes for children.

Navigator provides live data to demonstrate the impact for children involved in the programmes through pre and post intervention data from Child Wellbeing Profiles, SDQs and Child’s Voice Questionnaires. Staff can track progress, see trends at child, group, school and trust level and drill-down from intervention programme, group, to child level to see micro-impact, recorded observations and email child reports.

A well-designed SEL programme includes not only evidence-based curricula and instruction, but also clear goals, benchmarks, and tools for universal and targeted screening and progress monitoring.⁶

‘An over-arching recommendation focuses on the importance of implementing and monitoring progress carefully, and the requirement for school leaders to prioritise this work if it is to have an impact. Although some schools may feel social and emotional learning is ‘what we do already’, the evidence suggests that how SEL is adopted and embedded really matters for children’s outcomes.’

Sir Kevan Collins - CEO, Education Endowment Foundation⁷

In summary any SEMH interventions and provision to support wellbeing and mental health should be regularly reviewed and monitored to ensure they are having the intended impact and outcomes for children is critical to creating a healthier, happier school community.

Access to Navigator is FREE to all schools whilst providing data as part of the University of Bath Research Project. Find out more or email clare@hamishandmilo.org to get involved!

University of Bath Research Project

Sources

  1. Taylor, R., Oberle, E., Durlak, J. and Weissberg, R. (2017) ‘Promoting Positive Youth Development Through SchoolBased Social and Emotional Learning Interventions: A MetaAnalysis of Follow-Up Effects’, Child Development, 88, pp. 1156–1171. McCormick, M. et al (2019) ‘Long-Term Effects of Social–Emotional Learning on Receipt of Special Education and Grade Retention: Evidence From a Randomized Trial of INSIGHTS’, AERA, 5, 3.
  2. EEF Teaching and Learning Toolkit (2019), ‘Social and Emotional Learning, Technical Appendix – Summary of Effects from Meta-analyses; Wigelsworth, M. et al. (forthcoming) ‘Programmes to Practices: Evidence Review on Social and Emotional Learning’, London: Education Endowment Foundation.
  3. Greenberg, M. T. (2023). Evidence for social and emotional learning in schools. Learning Policy Institute. https://doi.org/10.54300/928.269
  4. Goodman, R. (1997). https://sdqinfo.org/
  5. Nurtureuk https://www.boxallprofile.org/
  6. Susanne Denham - https://www.edutopia.org/blog/tools-assess-sel-in-schools-susanne-a-denham
  7. Sir Kevan Collins Early Intervention Foundation https://educationendowmentfoundation.org.uk/education-evidence/guidance-reports/primary-sel

You may also be interested in

  • Suffolk County Council has chosen Hamish & Milo as their preferred Emotional Wellbeing Intervention provider for Primary schools as part of the Department for Education (DfE) Delivering Better Value (DBV) Programme that aims to support local authorities to improve outcomes for children and young people using evidence-based interventions.

  • School suspensions and exclusions Infographic DfE Data July 2024

    Shocking figures from the latest Department for Education’s (DfE) annual exclusions statistics make for a worrying read with both suspensions and permanent exclusions at the highest annual number ever recorded. Permanent exclusions have increased for primary pupils by a staggering 58%. Early intervention is the key.

  • All about me Activity Template Free Hamish & Milo

    Transition day activity for getting to know each other - 'All about me' activity template is a great way to get to know new pupils by letting them tell you about themselves in their own words.

Cartoon of Milo sleeping on his chair

Subscribe to our newsletter

SIGN UP FOR EXCLUSIVE OFFERS

Sign up to receive news on current issues that are affecting children and young people as well as resources we are developing to support you in your valuable work with children.

Hamish with newspaper cartoon