About
Evaluating Complexity
This website has been set up to share the methods, tools, and resources we are using in the evaluation of a complex programme of work funded by Sport England to increase physical activity. We aim to document our experience, encourage, and enable others to use the tools for evaluating complex adaptive systems.
Whole-systems and place-based approaches
Since 2017, Sport England has invested in a variety of communities across England to address inequalities in, and barriers to, physical activity. These investments are an important part of its ambitious ten-year vision to transform lives and communities, Uniting the Movement.
Sport England’s approach aims to support physical activity at different levels – from individual to social environment, organisations, institutions, physical environments, and policy.
This is known as a ‘whole systems approach’ - recognising that tackling inactivity at scale and achieving meaningful impact requires changes at these multiple levels.
When a whole systems approach is rooted in the distinctive characteristics and insights of people who live and work there, it is referred to as a ‘place-based approach’.
The challenge of evaluating complexity
Assessing the complex nature of whole-systems and place-based approaches is not possible through evaluation methods that look at an intervention in isolation. This is because these approaches are composed of multiple components and are shaped by their specific local surroundings – in other words, they are complex adaptive systems.
Understanding complex adaptive systems requires evaluation methods that can take into consideration the role of context, the different components of the system, and how they interact.
Configurational Comparative Methods and Evalc3
Throughout 2023-25, the National Evaluation and Learning Partnership will conduct a collaborative evaluation of several whole-systems and place-based approaches - identifying factors that promote an increase in physical activity and reduce inequalities across places.
The evaluation will be carried out using Configurational Comparative Methods (CCM) - a research method that has been recommended by the UK government to evaluate complex public health interventions, policy and programmes.
We are using the Evalc3 tool developed by Rick Davies for the CCA. This tool and related resources are freely available on the website here.
Who we are
National Evaluation and Learning Partnership
The National Evaluation and Learning Partnership (NELP) is a consortium comprised of experts from Sheffield Hallam University, Hartpury and Coventry Universities, Collaborate CIC, Substance Ltd., and a consultant Dr Robin Vincent.
The consortium is working with stakeholders from Sport England, system partners (such as the Active Partnerships and the Office for Health Improvement and Disparities, and many places across the country. Our shared purpose is to support the collection and use of data for learning such that people can take better action to help achieve a population level change in physical activity.
We draw on Realist Evaluation principles to build understanding about how we can deliver positive change in the complex adaptive systems in which we live and work.
Team
Our team brings together a broad range of skills and experience in evaluation and health inequalities. Further information about who we are and what we do can be found below.
The People Involved
Ryan Storey
Research Assistant with a background in financial elements of sport and growing interest and involvement in the evaluation of whole-systems approaches. Supporting on this project with collection, handling and analysis of data.
Dr Katie Shearn
Senior Research Fellow and Lead Evaluator for the project
Dr Robin Vincent
Independent learning research and evaluation consultant. Advisor on integration of NELP learning, evaluation, capacity building and configurational analysis
Dr Simon Armour
Post Doctoral Research Fellow, Sheffield Hallam University, working on Configurational Comparative Analysis of place-based approaches to physical activity inequalities
Dr Kev Harris
Associate Professor in Sports Management at Hartpury University, supporting the configurational analysis, and translating the practices into places
Dr Harriet Wingfield
Post Doctoral Research Fellow, Sheffield Hallam University, working on Configurational Comparative Analysis of place-based approaches to physical activity inequalities
Louis Ryan
Research Assistant at Sheffield Hallam University, working on configurational comparative analysis project element of the NELP
Amy Murray-Evans
Research Assistant at Sheffield Hallam University supporting places with place-based systemic working
Dr Rick Davies
Evaluation Consultant, Cambridge, UK