EvalC3 Online: Introduction

EvalC3 Online was designed by Dr Rick Davies, initially for use in the monitoring and evaluation of the achievements of development projects. But it has much wider applicability.

EvalC3 Online enables users:

1. To identify sub-sets of attributes that describe an intervention & its context, and which are good predictors of the achievement of an outcome of interest.
2. To compare and evaluate the performance of these predictive models.
3. To identify relevant cases for follow-up within-case investigations to uncover any causal mechanisms at work.

EvalC3 can be of use at all stages of a project cycle:

During project selection

• To identify what attributes of project proposals are the best predictors of whether a project will be chosen for funding, or not
• To identify how well a project proposal appraisal and screening process is as a predictor of the subsequent success of projects in achieving their objectives

During project implementation

• When the effectiveness of specific activities are being measured using survey instruments which include both specific (facet) and general (global) measures of satisfaction with service or product delivered. EvalC3 can identify what combination(s) of facets best predict global satisfaction. For example:
• Participants experiences with workshops and training events
• Donors and grantees experiences of their working relationships with each other

During a project evaluation

• “Causes of effects” analysis: To identify what combination(s) of project activities (and their contexts) were associated with a significant improvement in beneficiaries lives.
• “Effects of causes” analysis: To identify what combinations of improvements in beneficiaries lives were associated with a specific project activity (or combination of)
• To identify “positive deviants” – cases where success is being achieved despite the fact that failure is the most common outcome.

During a review of existing evaluations

• Re-analysing data that was collected, to verify the results. This is often possible with QCA based evaluations because QCA data sets are usually published as annexes to evaluations
• Synthesising the results of multiple evaluations, into prediction rules concerning different types of outcomes

For more information on each of the stages in the flow chart above, see How to use EvalC3

Acknowledgements

EvalC3 Online was built by Reyt, based on the Excel app EvalC3, built by Aptivate and designed by Dr Rick Davies.

With funding provided by Sports England, managed by a team led by Dr Katie Shearn at the Sheffield Hallam University Advanced Wellbeing Research Center