Time to reset the clock on the design of impact evaluations in criminology: the case for multi-methodology designs

Morris, Stephen ORCID: https://orcid.org/0000-0001-6869-8933, Smith, Andrew and Fox, Christopher ORCID: https://orcid.org/0000-0003-1931-2058 (2020) Time to reset the clock on the design of impact evaluations in criminology: the case for multi-methodology designs. British Journal of Community Justice, 16 (3). ISSN 1475-0279

Preview

Published Version Download (863kB) | Preview

Abstract

This paper highlights how qualitative research can enhance causal explanation in impact evaluations and provide additional causal leverage to findings from randomised experiments. We assess the extent to which randomised studies in criminology adopt mixed or multi-methodological approaches as seen in other fields such as health care, education and international development. We reviewed current practice in the design of experimental evaluations within criminology. Structured searched terms previously used to identify qualitative research components within randomised studies in health research, were used to search for evidence of mixed method design in 46 primary studies involving randomisation, published in four leading journals in criminology since 2013. Although such mixed-method randomised studies are increasingly seen in other fields such as health, education and international development, among the studies we identified in criminology and criminal justice our review reveals almost an entire absence of designs in which qualitative research is formally and explicitly integrated into study designs. We argue that randomised studies are significantly enhanced through incorporating explicit and planned mixed-method elements, and particularly qualitative research. We suggest reasons for this absence and what might be done to address it