Review article · 2018 · Open access
Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes
Journal of Development Effectiveness, 10(4), 400–421 · Published 2 October 2018 · DOI 10.1080/19439342.2018.1534875
In brief
“Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes” is a 2018 review article by Emmanuel Jiménez and 7 co-authors, published in Journal of Development Effectiveness. OpenAlex counts 53 citations as of 20 November 2026, which puts it in the top 7% of works published in 2018 by citations. It is open access: the full text is free to read at Bangor University Research Portal (Bangor University).
- Citations
- 53
- Most cited in
- 2024 (8)
- Field-weighted impact
- 1.13
- References
- 116
- Authors
- 8
Abstract
Recent evaluations have begun to use qualitative data in a manner that helps improve the quality and relevance of studies through the inferences that are drawn from them, and their applicability to policy makers and programme implementers. This paper reviews this work and identifies good practices to integrate qualitative methods into quantitative impact evaluations (IEs) and systematic reviews (SRs). Using recent literature on the characteristics of such practices, we developed two tools to assess the methodological rigour and mixed methods integration of 40 IEs and 7 SRs, drawing upon previous approaches. Our findings are that successful mixed methods quantitative impact evaluations: (1) provide a clear rationale for integration of methods; (2) deploy multidisciplinary teams; (3) provide adequate documentation; and (4) acknowledge limitations to the generalisability of qualitative and quantitative findings. Successful integration tended to improve mixed methods impact evaluations by collecting better data to inform the study design and findings, which helped contextualise quantitative findings. Our main observation on the integration of mixed methods in the systematic reviews is that mixed methods systematic reviews bringing together literatures that answer different questions can go beyond the ‘sum of their parts’ to provide holistic answers about development effectiveness. The findings of this study inform several recommendations to improve the conduct and reporting of mixed methods impact evaluations and systematic reviews.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Jiménez, E., Waddington, H. S., Goel, N., Prost, A., Pullin, A. S., White, H., Lahiri, S., & Narain, A. (2018). Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes. Journal of Development Effectiveness, 10(4), 400–421. https://doi.org/10.1080/19439342.2018.1534875
MLA 9
Jiménez, Emmanuel, et al. “Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes.” Journal of Development Effectiveness, vol. 10, no. 4, 2018, pp. 400–421. https://doi.org/10.1080/19439342.2018.1534875.
Chicago
Jiménez, Emmanuel, Hugh Sharma Waddington, Neeta Goel, Audrey Prost, Andrew S. Pullin, Howard White, Shaon Lahiri, and Anmol Narain. 2018. “Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes.” Journal of Development Effectiveness 10 (4): 400–421. https://doi.org/10.1080/19439342.2018.1534875.
Harvard
Jiménez, E. et al. (2018) ‘Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes’, Journal of Development Effectiveness, 10(4), pp. 400–421. doi:10.1080/19439342.2018.1534875.
IEEE
E. Jiménez et al., “Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes,” Journal of Development Effectiveness, vol. 10, no. 4, pp. 400–421, 2018, doi: 10.1080/19439342.2018.1534875.
BibTeX
@article{jimenez2018mixing,
title = {{Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes}},
author = {Jiménez, Emmanuel and Waddington, Hugh Sharma and Goel, Neeta and Prost, Audrey and Pullin, Andrew S. and White, Howard and Lahiri, Shaon and Narain, Anmol},
journal = {Journal of Development Effectiveness},
year = {2018},
volume = {10},
number = {4},
pages = {400--421},
doi = {10.1080/19439342.2018.1534875},
url = {https://doi.org/10.1080/19439342.2018.1534875}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2016 | 2 | |
| 2019 | 4 | |
| 2020 | 5 | |
| 2021 | 7 | |
| 2022 | 5 | |
| 2023 | 7 | |
| 2024 | 8 | |
| 2025 | 7 | |
| 2026 | 8 |
Its field-weighted citation impact is 1.13: it has been cited 1.13 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Social Sciences › Social Sciences › Public Administration › Evaluation and Performance Assessment
- qualitative-quantitative integration
- systematic reviews
- development effectiveness
- methodological quality
- generalizability
- multidisciplinary team
- development impact
Work with this paper
Most-cited papers in Social Sciences
- Using thematic analysis in psychologyVirginia Braun, Victoria Clarke · Qualitative Research in Psychology · 2006 · 240,222 citations
- Case Study Research: Design and MethodsRobert K. Yin · 1984 · 81,951 citations
- Three Approaches to Qualitative Content AnalysisHsiu-Fang Hsieh, Sarah Elizabeth Shannon · Qualitative Health Research · 2005 · 49,623 citations
- Qualitative Data Analysis: An Expanded SourcebookMatthew B. Miles, A Michael Huberman · Journal of Environmental Psychology · 1994 · 48,311 citations
- Consolidated criteria for reporting qualitative research (COREQ): a 32-item checklist for interviews and focus groupsAllison Tong, Peter Sainsbury, Jonathan C. Craig · International Journal for Quality in Health Care · 2007 · 45,353 citations
Questions about this paper
How do I cite this paper in APA style?
Jiménez, E., Waddington, H. S., Goel, N., Prost, A., Pullin, A. S., White, H., Lahiri, S., & Narain, A. (2018). Mixing and matching: using qualitative methods to improve quantitative impact evaluations (IEs) and systematic reviews (SRs) of development outcomes. Journal of Development Effectiveness, 10(4), 400–421. https://doi.org/10.1080/19439342.2018.1534875
How many times has this paper been cited?
53 times, according to OpenAlex on 20 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Bangor University Research Portal (Bangor University): sign in and open the PDF from this page.
Who wrote this paper?
Emmanuel Jiménez, Hugh Sharma Waddington, Neeta Goel, Audrey Prost, Andrew S. Pullin, Howard White, Shaon Lahiri, Anmol Narain.
What is the DOI of this paper?
10.1080/19439342.2018.1534875, permanently at https://doi.org/10.1080/19439342.2018.1534875. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 20 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.