Journal article · 2019 · Open access

The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial

Heather L. Shepherd, Liesbeth Geerligs, Phyllis Noemi Butow, Lindy M. Masya, Joanne Shaw, Melanie Anne Price, Haryana Mary Dhillon, Thomas F. Hack, Afaf Girgis, Tim Luckett, Melanie R Lovell, Brian J. Kelly and 5 more

Frontiers in Public Health, 7, 293 · Published 18 October 2019 · DOI 10.3389/fpubh.2019.00293

Free PDFView at the publisherCite this paper

In brief

“The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial” is a 2019 journal article by Heather L. Shepherd and 16 co-authors, published in Frontiers in Public Health. OpenAlex counts 42 citations as of 15 November 2026. It is open access under a CC BY licence: the full text is free to read at Frontiers in Public Health.

Citations
42
Most cited in
2021 (14)
Field-weighted impact
4.81
References
43
Authors
17

Abstract

Objective and study setting: Research efforts to identify factors that influence successful implementation are growing. This paper describes methods of defining and measuring outcomes of implementation success, using a cluster randomised controlled trial with 12 cancer services in Australia comparing the effectiveness of implementation strategies to support adherence to the Australian Clinical Pathway for the Screening, Assessment and Management of Anxiety and Depression in Adult Cancer Patients (ADAPT CP). Study design and methods: Using the StaRI guidelines, a process evaluation was planned to explore participant experience of the ADAPT CP, resources and implementation strategies according to the Implementation Outcomes Framework. This study focused on identifying measurable outcome criteria, prior to data collection for the trial, which is currently in progress. Principal findings: We translated each implementation outcome into clearly defined and measurable criteria, noting whether each addressed the ADAPT CP, resources or implementation strategies, or a combination of the three. A consensus process defined measures for the primary outcome (adherence) and secondary (implementation) outcomes; this process included literature review, discussion and clear measurement parameters. Based on our experience, we present an approach that could be used as a guide for other researchers and clinicians seeking to define success in their work. Conclusions: Defining and operationalising success in real-world implementation yields a range of methodological challenges and complexities that may be overcome by iterative review and engagement with end users. A clear understanding of how outcomes are defined and measured, based on a strong theoretical framework, is crucial to meaningful measurement and outcomes. The conceptual approach described in this article could be generalized for use in other studies.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Shepherd, H. L., Geerligs, L., Butow, P. N., Masya, L. M., Shaw, J., Price, M. A., Dhillon, H. M., Hack, T. F., Girgis, A., Luckett, T., Lovell, M. R., Kelly, B. J., Beale, P. J., Grimison, P., Shaw, T. J., Viney, R. C., & Rankin, N. M. (2019). The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial. Frontiers in Public Health, 7, 293. https://doi.org/10.3389/fpubh.2019.00293

MLA 9

Shepherd, Heather L., et al. “The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial.” Frontiers in Public Health, vol. 7, 2019, p. 293. https://doi.org/10.3389/fpubh.2019.00293.

Chicago

Shepherd, Heather L., Liesbeth Geerligs, Phyllis Noemi Butow, Lindy M. Masya, Joanne Shaw, Melanie Anne Price, Haryana Mary Dhillon, et al. 2019. “The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial.” Frontiers in Public Health 7: 293. https://doi.org/10.3389/fpubh.2019.00293.

Harvard

Shepherd, H. L. et al. (2019) ‘The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial’, Frontiers in Public Health, 7, p. 293. doi:10.3389/fpubh.2019.00293.

IEEE

H. L. Shepherd et al., “The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial,” Frontiers in Public Health, vol. 7, p. 293, 2019, doi: 10.3389/fpubh.2019.00293.

BibTeX

@article{shepherd2019elusive,
  title     = {{The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial}},
  author    = {Shepherd, Heather L. and Geerligs, Liesbeth and Butow, Phyllis Noemi and Masya, Lindy M. and Shaw, Joanne and Price, Melanie Anne and Dhillon, Haryana Mary and Hack, Thomas F. and Girgis, Afaf and Luckett, Tim and Lovell, Melanie R and Kelly, Brian J. and Beale, Philip James and Grimison, Peter and Shaw, Tim J and Viney, Rosalie C. and Rankin, Nicole Marion},
  journal   = {Frontiers in Public Health},
  year      = {2019},
  volume    = {7},
  pages     = {293},
  doi       = {10.3389/fpubh.2019.00293},
  url       = {https://doi.org/10.3389/fpubh.2019.00293}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201811
202011
20211414
202233
202377
202499
202566
202611

Its field-weighted citation impact is 4.81: it has been cited 4.81 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science

  • implementation outcomes
  • implementation success
  • outcome measurement
  • implementation strategies
  • cancer patients
  • anxiety and depression screening
  • process evaluation
  • consensus building

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Shepherd, H. L., Geerligs, L., Butow, P. N., Masya, L. M., Shaw, J., Price, M. A., Dhillon, H. M., Hack, T. F., Girgis, A., Luckett, T., Lovell, M. R., Kelly, B. J., Beale, P. J., Grimison, P., Shaw, T. J., Viney, R. C., & Rankin, N. M. (2019). The Elusive Search for Success: Defining and Measuring Implementation Outcomes in a Real-World Hospital Trial. Frontiers in Public Health, 7, 293. https://doi.org/10.3389/fpubh.2019.00293

How many times has this paper been cited?

42 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Frontiers in Public Health.

Who wrote this paper?

Heather L. Shepherd, Liesbeth Geerligs, Phyllis Noemi Butow, Lindy M. Masya, Joanne Shaw, Melanie Anne Price, Haryana Mary Dhillon, Thomas F. Hack, Afaf Girgis, Tim Luckett, Melanie R Lovell, Brian J. Kelly and 5 more.

What is the DOI of this paper?

10.3389/fpubh.2019.00293. The permanent link is https://doi.org/10.3389/fpubh.2019.00293.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.