Journal article · 2019 · Open access
Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study
BMJ Health & Care Informatics, 26(1), e000016 · Published 1 April 2019 · DOI 10.1136/bmjhci-2019-000016
In brief
“Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study” is a 2019 journal article by Michael H.-G. Li and 3 co-authors, published in BMJ Health & Care Informatics. OpenAlex counts 25 citations as of 15 November 2026, which puts it in the top 9% of works published in 2019 by citations. It is open access under a CC BY-NC licence: the full text is free to read at BMJ Health & Care Informatics.
- Citations
- 25
- Most cited in
- 2021 (6)
- Field-weighted impact
- 3.00
- References
- 51
- Authors
- 4
Abstract
Background Hospital reporting systems commonly use administrative data to calculate comorbidity scores in order to provide risk-adjustment to outcome indicators. Objective We aimed to elucidate the level of agreement between administrative coding data and medical chart review for extraction of comorbidities included in the Charlson Comorbidity Index (CCI) and Elixhauser Index (EI) for patients admitted to the intensive care unit of a university-affiliated hospital. Method We conducted an examination of a random cross-section of 100 patient episodes over 12 months (July 2012 to June 2013) for the 19 CCI and 30 EI comorbidities reported in administrative data and the manual medical record system. CCI and EI comorbidities were collected in order to ascertain the difference in mean indices, detect any systematic bias, and ascertain inter-rater agreement. Results We found reasonable inter-rater agreement (kappa (κ) coefficient ≥0.4) for cardiorespiratory and oncological comorbidities, but little agreement (κ<0.4) for other comorbidities. Comorbidity indices derived from administrative data were significantly lower than from chart review: −0.81 (95% CI − 1.29 to − 0.33; p=0.001) for CCI, and −2.57 (95% CI −4.46 to −0.68; p=0.008) for EI. Conclusion While cardiorespiratory and oncological comorbidities were reliably coded in administrative data, most other comorbidities were under-reported and an unreliable source for estimation of CCI or EI in intensive care patients. Further examination of a large multicentre population is required to confirm our findings.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Li, M. H.-G., Hutchinson, A. F., TACEY, M. A., & Duke, G. J. (2019). Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Health & Care Informatics, 26(1), e000016. https://doi.org/10.1136/bmjhci-2019-000016
MLA 9
Li, Michael H.-G., et al. “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study.” BMJ Health & Care Informatics, vol. 26, no. 1, 2019, p. e000016. https://doi.org/10.1136/bmjhci-2019-000016.
Chicago
Li, Michael H.-G., Anastasia F. Hutchinson, MARK A. TACEY, and Graeme J. Duke. 2019. “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study.” BMJ Health & Care Informatics 26 (1): e000016. https://doi.org/10.1136/bmjhci-2019-000016.
Harvard
Li, M. H.-G. et al. (2019) ‘Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study’, BMJ Health & Care Informatics, 26(1), p. e000016. doi:10.1136/bmjhci-2019-000016.
IEEE
M. H.-G. Li, A. F. Hutchinson, M. A. TACEY, and G. J. Duke, “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study,” BMJ Health & Care Informatics, vol. 26, no. 1, p. e000016, 2019, doi: 10.1136/bmjhci-2019-000016.
BibTeX
@article{li2019reliability,
title = {{Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study}},
author = {Li, Michael H.-G. and Hutchinson, Anastasia F. and TACEY, MARK A. and Duke, Graeme J.},
journal = {BMJ Health \& Care Informatics},
year = {2019},
volume = {26},
number = {1},
pages = {e000016},
doi = {10.1136/bmjhci-2019-000016},
url = {https://doi.org/10.1136/bmjhci-2019-000016}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2020 | 4 | |
| 2021 | 6 | |
| 2022 | 5 | |
| 2023 | 3 | |
| 2024 | 2 | |
| 2025 | 4 | |
| 2026 | 1 |
Its field-weighted citation impact is 3.00: it has been cited 3.00 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information
- comorbidity index
- Charlson Comorbidity Index
- administrative data
- medical chart review
- interobserver agreement
- intensive care unit patients
- risk adjustment
- coding accuracy
Work with this paper
Most-cited papers in Health Professions
- DETERMINATION OF SERUM PROTEINS BY MEANS OF THE BIURET REACTIONAllan Godfrey Gornall, Charles J. Bardawill, Maxima M. David · Journal of Biological Chemistry · 1949 · 16,172 citations
- Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation scienceLaura J. Damschroder, David Clark Aron, Rosalind E. Keith and 3 more · Implementation Science · 2009 · 15,527 citations
- FUNCTIONAL EVALUATION: THE BARTHEL INDEX.FLORENCE I. MAHONEY, DOROTHEA W. BARTHEL · PubMed · 1965 · 15,488 citations
- The Timed “Up & Go”: A Test of Basic Functional Mobility for Frail Elderly PersonsDiane Podsiadlo, Sandra Richardson · Journal of the American Geriatrics Society · 1991 · 15,001 citations
- National Committee for Clinical Laboratory StandardsErika Bruck · PEDIATRICS · 1980 · 14,735 citations
Questions about this paper
How do I cite this paper in APA style?
Li, M. H.-G., Hutchinson, A. F., TACEY, M. A., & Duke, G. J. (2019). Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Health & Care Informatics, 26(1), e000016. https://doi.org/10.1136/bmjhci-2019-000016
How many times has this paper been cited?
25 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: read the free full text at BMJ Health & Care Informatics.
Who wrote this paper?
Michael H.-G. Li, Anastasia F. Hutchinson, MARK A. TACEY, Graeme J. Duke.
What is the DOI of this paper?
10.1136/bmjhci-2019-000016. The permanent link is https://doi.org/10.1136/bmjhci-2019-000016.
Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.