Journal article · 2019 · Open access

Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study

Michael H.-G. Li, Anastasia F. Hutchinson, MARK A. TACEY, Graeme J. Duke

BMJ Health & Care Informatics, 26(1), e000016 · Published 1 April 2019 · DOI 10.1136/bmjhci-2019-000016

Free PDFView at the publisherCite this paper

In brief

“Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study” is a 2019 journal article by Michael H.-G. Li and 3 co-authors, published in BMJ Health & Care Informatics. OpenAlex counts 25 citations as of 15 November 2026, which puts it in the top 9% of works published in 2019 by citations. It is open access under a CC BY-NC licence: the full text is free to read at BMJ Health & Care Informatics.

Citations
25
Most cited in
2021 (6)
Field-weighted impact
3.00
References
51
Authors
4

Abstract

Background Hospital reporting systems commonly use administrative data to calculate comorbidity scores in order to provide risk-adjustment to outcome indicators. Objective We aimed to elucidate the level of agreement between administrative coding data and medical chart review for extraction of comorbidities included in the Charlson Comorbidity Index (CCI) and Elixhauser Index (EI) for patients admitted to the intensive care unit of a university-affiliated hospital. Method We conducted an examination of a random cross-section of 100 patient episodes over 12 months (July 2012 to June 2013) for the 19 CCI and 30 EI comorbidities reported in administrative data and the manual medical record system. CCI and EI comorbidities were collected in order to ascertain the difference in mean indices, detect any systematic bias, and ascertain inter-rater agreement. Results We found reasonable inter-rater agreement (kappa (κ) coefficient ≥0.4) for cardiorespiratory and oncological comorbidities, but little agreement (κ<0.4) for other comorbidities. Comorbidity indices derived from administrative data were significantly lower than from chart review: −0.81 (95% CI − 1.29 to − 0.33; p=0.001) for CCI, and −2.57 (95% CI −4.46 to −0.68; p=0.008) for EI. Conclusion While cardiorespiratory and oncological comorbidities were reliably coded in administrative data, most other comorbidities were under-reported and an unreliable source for estimation of CCI or EI in intensive care patients. Further examination of a large multicentre population is required to confirm our findings.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Li, M. H.-G., Hutchinson, A. F., TACEY, M. A., & Duke, G. J. (2019). Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Health & Care Informatics, 26(1), e000016. https://doi.org/10.1136/bmjhci-2019-000016

MLA 9

Li, Michael H.-G., et al. “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study.” BMJ Health & Care Informatics, vol. 26, no. 1, 2019, p. e000016. https://doi.org/10.1136/bmjhci-2019-000016.

Chicago

Li, Michael H.-G., Anastasia F. Hutchinson, MARK A. TACEY, and Graeme J. Duke. 2019. “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study.” BMJ Health & Care Informatics 26 (1): e000016. https://doi.org/10.1136/bmjhci-2019-000016.

Harvard

Li, M. H.-G. et al. (2019) ‘Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study’, BMJ Health & Care Informatics, 26(1), p. e000016. doi:10.1136/bmjhci-2019-000016.

IEEE

M. H.-G. Li, A. F. Hutchinson, M. A. TACEY, and G. J. Duke, “Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study,” BMJ Health & Care Informatics, vol. 26, no. 1, p. e000016, 2019, doi: 10.1136/bmjhci-2019-000016.

BibTeX

@article{li2019reliability,
  title     = {{Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study}},
  author    = {Li, Michael H.-G. and Hutchinson, Anastasia F. and TACEY, MARK A. and Duke, Graeme J.},
  journal   = {BMJ Health \& Care Informatics},
  year      = {2019},
  volume    = {26},
  number    = {1},
  pages     = {e000016},
  doi       = {10.1136/bmjhci-2019-000016},
  url       = {https://doi.org/10.1136/bmjhci-2019-000016}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202044
202166
202255
202333
202422
202544
202611

Its field-weighted citation impact is 3.00: it has been cited 3.00 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Health Professions › Health Information Management › Medical Coding and Health Information

  • comorbidity index
  • Charlson Comorbidity Index
  • administrative data
  • medical chart review
  • interobserver agreement
  • intensive care unit patients
  • risk adjustment
  • coding accuracy

Work with this paper

Most-cited papers in Health Professions

All highly cited Health Professions papers

Questions about this paper

How do I cite this paper in APA style?

Li, M. H.-G., Hutchinson, A. F., TACEY, M. A., & Duke, G. J. (2019). Reliability of comorbidity scores derived from administrative data in the tertiary hospital intensive care setting: a cross-sectional study. BMJ Health & Care Informatics, 26(1), e000016. https://doi.org/10.1136/bmjhci-2019-000016

How many times has this paper been cited?

25 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at BMJ Health & Care Informatics.

Who wrote this paper?

Michael H.-G. Li, Anastasia F. Hutchinson, MARK A. TACEY, Graeme J. Duke.

What is the DOI of this paper?

10.1136/bmjhci-2019-000016. The permanent link is https://doi.org/10.1136/bmjhci-2019-000016.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.