Review article · 2023 · Open access

Artificial intelligence bias in medical system designs: a systematic review

Ashish Kumar, Vivekanand Aelgani, Rubeena Vohra, Suneet Kumar Gupta, Mrinalini Bhagawati, Sudip Paul, Luca Saba, Neha Suri, Narendra Nath Khanna, John R. Laird, Amer M. Johri, Manudeep K. Kalra and 4 more

Multimedia Tools and Applications, 83(6), 18005–18057 · Published 22 July 2023 · DOI 10.1007/s11042-023-16029-x

Free PDFView at the publisherCite this paper

In brief

“Artificial intelligence bias in medical system designs: a systematic review” is a 2023 review article by Ashish Kumar and 15 co-authors, published in Multimedia Tools and Applications. OpenAlex counts 72 citations as of 15 November 2026, which puts it in the top 7% of works published in 2023 by citations. It is open access under a public domain licence: the full text is free to read at Multimedia Tools and Applications.

Citations
72
Most cited in
2025 (41)
Field-weighted impact
0.70
References
143
Authors
16

Abstract

Inherent bias in the artificial intelligence (AI)-model brings inaccuracies and variabilities during clinical deployment of the model. It is challenging to recognize the source of bias in AI-model due to variations in datasets and black box nature of system design. Additionally, there is no distinct process to identify the potential source of bias in the AI-model. To the best of our knowledge, this is the first review of its kind that addresses the bias in AI-model by categorizing 48 studies into three classes, namely, point-based, image-based, and hybrid-based AI-models. Selection strategy using PRISMA is adopted to select the 72 crucial AI studies for identifying bias in AI models. Using the three classes, bias is identified in these studies based on 44 critical AI attributes. Bias in the AI-models is computed by analytical, butterfly, and ranking-based bias models. These bias models were evaluated using two experts and compared using variability analysis. AI-studies that lacked sufficient AI-attributes are more prone to risk-of-bias (RoB) in all three classes. Studies with high RoB loses fins in the butterfly model. It has been analyzed that the majority of the studies in healthcare suffer from data bias and algorithmic bias due to incomplete specifications mentioned in the design protocol and weak AI design exploited for prediction.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Kumar, A., Aelgani, V., Vohra, R., Gupta, S. K., Bhagawati, M., Paul, S., Saba, L., Suri, N., Khanna, N. N., Laird, J. R., Johri, A. M., Kalra, M. K., Fouda, M. M., Fatemi, M., Naidu, S., & Suri, J. S. (2023). Artificial intelligence bias in medical system designs: a systematic review. Multimedia Tools and Applications, 83(6), 18005–18057. https://doi.org/10.1007/s11042-023-16029-x

MLA 9

Kumar, Ashish, et al. “Artificial intelligence bias in medical system designs: a systematic review.” Multimedia Tools and Applications, vol. 83, no. 6, 2023, pp. 18005–18057. https://doi.org/10.1007/s11042-023-16029-x.

Chicago

Kumar, Ashish, Vivekanand Aelgani, Rubeena Vohra, Suneet Kumar Gupta, Mrinalini Bhagawati, Sudip Paul, Luca Saba, et al. 2023. “Artificial intelligence bias in medical system designs: a systematic review.” Multimedia Tools and Applications 83 (6): 18005–18057. https://doi.org/10.1007/s11042-023-16029-x.

Harvard

Kumar, A. et al. (2023) ‘Artificial intelligence bias in medical system designs: a systematic review’, Multimedia Tools and Applications, 83(6), pp. 18005–18057. doi:10.1007/s11042-023-16029-x.

IEEE

A. Kumar et al., “Artificial intelligence bias in medical system designs: a systematic review,” Multimedia Tools and Applications, vol. 83, no. 6, pp. 18005–18057, 2023, doi: 10.1007/s11042-023-16029-x.

BibTeX

@article{kumar2023artificial,
  title     = {{Artificial intelligence bias in medical system designs: a systematic review}},
  author    = {Kumar, Ashish and Aelgani, Vivekanand and Vohra, Rubeena and Gupta, Suneet Kumar and Bhagawati, Mrinalini and Paul, Sudip and Saba, Luca and Suri, Neha and Khanna, Narendra Nath and Laird, John R. and Johri, Amer M. and Kalra, Manudeep K. and Fouda, Mostafa M. and Fatemi, Mostafa and Naidu, Subbaram and Suri, Jasjit S.},
  journal   = {Multimedia Tools and Applications},
  year      = {2023},
  volume    = {83},
  number    = {6},
  pages     = {18005--18057},
  doi       = {10.1007/s11042-023-16029-x},
  url       = {https://doi.org/10.1007/s11042-023-16029-x}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202322
202499
20254141
20262020

Its field-weighted citation impact is 0.70: it has been cited 0.70 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education

  • algorithmic bias
  • data bias
  • risk of bias
  • hybrid AI models
  • clinical implementation of AI
  • medical prediction

Work with this paper

Most-cited papers in Medicine

All highly cited Medicine papers

Questions about this paper

How do I cite this paper in APA style?

Kumar, A., Aelgani, V., Vohra, R., Gupta, S. K., Bhagawati, M., Paul, S., Saba, L., Suri, N., Khanna, N. N., Laird, J. R., Johri, A. M., Kalra, M. K., Fouda, M. M., Fatemi, M., Naidu, S., & Suri, J. S. (2023). Artificial intelligence bias in medical system designs: a systematic review. Multimedia Tools and Applications, 83(6), 18005–18057. https://doi.org/10.1007/s11042-023-16029-x

How many times has this paper been cited?

72 times, according to OpenAlex on 15 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access: read the free full text at Multimedia Tools and Applications.

Who wrote this paper?

Ashish Kumar, Vivekanand Aelgani, Rubeena Vohra, Suneet Kumar Gupta, Mrinalini Bhagawati, Sudip Paul, Luca Saba, Neha Suri, Narendra Nath Khanna, John R. Laird, Amer M. Johri, Manudeep K. Kalra and 4 more.

What is the DOI of this paper?

10.1007/s11042-023-16029-x. The permanent link is https://doi.org/10.1007/s11042-023-16029-x.

Bibliographic data from OpenAlex (CC0), last checked 15 November 2026. ResearchGuru does not host this paper; the links go to the publisher or the repository that does.