Journal article · 2022 · Open access

Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving

Jingda Wu, Zhiyu Huang, Chen Lv

IEEE Transactions on Intelligent Vehicles, 8(1), 194–203 · Published 21 June 2022 · DOI 10.1109/tiv.2022.3185159

Open PDFView at the publisherCite this paper

In brief

“Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving” is a 2022 journal article by Jingda Wu and 2 co-authors, published in IEEE Transactions on Intelligent Vehicles. OpenAlex counts 192 citations as of 22 November 2026, which puts it in the top 2% of works published in 2022 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
192
Most cited in
2025 (54)
Field-weighted impact
8.43
References
52
Authors
3

Abstract

To further improve learning efficiency and performance of reinforcement learning (RL), a novel uncertainty-aware model-based RL method is proposed and validated in autonomous driving scenarios in this paper. First, an action-conditioned ensemble model with the capability of uncertainty assessment is established as the environment model. Then, a novel uncertainty-aware model-based RL method is developed based on the adaptive truncation approach, providing virtual interactions between the agent and environment model, and improving RL’s learning efficiency and performance. The proposed method is then implemented in end-to-end autonomous vehicle control tasks, validated and compared with state-of-the-art methods under various driving scenarios. Validation results suggest that the proposed method outperforms the model-free RL approach with respect to learning efficiency, and model-based approach with respect to both efficiency and performance, demonstrating its feasibility and effectiveness.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Wu, J., Huang, Z., & Lv, C. (2022). Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving. IEEE Transactions on Intelligent Vehicles, 8(1), 194–203. https://doi.org/10.1109/tiv.2022.3185159

MLA 9

Wu, Jingda, et al. “Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving.” IEEE Transactions on Intelligent Vehicles, vol. 8, no. 1, 2022, pp. 194–203. https://doi.org/10.1109/tiv.2022.3185159.

Chicago

Wu, Jingda, Zhiyu Huang, and Chen Lv. 2022. “Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving.” IEEE Transactions on Intelligent Vehicles 8 (1): 194–203. https://doi.org/10.1109/tiv.2022.3185159.

Harvard

Wu, J., Huang, Z. and Lv, C. (2022) ‘Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving’, IEEE Transactions on Intelligent Vehicles, 8(1), pp. 194–203. doi:10.1109/tiv.2022.3185159.

IEEE

J. Wu, Z. Huang, and C. Lv, “Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving,” IEEE Transactions on Intelligent Vehicles, vol. 8, no. 1, pp. 194–203, 2022, doi: 10.1109/tiv.2022.3185159.

BibTeX

@article{wu2022uncertainty,
  title     = {{Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving}},
  author    = {Wu, Jingda and Huang, Zhiyu and Lv, Chen},
  journal   = {IEEE Transactions on Intelligent Vehicles},
  year      = {2022},
  volume    = {8},
  number    = {1},
  pages     = {194--203},
  doi       = {10.1109/tiv.2022.3185159},
  url       = {https://doi.org/10.1109/tiv.2022.3185159}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202299
20233737
20244949
20255454
20264343

Its field-weighted citation impact is 8.43: it has been cited 8.43 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • model-based reinforcement learning
  • uncertainty estimation
  • autonomous driving
  • adaptive truncation
  • virtual interaction
  • learning efficiency
  • environment modeling

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Wu, J., Huang, Z., & Lv, C. (2022). Uncertainty-Aware Model-Based Reinforcement Learning: Methodology and Application in Autonomous Driving. IEEE Transactions on Intelligent Vehicles, 8(1), 194–203. https://doi.org/10.1109/tiv.2022.3185159

How many times has this paper been cited?

192 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Jingda Wu, Zhiyu Huang, Chen Lv.

What is the DOI of this paper?

10.1109/tiv.2022.3185159, permanently at https://doi.org/10.1109/tiv.2022.3185159. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.