Journal article · 2023 · Open access

Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving

Carl-Johan Hoel, Krister Wolff, Leo Laine

IEEE Transactions on Intelligent Transportation Systems, 24(6), 6030–6041 · Published 16 March 2023 · DOI 10.1109/tits.2023.3251376

Open PDFView at the publisherCite this paper

In brief

“Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving” is a 2023 journal article by Carl-Johan Hoel and 2 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 100 citations as of 22 November 2026, which puts it in the top 8% of works published in 2023 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
100
Most cited in
2026 (33)
Field-weighted impact
5.39
References
51
Authors
3

Abstract

Reinforcement learning (RL) can be used to create a decision-making agent for autonomous driving. However, previous approaches provide black-box solutions, which do not offer information on how confident the agent is about its decisions. An estimate of both the aleatoric and epistemic uncertainty of the agent’s decisions is fundamental for real-world applications of autonomous driving. Therefore, this paper introduces the Ensemble Quantile Networks (EQN) method, which combines distributional RL with an ensemble approach, to obtain a complete uncertainty estimate. The distribution over returns is estimated by learning its quantile function implicitly, which gives the aleatoric uncertainty, whereas an ensemble of agents is trained on bootstrapped data to provide a Bayesian estimation of the epistemic uncertainty. A criterion for classifying which decisions that have an unacceptable uncertainty is also introduced. The results show that the EQN method can balance risk and time efficiency in different occluded intersection scenarios, by considering the estimated aleatoric uncertainty. Furthermore, it is shown that the trained agent can use the epistemic uncertainty information to identify situations that the agent has not been trained for and thereby avoid making unfounded, potentially dangerous, decisions outside of the training distribution.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Hoel, C.-J., Wolff, K., & Laine, L. (2023). Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems, 24(6), 6030–6041. https://doi.org/10.1109/tits.2023.3251376

MLA 9

Hoel, Carl-Johan, et al. “Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving.” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 6, 2023, pp. 6030–6041. https://doi.org/10.1109/tits.2023.3251376.

Chicago

Hoel, Carl-Johan, Krister Wolff, and Leo Laine. 2023. “Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving.” IEEE Transactions on Intelligent Transportation Systems 24 (6): 6030–6041. https://doi.org/10.1109/tits.2023.3251376.

Harvard

Hoel, C.-J., Wolff, K. and Laine, L. (2023) ‘Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving’, IEEE Transactions on Intelligent Transportation Systems, 24(6), pp. 6030–6041. doi:10.1109/tits.2023.3251376.

IEEE

C.-J. Hoel, K. Wolff, and L. Laine, “Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 6, pp. 6030–6041, 2023, doi: 10.1109/tits.2023.3251376.

BibTeX

@article{hoel2023ensemble,
  title     = {{Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving}},
  author    = {Hoel, Carl-Johan and Wolff, Krister and Laine, Leo},
  journal   = {IEEE Transactions on Intelligent Transportation Systems},
  year      = {2023},
  volume    = {24},
  number    = {6},
  pages     = {6030--6041},
  doi       = {10.1109/tits.2023.3251376},
  url       = {https://doi.org/10.1109/tits.2023.3251376}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202222
202388
20242727
20253030
20263333

Its field-weighted citation impact is 5.39: it has been cited 5.39 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • uncertainty estimation
  • aleatoric uncertainty
  • epistemic uncertainty
  • distributional reinforcement learning
  • quantile function
  • ensemble learning
  • bootstrapping
  • autonomous driving

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Hoel, C.-J., Wolff, K., & Laine, L. (2023). Ensemble Quantile Networks: Uncertainty-Aware Reinforcement Learning With Applications in Autonomous Driving. IEEE Transactions on Intelligent Transportation Systems, 24(6), 6030–6041. https://doi.org/10.1109/tits.2023.3251376

How many times has this paper been cited?

100 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Carl-Johan Hoel, Krister Wolff, Leo Laine.

What is the DOI of this paper?

10.1109/tits.2023.3251376, permanently at https://doi.org/10.1109/tits.2023.3251376. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.