Conference paper · 2024 · Open access
Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification
IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81 · Published 27 May 2024 · DOI 10.1109/icst60714.2024.00016
In brief
“Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification” is a 2024 conference paper by Ruben Grewal and 2 co-authors, published in IEEE International Conference on Software Testing, Verification and Validation (ICST). OpenAlex counts 53 citations as of 22 November 2026, which puts it in the top 2% of works published in 2024 by citations. It is open access under a CC BY-SA licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 53
- Most cited in
- 2026 (27)
- Field-weighted impact
- 4.08
- References
- 64
- Authors
- 3
Abstract
The automated real-time recognition of unexpected situations plays a crucial role in the safety of autonomous vehicles, especially in unsupported and unpredictable scenarios. This paper evaluates different Bayesian uncertainty quantification methods from the deep learning domain for the anticipa-tory testing of safety-critical misbehaviours during system-level simulation-based testing. Specifically, we compute uncertainty scores as the vehicle executes, following the intuition that high uncertainty scores are indicative of unsupported runtime conditions that can be used to distinguish safe from failure-inducing driving behaviors. In our study, we conducted an evaluation of the effectiveness and computational overhead associated with two Bayesian uncertainty quantification methods, namely Me-Dropout and Deep Ensembles, for misbehaviour avoidance. Over-all, for three benchmarks from the Udacity simulator comprising both out-of-distribution and unsafe conditions introduced via mutation testing, both methods successfully detected a high number of out-of-bounds episodes providing early warnings several seconds in advance, outperforming two state-of-the-art misbehaviour prediction methods based on autoencoders and attention maps in terms of effectiveness and efficiency. Notably, Deep Ensembles detected most misbehaviours without any false alarms and did so even when employing a relatively small number of models, making them computationally feasible for real-time detection. Our findings suggest that incorporating uncertainty quantification methods is a viable approach for building fail-safe mechanisms in deep neural network-based autonomous vehicles.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Grewal, R., Tonella, P., & Stocco, A. (2024). Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification. IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81. https://doi.org/10.1109/icst60714.2024.00016
MLA 9
Grewal, Ruben, et al. “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification.” IEEE International Conference on Software Testing, Verification and Validation (ICST), 2024, pp. 70–81. https://doi.org/10.1109/icst60714.2024.00016.
Chicago
Grewal, Ruben, Paolo Tonella, and Andrea Stocco. 2024. “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification.” IEEE International Conference on Software Testing, Verification and Validation (ICST): 70–81. https://doi.org/10.1109/icst60714.2024.00016.
Harvard
Grewal, R., Tonella, P. and Stocco, A. (2024) ‘Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification’, IEEE International Conference on Software Testing, Verification and Validation (ICST), pp. 70–81. doi:10.1109/icst60714.2024.00016.
IEEE
R. Grewal, P. Tonella, and A. Stocco, “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification,” IEEE International Conference on Software Testing, Verification and Validation (ICST), pp. 70–81, 2024, doi: 10.1109/icst60714.2024.00016.
BibTeX
@inproceedings{grewal2024predicting,
title = {{Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification}},
author = {Grewal, Ruben and Tonella, Paolo and Stocco, Andrea},
booktitle = {IEEE International Conference on Software Testing, Verification and Validation (ICST)},
year = {2024},
pages = {70--81},
doi = {10.1109/icst60714.2024.00016},
url = {https://doi.org/10.1109/icst60714.2024.00016}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 8 | |
| 2025 | 18 | |
| 2026 | 27 |
Its field-weighted citation impact is 4.08: it has been cited 4.08 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning
- autonomous driving safety
- Bayesian uncertainty quantification
- ensemble deep learning
- simulation-based testing
- out-of-distribution detection
- mutation testing
- fail-safe mechanism
- real-time anomaly detection
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Grewal, R., Tonella, P., & Stocco, A. (2024). Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification. IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81. https://doi.org/10.1109/icst60714.2024.00016
How many times has this paper been cited?
53 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Ruben Grewal, Paolo Tonella, Andrea Stocco.
What is the DOI of this paper?
10.1109/icst60714.2024.00016, permanently at https://doi.org/10.1109/icst60714.2024.00016. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.