Conference paper · 2024 · Open access

Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification

Ruben Grewal, Paolo Tonella, Andrea Stocco

IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81 · Published 27 May 2024 · DOI 10.1109/icst60714.2024.00016

Open PDFView at the publisherCite this paper

In brief

“Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification” is a 2024 conference paper by Ruben Grewal and 2 co-authors, published in IEEE International Conference on Software Testing, Verification and Validation (ICST). OpenAlex counts 53 citations as of 22 November 2026, which puts it in the top 2% of works published in 2024 by citations. It is open access under a CC BY-SA licence: the full text is free to read at arXiv (Cornell University).

Citations
53
Most cited in
2026 (27)
Field-weighted impact
4.08
References
64
Authors
3

Abstract

The automated real-time recognition of unexpected situations plays a crucial role in the safety of autonomous vehicles, especially in unsupported and unpredictable scenarios. This paper evaluates different Bayesian uncertainty quantification methods from the deep learning domain for the anticipa-tory testing of safety-critical misbehaviours during system-level simulation-based testing. Specifically, we compute uncertainty scores as the vehicle executes, following the intuition that high uncertainty scores are indicative of unsupported runtime conditions that can be used to distinguish safe from failure-inducing driving behaviors. In our study, we conducted an evaluation of the effectiveness and computational overhead associated with two Bayesian uncertainty quantification methods, namely Me-Dropout and Deep Ensembles, for misbehaviour avoidance. Over-all, for three benchmarks from the Udacity simulator comprising both out-of-distribution and unsafe conditions introduced via mutation testing, both methods successfully detected a high number of out-of-bounds episodes providing early warnings several seconds in advance, outperforming two state-of-the-art misbehaviour prediction methods based on autoencoders and attention maps in terms of effectiveness and efficiency. Notably, Deep Ensembles detected most misbehaviours without any false alarms and did so even when employing a relatively small number of models, making them computationally feasible for real-time detection. Our findings suggest that incorporating uncertainty quantification methods is a viable approach for building fail-safe mechanisms in deep neural network-based autonomous vehicles.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Grewal, R., Tonella, P., & Stocco, A. (2024). Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification. IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81. https://doi.org/10.1109/icst60714.2024.00016

MLA 9

Grewal, Ruben, et al. “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification.” IEEE International Conference on Software Testing, Verification and Validation (ICST), 2024, pp. 70–81. https://doi.org/10.1109/icst60714.2024.00016.

Chicago

Grewal, Ruben, Paolo Tonella, and Andrea Stocco. 2024. “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification.” IEEE International Conference on Software Testing, Verification and Validation (ICST): 70–81. https://doi.org/10.1109/icst60714.2024.00016.

Harvard

Grewal, R., Tonella, P. and Stocco, A. (2024) ‘Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification’, IEEE International Conference on Software Testing, Verification and Validation (ICST), pp. 70–81. doi:10.1109/icst60714.2024.00016.

IEEE

R. Grewal, P. Tonella, and A. Stocco, “Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification,” IEEE International Conference on Software Testing, Verification and Validation (ICST), pp. 70–81, 2024, doi: 10.1109/icst60714.2024.00016.

BibTeX

@inproceedings{grewal2024predicting,
  title     = {{Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification}},
  author    = {Grewal, Ruben and Tonella, Paolo and Stocco, Andrea},
  booktitle = {IEEE International Conference on Software Testing, Verification and Validation (ICST)},
  year      = {2024},
  pages     = {70--81},
  doi       = {10.1109/icst60714.2024.00016},
  url       = {https://doi.org/10.1109/icst60714.2024.00016}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202488
20251818
20262727

Its field-weighted citation impact is 4.08: it has been cited 4.08 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Adversarial Robustness in Machine Learning

  • autonomous driving safety
  • Bayesian uncertainty quantification
  • ensemble deep learning
  • simulation-based testing
  • out-of-distribution detection
  • mutation testing
  • fail-safe mechanism
  • real-time anomaly detection

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Grewal, R., Tonella, P., & Stocco, A. (2024). Predicting Safety Misbehaviours in Autonomous Driving Systems Using Uncertainty Quantification. IEEE International Conference on Software Testing, Verification and Validation (ICST), 70–81. https://doi.org/10.1109/icst60714.2024.00016

How many times has this paper been cited?

53 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Ruben Grewal, Paolo Tonella, Andrea Stocco.

What is the DOI of this paper?

10.1109/icst60714.2024.00016, permanently at https://doi.org/10.1109/icst60714.2024.00016. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.