Conference paper · 2024 · Open access
Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733 · Published 14 October 2024 · DOI 10.1109/iros58592.2024.10801876
In brief
“Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control” is a 2024 conference paper by Baha Zarrouki and 2 co-authors, published in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). OpenAlex counts 20 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).
- Citations
- 20
- Most cited in
- 2026 (18)
- Field-weighted impact
- 6.93
- References
- 36
- Authors
- 3
Abstract
Propagating uncertainties through nonlinear system dynamics in the context of Stochastic Nonlinear Model Predictive Control (SNMPC) is challenging, especially for high-dimensional systems requiring real-time control and operating under time-variant uncertainties such as autonomous vehicles. In this work, we propose an Adaptive SNMPC (aSNMPC) driven by Deep Reinforcement Learning (DRL) to optimize uncertainty handling, constraints robustification, feasibility, and closed-loop performance. To this end, our SNMPC uses Polynomial Chaos Expansion (PCE) for efficient uncertainty propagation, limits its propagation time through an Uncertainty Propagation Horizon (UPH), and transforms nonlinear chance constraints into robustified deterministic ones. We conceive a DRL agent to proactively anticipate upcoming control tasks and to dynamically reduce conservatism by determining the most suitable constraints robustification factor κ, and to enhance feasibility by choosing optimal UPH length Tu. We analyze the trained DRL agent’s decision-making process and highlight its ability to learn context-dependent optimal parameters. We showcase the enhanced robustness and feasibility of our DRL-driven aSNMPC through the real-time motion control task of an autonomous passenger vehicle when confronted with significant time-variant disturbances while achieving a minimum solution frequency of 110Hz. The code used in this research is publicly accessible as open-source software: https://github.com/bzarr/TUM-CONTROL
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Zarrouki, B., Wang, C., & Betz, J. (2024). Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876
MLA 9
Zarrouki, Baha, et al. “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control.” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024, pp. 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876.
Chicago
Zarrouki, Baha, Chenyang Wang, and Johannes Betz. 2024. “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control.” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS): 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876.
Harvard
Zarrouki, B., Wang, C. and Betz, J. (2024) ‘Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control’, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 12726–12733. doi:10.1109/iros58592.2024.10801876.
IEEE
B. Zarrouki, C. Wang, and J. Betz, “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 12726–12733, 2024, doi: 10.1109/iros58592.2024.10801876.
BibTeX
@inproceedings{zarrouki2024adaptive,
title = {{Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control}},
author = {Zarrouki, Baha and Wang, Chenyang and Betz, Johannes},
booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
year = {2024},
pages = {12726--12733},
doi = {10.1109/iros58592.2024.10801876},
url = {https://doi.org/10.1109/iros58592.2024.10801876}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 1 | |
| 2025 | 1 | |
| 2026 | 18 |
Its field-weighted citation impact is 6.93: it has been cited 6.93 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization
- adaptive model predictive control
- deep reinforcement learning
- polynomial chaos expansion
- error propagation
- real-time control
- closed-loop performance
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Zarrouki, B., Wang, C., & Betz, J. (2024). Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876
How many times has this paper been cited?
20 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Baha Zarrouki, Chenyang Wang, Johannes Betz.
What is the DOI of this paper?
10.1109/iros58592.2024.10801876, permanently at https://doi.org/10.1109/iros58592.2024.10801876. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.