Conference paper · 2024 · Open access

Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control

Baha Zarrouki, Chenyang Wang, Johannes Betz

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733 · Published 14 October 2024 · DOI 10.1109/iros58592.2024.10801876

Open PDFView at the publisherCite this paper

In brief

“Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control” is a 2024 conference paper by Baha Zarrouki and 2 co-authors, published in IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). OpenAlex counts 20 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at arXiv (Cornell University).

Citations
20
Most cited in
2026 (18)
Field-weighted impact
6.93
References
36
Authors
3

Abstract

Propagating uncertainties through nonlinear system dynamics in the context of Stochastic Nonlinear Model Predictive Control (SNMPC) is challenging, especially for high-dimensional systems requiring real-time control and operating under time-variant uncertainties such as autonomous vehicles. In this work, we propose an Adaptive SNMPC (aSNMPC) driven by Deep Reinforcement Learning (DRL) to optimize uncertainty handling, constraints robustification, feasibility, and closed-loop performance. To this end, our SNMPC uses Polynomial Chaos Expansion (PCE) for efficient uncertainty propagation, limits its propagation time through an Uncertainty Propagation Horizon (UPH), and transforms nonlinear chance constraints into robustified deterministic ones. We conceive a DRL agent to proactively anticipate upcoming control tasks and to dynamically reduce conservatism by determining the most suitable constraints robustification factor κ, and to enhance feasibility by choosing optimal UPH length Tu. We analyze the trained DRL agent’s decision-making process and highlight its ability to learn context-dependent optimal parameters. We showcase the enhanced robustness and feasibility of our DRL-driven aSNMPC through the real-time motion control task of an autonomous passenger vehicle when confronted with significant time-variant disturbances while achieving a minimum solution frequency of 110Hz. The code used in this research is publicly accessible as open-source software: https://github.com/bzarr/TUM-CONTROL

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Zarrouki, B., Wang, C., & Betz, J. (2024). Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876

MLA 9

Zarrouki, Baha, et al. “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control.” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2024, pp. 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876.

Chicago

Zarrouki, Baha, Chenyang Wang, and Johannes Betz. 2024. “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control.” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS): 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876.

Harvard

Zarrouki, B., Wang, C. and Betz, J. (2024) ‘Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control’, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 12726–12733. doi:10.1109/iros58592.2024.10801876.

IEEE

B. Zarrouki, C. Wang, and J. Betz, “Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control,” IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 12726–12733, 2024, doi: 10.1109/iros58592.2024.10801876.

BibTeX

@inproceedings{zarrouki2024adaptive,
  title     = {{Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control}},
  author    = {Zarrouki, Baha and Wang, Chenyang and Betz, Johannes},
  booktitle = {IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)},
  year      = {2024},
  pages     = {12726--12733},
  doi       = {10.1109/iros58592.2024.10801876},
  url       = {https://doi.org/10.1109/iros58592.2024.10801876}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202411
202511
20261818

Its field-weighted citation impact is 6.93: it has been cited 6.93 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Control and Systems Engineering › Advanced Control Systems Optimization

  • adaptive model predictive control
  • deep reinforcement learning
  • polynomial chaos expansion
  • error propagation
  • real-time control
  • closed-loop performance

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Zarrouki, B., Wang, C., & Betz, J. (2024). Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control. IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 12726–12733. https://doi.org/10.1109/iros58592.2024.10801876

How many times has this paper been cited?

20 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Baha Zarrouki, Chenyang Wang, Johannes Betz.

What is the DOI of this paper?

10.1109/iros58592.2024.10801876, permanently at https://doi.org/10.1109/iros58592.2024.10801876. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.