Journal article · 2023 · Open access
Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making
IEEE Transactions on Intelligent Transportation Systems, 24(11), 12345–12356 · Published 23 June 2023 · DOI 10.1109/tits.2023.3285440
In brief
“Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making” is a 2023 journal article by Mohammad Al-Sharman and 5 co-authors, published in IEEE Transactions on Intelligent Transportation Systems. OpenAlex counts 130 citations as of 22 November 2026, which puts it in the top 8% of works published in 2023 by citations. It is open access under a CC BY licence: the full text is free to read.
- Citations
- 130
- Most cited in
- 2025 (62)
- Field-weighted impact
- 7.95
- References
- 46
- Authors
- 6
Abstract
Reinforcement learning-based techniques, empowered by deep-structured neural nets, have demonstrated superiority over rule-based methods in terms of making high-level behavioral decisions due to qualities related to handling large state spaces. Nonetheless, their training time, sample efficiency and the feasibility of the learnt behaviors remain key concerns. In this paper, we propose a novel hierarchical reinforcement learning-based decision-making architecture for learning left-turn policies at unsignalized intersections with feasibility guarantees. The proposed technique is comprised of two layers; a high-level learning-based behavioral planning layer which adopts soft actor-critic (SAC) principles to learn high-level, non-conservative yet safe, driving behaviors, and a low-level motion planning layer that uses Model Predictive Control (MPC) framework to ensure feasibility of the two-dimensional left-turn maneuver. The high-level layer generates reference signals of velocity and yaw angles for the ego vehicle taking into account safety and collision avoidance with the intersection vehicles, whereas the low-level motion planning layer solves an optimization problem to track these reference commands taking into account several vehicle dynamic constraints and ride comfort. While training the behavioral SAC-based planning layer, We develop an adaptive entropy regularization technique that results in faster convergence, higher mean rewards, and lower collision rates. We validate the proposed decision-making scheme in simulated environments and compare with other model free Reinforcement Learning (RL) baselines. The results demonstrate that the proposed integrated framework possesses better training and navigation capabilities.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Al-Sharman, M., Dempster, R., Daoud, M. A., Nasr, M., Rayside, D., & Melek, W. (2023). Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making. IEEE Transactions on Intelligent Transportation Systems, 24(11), 12345–12356. https://doi.org/10.1109/tits.2023.3285440
MLA 9
Al-Sharman, Mohammad, et al. “Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making.” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 11, 2023, pp. 12345–12356. https://doi.org/10.1109/tits.2023.3285440.
Chicago
Al-Sharman, Mohammad, Rowan Dempster, Mohamed A. Daoud, Mahmoud Nasr, Derek Rayside, and William Melek. 2023. “Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making.” IEEE Transactions on Intelligent Transportation Systems 24 (11): 12345–12356. https://doi.org/10.1109/tits.2023.3285440.
Harvard
Al-Sharman, M. et al. (2023) ‘Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making’, IEEE Transactions on Intelligent Transportation Systems, 24(11), pp. 12345–12356. doi:10.1109/tits.2023.3285440.
IEEE
M. Al-Sharman, R. Dempster, M. A. Daoud, M. Nasr, D. Rayside, and W. Melek, “Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making,” IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 11, pp. 12345–12356, 2023, doi: 10.1109/tits.2023.3285440.
BibTeX
@article{alsharman2023self,
title = {{Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making}},
author = {Al-Sharman, Mohammad and Dempster, Rowan and Daoud, Mohamed A. and Nasr, Mahmoud and Rayside, Derek and Melek, William},
journal = {IEEE Transactions on Intelligent Transportation Systems},
year = {2023},
volume = {24},
number = {11},
pages = {12345--12356},
doi = {10.1109/tits.2023.3285440},
url = {https://doi.org/10.1109/tits.2023.3285440}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2022 | 2 | |
| 2023 | 2 | |
| 2024 | 27 | |
| 2025 | 62 | |
| 2026 | 37 |
Its field-weighted citation impact is 7.95: it has been cited 7.95 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety
- autonomous driving
- unsignalized intersections
- hierarchical reinforcement learning
- soft actor-critic
- model predictive control
- motion planning
- behavior planning
- collision avoidance
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Al-Sharman, M., Dempster, R., Daoud, M. A., Nasr, M., Rayside, D., & Melek, W. (2023). Self-Learned Autonomous Driving at Unsignalized Intersections: A Hierarchical Reinforced Learning Approach for Feasible Decision-Making. IEEE Transactions on Intelligent Transportation Systems, 24(11), 12345–12356. https://doi.org/10.1109/tits.2023.3285440
How many times has this paper been cited?
130 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access: sign in and open the full text from this page.
Who wrote this paper?
Mohammad Al-Sharman, Rowan Dempster, Mohamed A. Daoud, Mahmoud Nasr, Derek Rayside, William Melek.
What is the DOI of this paper?
10.1109/tits.2023.3285440, permanently at https://doi.org/10.1109/tits.2023.3285440. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.