Conference paper · 2021 · Open access
Autonomous Vehicle Path Planning using Q-Learning
Journal of Physics Conference Series, 2128(1), 012018 · Published 1 December 2021 · DOI 10.1088/1742-6596/2128/1/012018
In brief
“Autonomous Vehicle Path Planning using Q-Learning” is a 2021 conference paper by Mohammed M S Ibrahim and 2 co-authors, published in Journal of Physics Conference Series. OpenAlex counts 4 citations as of 22 November 2026. It is open access under a CC BY licence: the full text is free to read at Journal of Physics Conference Series.
- Citations
- 4
- Most cited in
- 2025 (3)
- Field-weighted impact
- 0.29
- References
- 13
- Authors
- 3
Abstract
Path planning is vital in autonomous vehicle technology, from robots to self-driving cars and driverless trucks, it is impossible to navigate without a proper path planning algorithm, various algorithms exist Q-learning being one of them. Q-learning is used extensively in discrete applications as it is effective in finding solutions to these problems. This research investigates the possibility of using Q-learning for solving the local path planning problem with obstacle avoidance. Q-learning is split into two phases, the first being the training phase, and the second being the application phase. During training, Q-learning requires exponentially increasing training time based on the system’s state space. However, when Q-learning is applied it becomes as simple as a lookup table which allows it to run on even the simplest microcontrollers. Two simulations are conducted with varying environments. One to showcase the ability to learn the optimal path, the other to showcase the ability for learning navigation in variable environments. The first simulation was run on a static environment with one obstacle, with enough training episodes, Q-learning could solve the path planning problem with minimal movement steps. The second simulation focuses on a randomized environment, obstacles and the agent’s starting position are randomly chosen at the start of every episode. During testing, Q-learning was able to find a path to the target when a path did exist, as It was possible in certain configurations for the vehicle to be stuck in between obstacles with no feasible path or solution.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Ibrahim, M. M. S., Atia, M. R. A., & Fakhr, M. (2021). Autonomous Vehicle Path Planning using Q-Learning. Journal of Physics Conference Series, 2128(1), 012018. https://doi.org/10.1088/1742-6596/2128/1/012018
MLA 9
Ibrahim, Mohammed M S, et al. “Autonomous Vehicle Path Planning using Q-Learning.” Journal of Physics Conference Series, vol. 2128, no. 1, 2021, p. 012018. https://doi.org/10.1088/1742-6596/2128/1/012018.
Chicago
Ibrahim, Mohammed M S, Mostafa Rostom Ahmed Atia, and MW Fakhr. 2021. “Autonomous Vehicle Path Planning using Q-Learning.” Journal of Physics Conference Series 2128 (1): 012018. https://doi.org/10.1088/1742-6596/2128/1/012018.
Harvard
Ibrahim, M. M. S., Atia, M. R. A. and Fakhr, M. (2021) ‘Autonomous Vehicle Path Planning using Q-Learning’, Journal of Physics Conference Series, 2128(1), p. 012018. doi:10.1088/1742-6596/2128/1/012018.
IEEE
M. M. S. Ibrahim, M. R. A. Atia, and M. Fakhr, “Autonomous Vehicle Path Planning using Q-Learning,” Journal of Physics Conference Series, vol. 2128, no. 1, p. 012018, 2021, doi: 10.1088/1742-6596/2128/1/012018.
BibTeX
@inproceedings{ibrahim2021autonomous,
title = {{Autonomous Vehicle Path Planning using Q-Learning}},
author = {Ibrahim, Mohammed M S and Atia, Mostafa Rostom Ahmed and Fakhr, MW},
booktitle = {Journal of Physics Conference Series},
year = {2021},
volume = {2128},
number = {1},
pages = {012018},
doi = {10.1088/1742-6596/2128/1/012018},
url = {https://doi.org/10.1088/1742-6596/2128/1/012018}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Topic and keywords
Physical Sciences › Engineering › Control and Systems Engineering › Robotic Path Planning Algorithms
- autonomous vehicles
- path planning
- Q-learning
- obstacle avoidance
- reinforcement learning
- microcontroller implementation
- variable environments
Work with this paper
Most-cited papers in Engineering
- A Closed‐form Equation for Predicting the Hydraulic Conductivity of Unsaturated SoilsMartinus Th. van Genuchten · Soil Science Society of America Journal · 1980 · 28,197 citations
- An improved technique for determining hardness and elastic modulus using load and displacement sensing indentation experimentsW. C. Oliver, George M. Pharr · Journal of materials research/Pratt's guide to venture capital sources · 1992 · 27,379 citations
- Digital communicationsOwen Bishop · Routledge eBooks · 2007 · 24,890 citations
- The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysisNorden Eh Huang, Zhengwei Shen, Steven R. Long and 6 more · Proceedings of the Royal Society A Mathematical Physical and Engineering Sciences · 1998 · 24,008 citations
- Numerical Heat Transfer and Fluid FlowSuhas V. Patankar · CRC Press eBooks · 2018 · 23,491 citations
Questions about this paper
How do I cite this paper in APA style?
Ibrahim, M. M. S., Atia, M. R. A., & Fakhr, M. (2021). Autonomous Vehicle Path Planning using Q-Learning. Journal of Physics Conference Series, 2128(1), 012018. https://doi.org/10.1088/1742-6596/2128/1/012018
How many times has this paper been cited?
4 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at Journal of Physics Conference Series: sign in and open the PDF from this page.
Who wrote this paper?
Mohammed M S Ibrahim, Mostafa Rostom Ahmed Atia, MW Fakhr.
What is the DOI of this paper?
10.1088/1742-6596/2128/1/012018, permanently at https://doi.org/10.1088/1742-6596/2128/1/012018. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.