Conference paper · 2024 · Open access
Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning
International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484 · Published 8 November 2024 · DOI 10.1145/3716895.3716980
In brief
“Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning” is a 2024 conference paper by Letian Xu and 5 co-authors, published in International Conference on Artificial Intelligence and Computer Engineering (ICAICE). OpenAlex counts 41 citations as of 22 November 2026, which puts it in the top 1% of works published in 2024 by citations. It is open access: the full text is free to read at arXiv (Cornell University).
- Citations
- 41
- Most cited in
- 2025 (22)
- Field-weighted impact
- 3.16
- References
- 34
- Authors
- 6
Abstract
This paper explores the use of Deep Reinforcement Learning (DRL) to achieve autonomous navigation for unmanned vehicles, with a focus on the Deep Deterministic Policy Gradient (DDPG) algorithm. The main challenge addressed is handling high-dimensional, continuous action spaces, which are commonly encountered in autonomous navigation tasks. The study presents the Ackermann robot model used for testing and provides an explanation of how the DDPG algorithm is applied to the navigation problem. Through experiments conducted in a simulation environment, the feasibility and effectiveness of the proposed approach are verified. The results indicate that the DDPG algorithm outperforms traditional reinforcement learning algorithms, such as Deep Q-Network (DQN) and Double Deep Q-Network (DDQN), particularly in path planning tasks. The improved algorithm demonstrates better decision-making, leading to more accurate and reliable navigation in comparison to the traditional methods.
Cite this paper
Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.
APA 7
Xu, L., Liu, H., Zhao, H., Zheng, T., Jiang, T., & Liu, L. (2024). Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning. International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484. https://doi.org/10.1145/3716895.3716980
MLA 9
Xu, Letian, et al. “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning.” International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 2024, pp. 480–484. https://doi.org/10.1145/3716895.3716980.
Chicago
Xu, Letian, Hao Liu, Haopeng Zhao, Tianyao Zheng, Tongzhou Jiang, and Lipeng Liu. 2024. “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning.” International Conference on Artificial Intelligence and Computer Engineering (ICAICE): 480–484. https://doi.org/10.1145/3716895.3716980.
Harvard
Xu, L. et al. (2024) ‘Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning’, International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 480–484. doi:10.1145/3716895.3716980.
IEEE
L. Xu, H. Liu, H. Zhao, T. Zheng, T. Jiang, and L. Liu, “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning,” International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 480–484, 2024, doi: 10.1145/3716895.3716980.
BibTeX
@inproceedings{xu2024autonomous,
title = {{Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning}},
author = {Xu, Letian and Liu, Hao and Zhao, Haopeng and Zheng, Tianyao and Jiang, Tongzhou and Liu, Lipeng},
booktitle = {International Conference on Artificial Intelligence and Computer Engineering (ICAICE)},
year = {2024},
pages = {480--484},
doi = {10.1145/3716895.3716980},
url = {https://doi.org/10.1145/3716895.3716980}
}
Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)
Citations by year
| Year | Citations | Share of the best year |
|---|---|---|
| 2024 | 11 | |
| 2025 | 22 | |
| 2026 | 8 |
Its field-weighted citation impact is 3.16: it has been cited 3.16 times as often as the average work of the same field, type and year (1.00 is the world average).
Topic and keywords
Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics
- autonomous navigation
- unmanned vehicles
- deep reinforcement learning
- deep deterministic policy gradient
- continuous action spaces
- path planning
- deep Q-network comparison
Work with this paper
Most-cited papers in Computer Science
- ImageNet classification with deep convolutional neural networksAlex Krizhevsky, Ilya Sutskever, Geoffrey E. Hinton · Communications of the ACM · 2017 · 114,726 citations
- Long Short-Term MemorySepp Hochreiter, Jürgen Schmidhuber · Neural Computation · 1997 · 109,097 citations
- A Mathematical Theory of CommunicationClaude E. Shannon · Bell System Technical Journal · 1948 · 91,736 citations
- Deep learningYann LeCun, Yoshua Bengio, Geoffrey E. Hinton · Nature · 2015 · 90,226 citations
- Faster R-CNN: Towards Real-Time Object Detection with Region Proposal NetworksShaoqing Ren, Kaiming He, Ross Girshick and 1 more · IEEE Transactions on Pattern Analysis and Machine Intelligence · 2016 · 74,143 citations
Questions about this paper
How do I cite this paper in APA style?
Xu, L., Liu, H., Zhao, H., Zheng, T., Jiang, T., & Liu, L. (2024). Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning. International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484. https://doi.org/10.1145/3716895.3716980
How many times has this paper been cited?
41 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.
Is this paper free to read?
Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.
Who wrote this paper?
Letian Xu, Hao Liu, Haopeng Zhao, Tianyao Zheng, Tongzhou Jiang, Lipeng Liu.
What is the DOI of this paper?
10.1145/3716895.3716980, permanently at https://doi.org/10.1145/3716895.3716980. Sign in and open it from this page.
Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.