Conference paper · 2024 · Open access

Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning

Letian Xu, Hao Liu, Haopeng Zhao, Tianyao Zheng, Tongzhou Jiang, Lipeng Liu

International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484 · Published 8 November 2024 · DOI 10.1145/3716895.3716980

Open PDFView at the publisherCite this paper

In brief

“Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning” is a 2024 conference paper by Letian Xu and 5 co-authors, published in International Conference on Artificial Intelligence and Computer Engineering (ICAICE). OpenAlex counts 41 citations as of 22 November 2026, which puts it in the top 1% of works published in 2024 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
41
Most cited in
2025 (22)
Field-weighted impact
3.16
References
34
Authors
6

Abstract

This paper explores the use of Deep Reinforcement Learning (DRL) to achieve autonomous navigation for unmanned vehicles, with a focus on the Deep Deterministic Policy Gradient (DDPG) algorithm. The main challenge addressed is handling high-dimensional, continuous action spaces, which are commonly encountered in autonomous navigation tasks. The study presents the Ackermann robot model used for testing and provides an explanation of how the DDPG algorithm is applied to the navigation problem. Through experiments conducted in a simulation environment, the feasibility and effectiveness of the proposed approach are verified. The results indicate that the DDPG algorithm outperforms traditional reinforcement learning algorithms, such as Deep Q-Network (DQN) and Double Deep Q-Network (DDQN), particularly in path planning tasks. The improved algorithm demonstrates better decision-making, leading to more accurate and reliable navigation in comparison to the traditional methods.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Xu, L., Liu, H., Zhao, H., Zheng, T., Jiang, T., & Liu, L. (2024). Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning. International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484. https://doi.org/10.1145/3716895.3716980

MLA 9

Xu, Letian, et al. “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning.” International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 2024, pp. 480–484. https://doi.org/10.1145/3716895.3716980.

Chicago

Xu, Letian, Hao Liu, Haopeng Zhao, Tianyao Zheng, Tongzhou Jiang, and Lipeng Liu. 2024. “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning.” International Conference on Artificial Intelligence and Computer Engineering (ICAICE): 480–484. https://doi.org/10.1145/3716895.3716980.

Harvard

Xu, L. et al. (2024) ‘Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning’, International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 480–484. doi:10.1145/3716895.3716980.

IEEE

L. Xu, H. Liu, H. Zhao, T. Zheng, T. Jiang, and L. Liu, “Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning,” International Conference on Artificial Intelligence and Computer Engineering (ICAICE), pp. 480–484, 2024, doi: 10.1145/3716895.3716980.

BibTeX

@inproceedings{xu2024autonomous,
  title     = {{Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning}},
  author    = {Xu, Letian and Liu, Hao and Zhao, Haopeng and Zheng, Tianyao and Jiang, Tongzhou and Liu, Lipeng},
  booktitle = {International Conference on Artificial Intelligence and Computer Engineering (ICAICE)},
  year      = {2024},
  pages     = {480--484},
  doi       = {10.1145/3716895.3716980},
  url       = {https://doi.org/10.1145/3716895.3716980}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
20241111
20252222
202688

Its field-weighted citation impact is 3.16: it has been cited 3.16 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • autonomous navigation
  • unmanned vehicles
  • deep reinforcement learning
  • deep deterministic policy gradient
  • continuous action spaces
  • path planning
  • deep Q-network comparison

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Xu, L., Liu, H., Zhao, H., Zheng, T., Jiang, T., & Liu, L. (2024). Autonomous Navigation of Unmanned Vehicle Through Deep Reinforcement Learning. International Conference on Artificial Intelligence and Computer Engineering (ICAICE), 480–484. https://doi.org/10.1145/3716895.3716980

How many times has this paper been cited?

41 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Letian Xu, Hao Liu, Haopeng Zhao, Tianyao Zheng, Tongzhou Jiang, Lipeng Liu.

What is the DOI of this paper?

10.1145/3716895.3716980, permanently at https://doi.org/10.1145/3716895.3716980. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.