Journal article · 2021 · Open access

Autonomous Driving Control Using the DDPG and RDPG Algorithms

Che-Cheng Chang, Jichiang Tsai, Jun-Han Lin, Yee-Ming Ooi

Applied Sciences, 11(22), 10659 · Published 12 November 2021 · DOI 10.3390/app112210659

Open PDFView at the publisherCite this paper

In brief

“Autonomous Driving Control Using the DDPG and RDPG Algorithms” is a 2021 journal article by Che-Cheng Chang and 3 co-authors, published in Applied Sciences. OpenAlex counts 32 citations as of 22 November 2026, which puts it in the top 4% of works published in 2021 by citations. It is open access under a CC BY licence: the full text is free to read at Applied Sciences.

Citations
32
Most cited in
2024 (11)
Field-weighted impact
1.23
References
13
Authors
4

Abstract

Recently, autonomous driving has become one of the most popular topics for smart vehicles. However, traditional control strategies are mostly rule-based, which have poor adaptability to the time-varying traffic conditions. Similarly, they have difficulty coping with unexpected situations that may occur any time in the real-world environment. Hence, in this paper, we exploited Deep Reinforcement Learning (DRL) to enhance the quality and safety of autonomous driving control. Based on the road scenes and self-driving simulation modules provided by AirSim, we used the Deep Deterministic Policy Gradient (DDPG) and Recurrent Deterministic Policy Gradient (RDPG) algorithms, combined with the Convolutional Neural Network (CNN), to realize the autonomous driving control of self-driving cars. In particular, by using the real-time images of the road provided by AirSim as the training data, we carefully formulated an appropriate reward-generation method to improve the convergence speed of the adopted DDPG and RDPG models and the control performance of moving driverless cars.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Chang, C.-C., Tsai, J., Lin, J.-H., & Ooi, Y.-M. (2021). Autonomous Driving Control Using the DDPG and RDPG Algorithms. Applied Sciences, 11(22), 10659. https://doi.org/10.3390/app112210659

MLA 9

Chang, Che-Cheng, et al. “Autonomous Driving Control Using the DDPG and RDPG Algorithms.” Applied Sciences, vol. 11, no. 22, 2021, p. 10659. https://doi.org/10.3390/app112210659.

Chicago

Chang, Che-Cheng, Jichiang Tsai, Jun-Han Lin, and Yee-Ming Ooi. 2021. “Autonomous Driving Control Using the DDPG and RDPG Algorithms.” Applied Sciences 11 (22): 10659. https://doi.org/10.3390/app112210659.

Harvard

Chang, C.-C. et al. (2021) ‘Autonomous Driving Control Using the DDPG and RDPG Algorithms’, Applied Sciences, 11(22), p. 10659. doi:10.3390/app112210659.

IEEE

C.-C. Chang, J. Tsai, J.-H. Lin, and Y.-M. Ooi, “Autonomous Driving Control Using the DDPG and RDPG Algorithms,” Applied Sciences, vol. 11, no. 22, p. 10659, 2021, doi: 10.3390/app112210659.

BibTeX

@article{chang2021autonomous,
  title     = {{Autonomous Driving Control Using the DDPG and RDPG Algorithms}},
  author    = {Chang, Che-Cheng and Tsai, Jichiang and Lin, Jun-Han and Ooi, Yee-Ming},
  journal   = {Applied Sciences},
  year      = {2021},
  volume    = {11},
  number    = {22},
  pages     = {10659},
  doi       = {10.3390/app112210659},
  url       = {https://doi.org/10.3390/app112210659}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202255
202344
20241111
202577
202655

Its field-weighted citation impact is 1.23: it has been cited 1.23 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Computer Science › Artificial Intelligence › Reinforcement Learning in Robotics

  • autonomous driving
  • autonomous vehicles
  • deep deterministic policy gradient
  • deep reinforcement learning
  • AirSim
  • reward function design
  • convolutional neural networks
  • vehicle control

Work with this paper

Most-cited papers in Computer Science

All highly cited Computer Science papers

Questions about this paper

How do I cite this paper in APA style?

Chang, C.-C., Tsai, J., Lin, J.-H., & Ooi, Y.-M. (2021). Autonomous Driving Control Using the DDPG and RDPG Algorithms. Applied Sciences, 11(22), 10659. https://doi.org/10.3390/app112210659

How many times has this paper been cited?

32 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at Applied Sciences: sign in and open the PDF from this page.

Who wrote this paper?

Che-Cheng Chang, Jichiang Tsai, Jun-Han Lin, Yee-Ming Ooi.

What is the DOI of this paper?

10.3390/app112210659, permanently at https://doi.org/10.3390/app112210659. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.