Conference paper · 2019 · Open access

Autonomous Highway Driving using Deep Reinforcement Learning

Subramanya P. Nageshrao, Eric Tseng, Dimitar Filev

Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, 2326–2331 · Published 1 October 2019 · DOI 10.1109/smc.2019.8914621

Open PDFView at the publisherCite this paper

In brief

“Autonomous Highway Driving using Deep Reinforcement Learning” is a 2019 conference paper by Subramanya P. Nageshrao and 2 co-authors, published in Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics. OpenAlex counts 184 citations as of 22 November 2026, which puts it in the top 5% of works published in 2019 by citations. It is open access: the full text is free to read at arXiv (Cornell University).

Citations
184
Most cited in
2024 (31)
Field-weighted impact
15.91
References
36
Authors
3

Abstract

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. Due to this, formulating a rule based decision maker for selecting driving maneuvers may not be ideal. Similarly, it may not be efficient to solve optimal control problem in real-time for a predefined cost function. In order to address these issues and to avoid peculiar behaviors when encountering unforeseen scenario, we propose a reinforcement learning (RL) based method, where the ego car, i.e., an autonomous vehicle, learns to make decisions by directly interacting with the simulated traffic. Here the decision maker is a deep neural network that provides an action choice for a given system state. We demonstrate the performance of the developed algorithm in highway driving scenario where the trained AV encounters varying traffic density.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Nageshrao, S. P., Tseng, E., & Filev, D. (2019). Autonomous Highway Driving using Deep Reinforcement Learning. Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, 2326–2331. https://doi.org/10.1109/smc.2019.8914621

MLA 9

Nageshrao, Subramanya P., et al. “Autonomous Highway Driving using Deep Reinforcement Learning.” Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, 2019, pp. 2326–2331. https://doi.org/10.1109/smc.2019.8914621.

Chicago

Nageshrao, Subramanya P., Eric Tseng, and Dimitar Filev. 2019. “Autonomous Highway Driving using Deep Reinforcement Learning.” Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics: 2326–2331. https://doi.org/10.1109/smc.2019.8914621.

Harvard

Nageshrao, S. P., Tseng, E. and Filev, D. (2019) ‘Autonomous Highway Driving using Deep Reinforcement Learning’, Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, pp. 2326–2331. doi:10.1109/smc.2019.8914621.

IEEE

S. P. Nageshrao, E. Tseng, and D. Filev, “Autonomous Highway Driving using Deep Reinforcement Learning,” Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, pp. 2326–2331, 2019, doi: 10.1109/smc.2019.8914621.

BibTeX

@inproceedings{nageshrao2019autonomous,
  title     = {{Autonomous Highway Driving using Deep Reinforcement Learning}},
  author    = {Nageshrao, Subramanya P. and Tseng, Eric and Filev, Dimitar},
  booktitle = {Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics},
  year      = {2019},
  pages     = {2326--2331},
  doi       = {10.1109/smc.2019.8914621},
  url       = {https://doi.org/10.1109/smc.2019.8914621}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
201933
20202424
20211919
20222929
20232626
20243131
20252828
20262424

Its field-weighted citation impact is 15.91: it has been cited 15.91 times as often as the average work of the same field, type and year (1.00 is the world average).

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • autonomous driving
  • highway driving
  • deep reinforcement learning
  • traffic density
  • decision-making
  • real-time control

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Nageshrao, S. P., Tseng, E., & Filev, D. (2019). Autonomous Highway Driving using Deep Reinforcement Learning. Conference proceedings/Conference proceedings - IEEE International Conference on Systems, Man, and Cybernetics, 2326–2331. https://doi.org/10.1109/smc.2019.8914621

How many times has this paper been cited?

184 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Subramanya P. Nageshrao, Eric Tseng, Dimitar Filev.

What is the DOI of this paper?

10.1109/smc.2019.8914621, permanently at https://doi.org/10.1109/smc.2019.8914621. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.