Preprint · 2021 · Open access

WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving

Arjit Sharma, Sahil Sharma

arXiv (Cornell University) · Published 27 August 2021 · DOI 10.48550/arxiv.2108.12134

Open PDFView at the publisherCite this paper

In brief

“WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving” is a 2021 preprint by Arjit Sharma and Sahil Sharma, published in arXiv (Cornell University). OpenAlex counts 4 citations as of 22 November 2026. It is open access under a CC BY-NC-ND licence: the full text is free to read at arXiv (Cornell University).

Citations
4
Most cited in
2023 (2)
References
35
Authors
2

Abstract

Urban autonomous driving is an open and challenging problem to solve as the decision-making system has to account for several dynamic factors like multi-agent interactions, diverse scene perceptions, complex road geometries, and other rarely occurring real-world events. On the other side, with deep reinforcement learning (DRL) techniques, agents have learned many complex policies. They have even achieved super-human-level performances in various Atari Games and Deepmind's AlphaGo. However, current DRL techniques do not generalize well on complex urban driving scenarios. This paper introduces the DRL driven Watch and Drive (WAD) agent for end-to-end urban autonomous driving. Motivated by recent advancements, the study aims to detect important objects/states in high dimensional spaces of CARLA and extract the latent state from them. Further, passing on the latent state information to WAD agents based on TD3 and SAC methods to learn the optimal driving policy. Our novel approach utilizing fewer resources, step-by-step learning of different driving tasks, hard episode termination policy, and reward mechanism has led our agents to achieve a 100% success rate on all driving tasks in the original CARLA benchmark and set a new record of 82% on further complex NoCrash benchmark, outperforming the state-of-the-art model by more than +30% on NoCrash benchmark.

Cite this paper

Formatted from the catalogue record. Check names, capitals and page numbers against the paper before you submit.

APA 7

Sharma, A., & Sharma, S. (2021). WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2108.12134

MLA 9

Sharma, Arjit, and Sahil Sharma. “WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving.” arXiv (Cornell University), 2021. https://doi.org/10.48550/arxiv.2108.12134.

Chicago

Sharma, Arjit and Sahil Sharma. 2021. “WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving.” arXiv (Cornell University). https://doi.org/10.48550/arxiv.2108.12134.

Harvard

Sharma, A. and Sharma, S. (2021) ‘WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving’, arXiv (Cornell University). doi:10.48550/arxiv.2108.12134.

IEEE

A. Sharma and S. Sharma, “WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving,” arXiv (Cornell University), 2021, doi: 10.48550/arxiv.2108.12134.

BibTeX

@misc{sharma2021deep,
  title     = {{WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving}},
  author    = {Sharma, Arjit and Sharma, Sahil},
  howpublished = {arXiv (Cornell University)},
  year      = {2021},
  doi       = {10.48550/arxiv.2108.12134},
  url       = {https://doi.org/10.48550/arxiv.2108.12134}
}

Download for a reference manager: BibTeX (.bib) · RIS for Zotero, Mendeley and EndNote (.ris)

Citations by year

YearCitationsShare of the best year
202211
202322
202411

Topic and keywords

Physical Sciences › Engineering › Automotive Engineering › Autonomous Vehicle Technology and Safety

  • deep reinforcement learning
  • CARLA simulator
  • latent state representation
  • TD3
  • soft actor-critic
  • multi-agent interaction
  • reward function design

Work with this paper

Most-cited papers in Engineering

All highly cited Engineering papers

Questions about this paper

How do I cite this paper in APA style?

Sharma, A., & Sharma, S. (2021). WAD: A Deep Reinforcement Learning Agent for Urban Autonomous Driving. arXiv (Cornell University). https://doi.org/10.48550/arxiv.2108.12134

How many times has this paper been cited?

4 times, according to OpenAlex on 22 November 2026. Google Scholar and Scopus count different sets of sources, so their numbers differ.

Is this paper free to read?

Yes. It is open access at arXiv (Cornell University): sign in and open the PDF from this page.

Who wrote this paper?

Arjit Sharma, Sahil Sharma.

What is the DOI of this paper?

10.48550/arxiv.2108.12134, permanently at https://doi.org/10.48550/arxiv.2108.12134. Sign in and open it from this page.

Bibliographic data from OpenAlex (CC0), last checked 22 November 2026. ResearchGuru does not host this paper; once you are signed in, the links open it at the publisher or the repository that does.