Deep reinforcement learning for traffic light optimization

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Deep Reinforcement Learning has the potential of practically addressing one of the most pressing problems in road traffic management, namely that of traffic light optimization (TLO). The objective of the TLO problem is to set the timings (phase and duration) of traffic lights in order to minimize the overall travel time of the vehicles that traverse the road network. In this paper, we introduce a new reward function that is able to decrease travel time in a micro-simulator environment. More specifically, our reward function simultaneously takes the traffic flow and traffic delay into account in order to provide a solution to the TLO problem. We use both Deep Q-Learning and Policy Gradient approaches to solve the resulting reinforcement learning problem.

Original languageEnglish
Title of host publicationProceedings - 18th IEEE International Conference on Data Mining Workshops, ICDMW 2018
EditorsJeffrey Yu, Zhenhui Li, Hanghang Tong, Feida Zhu
PublisherIEEE Computer Society
Pages564-571
Number of pages8
ISBN (Electronic)9781538692882
DOIs
Publication statusPublished - 7 Feb 2019
Event18th IEEE International Conference on Data Mining Workshops, ICDMW 2018 - Singapore, Singapore
Duration: 17 Nov 201820 Nov 2018

Publication series

NameIEEE International Conference on Data Mining Workshops, ICDMW
Volume2018-November
ISSN (Print)2375-9232
ISSN (Electronic)2375-9259

Conference

Conference18th IEEE International Conference on Data Mining Workshops, ICDMW 2018
CountrySingapore
CitySingapore
Period17/11/1820/11/18

    Fingerprint

Keywords

  • Deep Learning
  • Traffic Light Optimization

ASJC Scopus subject areas

  • Computer Science Applications
  • Software

Cite this

Coskun, M., Baggag, A., & Chawla, S. (2019). Deep reinforcement learning for traffic light optimization. In J. Yu, Z. Li, H. Tong, & F. Zhu (Eds.), Proceedings - 18th IEEE International Conference on Data Mining Workshops, ICDMW 2018 (pp. 564-571). [8637414] (IEEE International Conference on Data Mining Workshops, ICDMW; Vol. 2018-November). IEEE Computer Society. https://doi.org/10.1109/ICDMW.2018.00088