Continuous residual reinforcement learning for traffic signal control optimization

Traffic signal control can be naturally regarded as a reinforcement learning problem. Unfortunately, it is one of the most difficult classes of reinforcement learning problems owing to its large state space. A straightforward approach to address this challenge is to control traffic signals based on continuous reinforcement learning. Although they have been successful in traffic signal control, they may become unstable and fail to converge to near-optimal solutions. We develop adaptive traffic signal controllers based on continuous residual reinforcement learning (CRL-TSC) that is more stable. The effect of three feature functions is empirically investigated in a microscopic traffic simulation. Furthermore, the effects of departing streets, more actions, and the use of the spatial distribution of the vehicles on the performance of CRL-TSCs are assessed. The results show that the best setup of the CRL-TSC leads to saving average travel time by 15% in comparison to an optimized fixed-time controller.

Seipel, StefanUppsala universitet,Högskolan i Gävle,Datavetenskap,Division of Visual Information and Interaction, Department of Information Technology, Uppsala University, Uppsala, Sweden,Avdelningen för visuell information och interaktion,Bildanalys och människa-datorinteraktion(Swepub:uu)stefseip (author)
Wiering, MarcoInstitute of Artificial Intelligence and Cognitive Engineering, University of Groningen, Groningen, the Netherlands (author)
Högskolan i GävleDatavetenskap (creator_code:org_t)

In:Canadian journal of civil engineering (Print): NRC Research Press45:8, s. 690-7020315-14681208-6029

About the subject

ENGINEERING AND TECHNOLOGY: ENGINEERING AND ...; and Electrical Engin ...; and Control Engineer ...

Kungliga biblioteket hanterar dina personuppgifter i enlighet med EU:s dataskyddsförordning (2018), GDPR. Läs mer om hur det funkar här.
Så här hanterar KB dina uppgifter vid användning av denna tjänst.