A multi-criteria intelligent control for traffic lights using reinforcement learning

• Traffic signal control plays a crucial role in traffic management and operation practices. In the past decade, adaptive signal control systems, capable of adjusting control schemes in response to traffic patterns, have shown the abilities to improve traffic mobility. On the other hand, the negative impacts on environments by increased vehicles attract increased attentions from traffic stakeholders and the general public. Most of the prevalent adaptive signal control systems do not address energy and environmental issues. The present paper proposes an adaptive signal control system capable of taking multi-criteria strategies into account. A general multi-agent framework is introduced for modeling signal control operations. The behavior of each cognitive agent is modeled by a Constrained Markov Decision Process (CMDP). Reinforcement learning algorithms are applied to solve the MDP problem. As a result, the signal controller makes intelligent timing decisions according to a pre-defined policy goal. A case study is carried out for the stage-based control scheme to investigate the effectiveness of the adaptive signal control system from two perspectives, traffic mobility and energy efficiency. The control approach can be further applied to a large network in a decentralized manner. 

Ämnesord

TEKNIK OCH TEKNOLOGIER  -- Samhällsbyggnadsteknik -- Transportteknik och logistik (hsv//swe)

ENGINEERING AND TECHNOLOGY  -- Civil Engineering -- Transport Systems and Logistics (hsv//eng)

NATURVETENSKAP  -- Data- och informationsvetenskap -- Datavetenskap (hsv//swe)

NATURAL SCIENCES  -- Computer and Information Sciences -- Computer Sciences (hsv//eng)

Nyckelord

Adaptive traffic light control

Intelligent timing decision

Multi-criteria strategies

Reinforcement Learning

Adaptive control systems

Control systems

Education

Energy efficiency

Intelligent agents

Learning algorithms

Markov processes

Multi agent systems

Street traffic control

Adaptive signal control systems

Adaptive traffic lights

Constrained Markov decision process

Environmental issues

Multi-criteria

Multiagent framework

Timing decisions

Traffic signal control

Traffic signals

Publikations- och innehållstyp

ref (ämneskategori)

kap (ämneskategori)