UM  > Faculty of Science and Technology
Residential Collegefalse
Status已發表Published
An Intelligent Train Operation Method Based on Event-Driven Deep Reinforcement Learning
Zhang, Liqing1; U, Leong Hou1; Zhou, Mingliang2; Li, Zhenning1
2021-12-24
Source PublicationIEEE Transactions on Industrial Informatics
ISSN1551-3203
Volume18Issue:10Pages:6973-6980
Abstract

Train operation control in urban railways is challenging due to its high dynamics, complex environment, and level of comfort and safety. To address these challenges, authors propose a new Deep Reinforcement-based Train Operation (DRTO) method which includes: i) a deterministic deep reinforcement learning algorithm, ii) a dynamic incentive system, which is used to ensure safe operation in a multi-train environment, and iii) an event-driven method, which is used to improve the DRTO performance based on an event-driven strategy. To evaluate the performance, authors thoroughly compare the proposed method with other operation control solutions on both synthetic and real datasets. Our results demonstrate that DRTO is effective in: i) decreasing the energy consumption of train operation, ii) increasing passenger comfort and iii) achieving a good trade-off between efficiency and safety. In addition, the effectiveness of the event-driven strategy and the dynamic incentive system is also demonstrated in the experiments.

KeywordDeep Deterministic Policy Gradient (Ddpg) Deep Reinforcement-based Train Operation (Drto) Event Driven
DOI10.1109/TII.2021.3138098
URLView the original
Indexed BySCIE
Language英語English
WOS Research AreaAutomation & Control Systems ; Computer Science ; Engineering
WOS SubjectAutomation & Control Systems ; Computer Science, Interdisciplinary Applications ; Engineering, Industrial
WOS IDWOS:000838389400049
PublisherIEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC, 445 HOES LANE, PISCATAWAY, NJ 08855-4141
Scopus ID2-s2.0-85122057526
Fulltext Access
Citation statistics
Document TypeJournal article
CollectionFaculty of Science and Technology
THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU)
Corresponding AuthorU, Leong Hou
Affiliation1.State Key Laboratory of Internet of Things for Smart City, University of Macau, Taipa, Macau 999078, China
2.School of Computer Science, Chongqing University, Chongqing 400044, China
First Author AffilicationUniversity of Macau
Corresponding Author AffilicationUniversity of Macau
Recommended Citation
GB/T 7714
Zhang, Liqing,U, Leong Hou,Zhou, Mingliang,et al. An Intelligent Train Operation Method Based on Event-Driven Deep Reinforcement Learning[J]. IEEE Transactions on Industrial Informatics, 2021, 18(10), 6973-6980.
APA Zhang, Liqing., U, Leong Hou., Zhou, Mingliang., & Li, Zhenning (2021). An Intelligent Train Operation Method Based on Event-Driven Deep Reinforcement Learning. IEEE Transactions on Industrial Informatics, 18(10), 6973-6980.
MLA Zhang, Liqing,et al."An Intelligent Train Operation Method Based on Event-Driven Deep Reinforcement Learning".IEEE Transactions on Industrial Informatics 18.10(2021):6973-6980.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhang, Liqing]'s Articles
[U, Leong Hou]'s Articles
[Zhou, Mingliang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhang, Liqing]'s Articles
[U, Leong Hou]'s Articles
[Zhou, Mingliang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhang, Liqing]'s Articles
[U, Leong Hou]'s Articles
[Zhou, Mingliang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.