Residential College | false |
Status | 已發表Published |
A deep generative approach for crash frequency model with heterogeneous imbalanced data | |
Ding, Hongliang1; Lu, Yuhuan2,3; Sze, N. N.1; Chen, Tiantian1,4; Guo, Yanyong5,6,7; Lin, Qinghai8 | |
2022-01-24 | |
Source Publication | Analytic Methods in Accident Research |
ISSN | 2213-6657 |
Volume | 34Pages:100212 |
Abstract | Crash frequency model is often subject to excessive zero observation because of the rare nature of crashes. To address the problem of imbalanced crash data, a deep generative approach – augmented variational autoencoder – was proposed to generate synthetic crash data for the association measure between crash and possible explanatory factors. This approach was characterized by a factorized generative model and refined objective function. For instance, the generative model can handle heterogeneous data including real-valued, nominal and ordinal distributions. On the other hand, the refined objective function can control for the random effect by better recognizing both the zero-crash and non-zero crash cases. In this study, comprehensive traffic and crash data of multiple distribution types in Hong Kong in the period between 2014 and 2016 were used. To assess the data generation performance of the proposed augmented variational autoencoder method, a conventional data synthesis technique (synthetic minority oversampling technique-nominal continuous) was also considered. Performances of crash frequency models of total crashes and fatal and severe injury crashes are assessed. For total crashes, the results of parameter estimation, in terms of statistical fit, prediction accuracy, and explanatory factors identified, of the crash frequency model based on synthetic data using the augmented variational autoencoder method adhered closer to that based on original data, compared to that based on synthetic data using the synthetic minority oversampling technique-nominal continuous method. For fatal and severe injury crashes, zero-crash observations were prevalent, with the ratio of zero-crash to non-zero crash cases of 9 to 1. Crash data was first balanced using the proposed augmented variational autoencoder method. Then, fatal and severe injury crash frequency models using correlated random parameter models based on original data and balanced data were estimated respectively. Results indicate that fatal and severe injury crash frequency model based on balanced data outperforms its counterpart, with the lowest root mean square error, lowest mean absolute error, and highest number of crash explanatory factors identified. More importantly, correlation between the random parameters can be revealed. Findings of this study should shed light to both researchers and practitioners for the development of crash frequency models, with which the problem of excessive zero observations is prevalent when highly disaggregated traffic and crash data by time and space are used. |
Keyword | Augmented Variational Autoencoder Crash Frequency Model Imbalanced Crash Data Machine Learning |
DOI | 10.1016/j.amar.2022.100212 |
URL | View the original |
Indexed By | SSCI |
Language | 英語English |
WOS Research Area | Public, Environmental & Occupational Health ; Transportation |
WOS Subject | Public, Environmental & Occupational Health ; Transportation |
WOS ID | WOS:000798368600001 |
Scopus ID | 2-s2.0-85123983346 |
Fulltext Access | |
Citation statistics | |
Document Type | Journal article |
Collection | DEPARTMENT OF COMPUTER AND INFORMATION SCIENCE THE STATE KEY LABORATORY OF INTERNET OF THINGS FOR SMART CITY (UNIVERSITY OF MACAU) |
Corresponding Author | Sze, N. N. |
Affiliation | 1.Department of Civil and Environmental Engineering, The Hong Kong Polytechnic University, Hung Hom, Hong Kong 2.Department of Computer and Information Science, University of Macau, Taipa, Macao 3.State Key Laboratory of Internet of Things for Smart City, University of Macau, Taipa, Macao 4.Department of Industrial and System Engineering, The Hong Kong Polytechnic University, Hung Hom, Hong Kong 5.School of Transportation, Southeast University, China 6.Jiangsu Key Laboratory of Urban ITS, China 7.Jiangsu Province Collaborative Innovation Center of Modern Urban Traffic Technologies, China 8.School of Intelligent Systems Engineering, Sun Yat-Sen University Guangzhou, China |
Recommended Citation GB/T 7714 | Ding, Hongliang,Lu, Yuhuan,Sze, N. N.,et al. A deep generative approach for crash frequency model with heterogeneous imbalanced data[J]. Analytic Methods in Accident Research, 2022, 34, 100212. |
APA | Ding, Hongliang., Lu, Yuhuan., Sze, N. N.., Chen, Tiantian., Guo, Yanyong., & Lin, Qinghai (2022). A deep generative approach for crash frequency model with heterogeneous imbalanced data. Analytic Methods in Accident Research, 34, 100212. |
MLA | Ding, Hongliang,et al."A deep generative approach for crash frequency model with heterogeneous imbalanced data".Analytic Methods in Accident Research 34(2022):100212. |
Files in This Item: | There are no files associated with this item. |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment