An integrated vision-based dynamic collision risk assessment framework of workers and mobile machinery on construction site
DOI: https://doi.org/10.3846/jcem.2026.24922Abstract
The concepts of environmental impact index and spatial conflict degree have gained prominence in enhancing the controllability of collision accidents and mitigating the likelihood of collisions during construction processes. Nevertheless, prior studies predominantly focused on exploring collisions in terms of proximity and congestion between pairs of entities, thereby overlooking a comprehensive consideration of workers, construction machinery, environmental factors, and the spatial interaction of specific activities.To this end, this study aims to propose an integrated vision-based dynamic collision risk assessment framework by setting workers and mobile machinery as targeted research objectives and embedding a comprehensive risk assessment model in the proposed framework, thereby comprehensively assessing four types of risk factors (i.e., proximity, congestion, environmental impact index, and spatial conflict), and visualize the hierarchy of risk warnings. Firstly, a comprehensive risk assessment model was developed by using the fuzzy comprehensive evaluation method. This is followed by developing a dynamic risk assessment framework to extract the spatial information of the monitored objects by using computer vision as the underlying data of the risk factors. Finally, the proposed integrated framework was validated by an experimental study. This experiment’s safety risk assessment results are consistent with expectations, which largely illustrates the effectiveness of the evaluation model constructed in this paper. For the vision module, the accuracy of classification and monitoring is more than 95%, and the speed of the object detection algorithm to process the video is about 10 frames per second, which shows the feasibility of this study.
Keywords:
dynamic collision risk assessment, fuzzy comprehensive evaluation, environmental impact factor, space conflict, computer visionHow to Cite
Share
License
Copyright (c) 2026 The Author(s). Published by Vilnius Gediminas Technical University.
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Akinci, B., Fischen, M., Levitt, R., & Carlson, R. (2002). Formalization and automation of time-space conflict analysis. Journal of Computing in Civil Engineering, 16(2), 124–134. https://doi.org/10.1061/(ASCE)0887-3801(2002)16:2(124)
Alizadeh, S. S., Mortazavi, S. B., & Mehdi Sepehri, M. (2015). Assessment of accident severity in the construction industry using the Bayesian theorem. International Journal of Occupational Safety and Ergonomics, 21(4), 551–557. https://doi.org/10.1080/10803548.2015.1095546
Alruqi, W. M., & Hallowell, M. R. (2019). Critical success factors for construction safety: Review and meta-analysis of safety leading indicators. Journal of Construction Engineering and Management, 145(3), Article 04019005. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001626
Ballesteros, M. J., Fernández, M. D., Quintana, S., Ballesteros, J. A., & González, I. (2010). Noise emission evolution on construction sites. Measurement for controlling and assessing its impact on the people and on the environment. Building and Environment, 45(3), 711–717. https://doi.org/10.1016/j.buildenv.2009.08.011
Chen, H., Luo, X., Zheng, Z., & Ke, J. (2019). A proactive workers’ safety risk evaluation framework based on position and posture data fusion. Automation in Construction, 98, 275–288. https://doi.org/10.1016/j.autcon.2018.11.026
Chen, C., Zhu, Z., & Hammad, A. (2020). Automated excavators activity recognition and productivity analysis from construction site surveillance videos. Automation in Construction, 110, Article 103045. https://doi.org/10.1016/j.autcon.2019.103045
Chi, S., & Caldas, C. H. (2012). Image-based safety assessment: Automated spatial safety risk identification of earthmoving and surface mining activities. Journal of Construction Engineering and Management, 138(3), 341–351. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000438
Choi, B., Lee, H.-S., Park, M., Cho, Y. K., & Kim, H. (2014). Framework for work-space planning using four-dimensional BIM in construction projects. Journal of Construction Engineering and Management, 140(9), Article 04014041. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000885
Dagan, D., & Isaac, S. (2015). Planning safe distances between workers on construction sites. Automation in Construction, 50, 64–71. https://doi.org/10.1016/j.autcon.2014.12.008
Dashti, M. S., RezaZadeh, M., Khanzadi, M., & Taghaddos, H. (2021). Integrated BIM-based simulation for automated time-space conflict management in construction projects. Automation in Construction, 132, Article 103957. https://doi.org/10.1016/j.autcon.2021.103957
Esmaeili, B., Hallowell, M. R., & Rajagopalan, B. (2015). Attribute-based safety risk assessment. II: Predicting safety outcomes using generalized linear models. Journal of Construction Engineering and Management, 141(8), Article 04015022. https://doi.org/10.1061/(ASCE)CO.1943-7862.0000981
Europe Construction Tech Review. (2020). Top 10 safety and compliance solution companies-2020. https://safety-and-compliance.constructiontechreview.com/vendors/top-safety-compliance-companies-2020.html
Fang, W., Ding, L., Luo, H., & Love, P. E. (2018). Falls from heights: A computer vision-based approach for safety harness detection. Automation in Construction, 91, 53–61. https://doi.org/10.1016/j.autcon.2018.02.018
Gan, W., Gu, K., Geng, J., Qiu, C., Yang, R., Wang, H., & Hu, X. (2024). A novel three-stage collision-risk pre-warning model for construction vehicles and workers. Buildings, 14(8), Article 2324. https://doi.org/10.3390/buildings14082324
Gheisari, M., & Esmaeili, B. (2019). Applications and requirements of unmanned aerial systems (UASs) for construction safety. Safety Science, 118, 230–240. https://doi.org/10.1016/j.ssci.2019.05.015
Golovina, O., Teizer, J., & Pradhananga, N. (2016). Heat map generation for predictive safety planning: Preventing struck-by and near miss interactions between workers-on-foot and construction equipment. Automation in Construction, 71, 99–115. https://doi.org/10.1016/j.autcon.2016.03.008
Guo, B. H., & Yiu, T. W. (2016). Developing leading indicators to monitor the safety conditions of construction projects. Journal of Management in Engineering, 32(1), Article 04015016. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000376
Guo, H., Yu, Y., Ding, Q., & Skitmore, M. (2018). Image-and-skeleton-based parameterized approach to real-time identification of construction workers’ unsafe behaviors. Journal of Construction Engineering and Management, 144(6), Article 04018042. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001497
Hallowell, M. R., Alexander, D., & Gambatese, J. A. (2017). Energy-based safety risk assessment: Does magnitude and intensity of energy predict injury severity?. Construction Management and Economics, 35(1–2), 64–77. https://doi.org/10.1080/01446193.2016.1274418
Han, S., & Lee, S. (2013). A vision-based motion capture and recognition framework for behavior-based safety management. Automation in Construction, 35, 131–141. https://doi.org/10.1016/j.autcon.2013.05.001
Hinze, J., Huang, X., & Terry, L. (2005). The nature of struck-by accidents. Journal of Construction Engineering and Management, 131(2), 262–268. https://doi.org/10.1061/(ASCE)0733-9364(2005)131:2(262)
Holecek, P., & Talašová, J. (2010). FuzzME: a new software for multiple-criteria fuzzy evaluation. Acta Universitatis Matthiae Belii ser. Mathematics, 16, 35–51.
Hu, Q., Bai, Y., He, L., Cai, Q., Tang, S., Ma, G., Tan, J., & Liang, B. (2020). Intelligent framework for worker-machine safety assessment. Journal of Construction Engineering and Management, 146(5), Article 04020045. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001801
Isaac, S., & Edrei, T. (2016). A statistical model for dynamic safety risk control on construction sites. Automation in Construction, 63, 66–78. https://doi.org/10.1016/j.autcon.2015.12.006
Kanan, R., Elhassan, O., & Bensalem, R. (2018). An IoT-based autonomous system for workers’ safety in construction sites with real-time alarming, monitoring, and positioning strategies. Automation in Construction, 88, 73–86. https://doi.org/10.1016/j.autcon.2017.12.033
Kang, Y., Siddiqui, S., Suk, S. J., Chi, S., & Kim, C. (2017). Trends of fall accidents in the US construction industry. Journal of Construction Engineering and Management, 143(8), Article 04017043. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001332
Kassem, M., Dawood, N., & Chavada, R. (2015). Construction workspace management within an Industry Foundation Class-Compliant 4D tool. Automation in Construction, 52, 42–58. https://doi.org/10.1016/j.autcon.2015.02.008
Khakzad, N., Khan, F., & Paltrinieri, N. (2014). On the application of near accident data to risk analysis of major accidents. Reliability Engineering & System Safety, 126, 116–125. https://doi.org/10.1016/j.ress.2014.01.015
Kim, H., Kim, K., & Kim, H. (2016). Vision-based object-centric safety assessment using fuzzy inference: Monitoring struck-by accidents with moving objects. Journal of Computing in Civil Engineering, 30(4), Article 04015075. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000562
Kim, K., Kim, H., & Kim, H. (2017). Image-based construction hazard avoidance system using augmented reality in wearable device. Automation in Construction, 83, 390–403. https://doi.org/10.1016/j.autcon.2017.06.014
Kim, D., Liu, M., Lee, S., & Kamat, V. R. (2019). Remote proximity monitoring between mobile construction resources using camera-mounted UAVs. Automation in Construction, 99, 168–182. https://doi.org/10.1016/j.autcon.2018.12.014
Lee, S. C., Kim, J. H., & Hong, J. Y. (2019). Characterizing perceived aspects of adverse impact of noise on construction managers on construction sites. Building and Environment, 152, 17–27. https://doi.org/10.1016/j.buildenv.2019.02.005
Li, J., Su, Z., Geng, J., & Yin, Y. (2018). Real-time detection of steel strip surface defects based on improved yolo detection network. IFAC-PapersOnLine, 51(21), 76–81. https://doi.org/10.1016/j.ifacol.2018.09.412
Liu, H., & Tian, G. (2019). Building engineering safety risk assessment and early warning mechanism construction based on distributed machine learning algorithm. Safety Science, 120, 764–771. https://doi.org/10.1016/j.ssci.2019.08.022
Liu, J., Gong, E., Wang, D., & Teng, Y. (2018). Cloud model-based safety performance evaluation of prefabricated building project in China. Wireless Personal Communications, 102, 3021–3039. https://doi.org/10.1007/s11277-018-5323-3
Lou, X., & Cui, B. (2007). Boundedness and exponential stability for nonautonomous RCNNs with distributed delays. Computers & Mathematics with Applications, 54(4), 589–598. https://doi.org/10.1016/j.camwa.2007.02.007
Luo, X., Li, H., Cao, D., Yu, Y., Yang, X., & Huang, T. (2018). Towards efficient and objective work sampling: Recognizing workers’ activities in site surveillance videos with two-stream convolutional networks. Automation in Construction, 94, 360–370. https://doi.org/10.1016/j.autcon.2018.07.011
Mardani, A., Jusoh, A., & Zavadskas, E. K. (2015). Fuzzy multiple criteria decision-making techniques and applications–Two decades review from 1994 to 2014. Expert Systems with Applications, 42(8), 4126–4148. https://doi.org/10.1016/j.eswa.2015.01.003
Martinez, P., Ahmad, R., & Al-Hussein, M. (2019a). A vision-based system for pre-inspection of steel frame manufacturing. Automation in Construction, 97, 151–163. https://doi.org/10.1016/j.autcon.2018.10.021
Martinez, P., Al-Hussein, M., & Ahmad, R. (2019b). A scientometric analysis and critical review of computer vision applications for construction. Automation in Construction, 107, Article 102947. https://doi.org/10.1016/j.autcon.2019.102947
Moon, H., Dawood, N., & Kang, L. (2014). Development of workspace conflict visualization system using 4D object of work schedule. Advanced Engineering Informatics, 28(1), 50–65. https://doi.org/10.1016/j.aei.2013.12.001
Nguyen, L. D., Tran, D. Q., & Chandrawinata, M. P. (2016). Predicting safety risk of working at heights using Bayesian networks. Journal of Construction Engineering and Management, 142(9), Article 04016041. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001154
Ning, X., Qi, J., & Wu, C. (2018). A quantitative safety risk assessment model for construction site layout planning. Safety Science, 104, 246–259. https://doi.org/10.1016/j.ssci.2018.01.016
Paltrinieri, N., Khan, F., & Cozzani, V. (2015). Coupling of advanced techniques for dynamic risk management. Journal of Risk Research, 18(7), 910–930. https://doi.org/10.1080/13669877.2014.919515
Park, J., Marks, E., Cho, Y. K., & Suryanto, W. (2016). Performance test of wireless technologies for personnel and equipment proximity sensing in work zones. Journal of Construction Engineering and Management, 142(1), Article 04015049. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001031
Poh, C. Q., Ubeynarayana, C. U., & Goh, Y. M. (2018). Safety leading indicators for construction sites: A machine learning approach. Automation in Construction, 93, 375–386. https://doi.org/10.1016/j.autcon.2018.03.022
Raveendran, A., Renjith, V., & Madhu, G. (2022). A comprehensive review on dynamic risk analysis methodologies. Journal of Loss Prevention in the Process Industries, 76, Article 104734. https://doi.org/10.1016/j.jlp.2022.104734
Redmon, J., & Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv. https://doi.org/10.48550/arXiv.1804.02767
Salas, R., & Hallowell, M. (2016). Predictive validity of safety leading indicators: Empirical assessment in the oil and gas sector. Journal of Construction Engineering and Management, 142(10), Article 04016052. https://doi.org/10.1061/(ASCE)CO.1943-7862.0001167
Sawicki, M., & Szóstak, M. (2020). Quantitative assessment of the state of threat of working on construction scaffolding. International Journal of Environmental Research and Public Health, 17(16), Article 5773. https://doi.org/10.3390/ijerph17165773
Seker, S., & Zavadskas, E. K. (2017). Application of fuzzy DEMATEL method for analyzing occupational risks on construction sites. Sustainability, 9(11), Article 2083. https://doi.org/10.3390/su9112083
Seo, J., Han, S., Lee, S., & Kim, H. (2015). Computer vision techniques for construction safety and health monitoring. Advanced Engineering Informatics, 29(2), 239–251. https://doi.org/10.1016/j.aei.2015.02.001
Shin, Y.-S., & Kim, J. (2022). A vision-based collision monitoring system for proximity of construction workers to trucks enhanced by posture-dependent perception and truck bodies’ occupied space. Sustainability, 14(13), Article 7934. https://doi.org/10.3390/su14137934
Shu, Y., Duan, W., & Jiao, C. (2019). SSD evolution model in HF etching of fused silica optics. Optik, 181, 372–377. https://doi.org/10.1016/j.ijleo.2018.12.067
Son, H., Seong, H., Choi, H., & Kim, C. (2019). Real-time vision-based warning system for prevention of collisions between workers and heavy equipment. Journal of Computing in Civil Engineering, 33(5), Article 04019029. https://doi.org/10.1061/(ASCE)CP.1943-5487.0000845
Sun, X., Wu, P., & Hoi, S. C. (2018). Face detection using deep learning: An improved faster RCNN approach. Neurocomputing, 299, 42–50. https://doi.org/10.1016/j.neucom.2018.03.030
Teizer, J., & Cheng, T. (2015). Proximity hazard indicator for workers-on-foot near miss interactions with construction equipment and geo-referenced hazard areas. Automation in Construction, 60, 58–73. https://doi.org/10.1016/j.autcon.2015.09.003
Veit, A., Matera, T., Neumann, L., Matas, J., & Belongie, S. (2016). Coco-text: Dataset and benchmark for text detection and recognition in natural images. arXiv. https://doi.org/10.48550/arXiv.1601.07140
Viso.ai. (2024). Viso Suite. https://viso.ai/
Wang, J., & Razavi, S. (2017). A comprehensive spatio-temporal network-based model for dynamic risk analysis on struck-by-equipment hazard. In Computing in Civil Engineering 2017 (pp. 384–391). ASCE. https://doi.org/10.1061/9780784480847.048
Wang, Y., Liao, P.-C., Zhang, C., Ren, Y., Sun, X., & Tang, P. (2019). Crowdsourced reliable labeling of safety-rule violations on images of complex construction scenes for advanced vision-based workplace safety. Advanced Engineering Informatics, 42, Article 101001. https://doi.org/10.1016/j.aei.2019.101001
Yu, Y., Guo, H., Ding, Q., Li, H., & Skitmore, M. (2017). An experimental study of real-time identification of construction workers’ unsafe behaviors. Automation in Construction, 82, 193–206. https://doi.org/10.1016/j.autcon.2017.05.002
Zhang, S., Teizer, J., Pradhananga, N., & Eastman, C. M. (2015). Workforce location tracking to model, visualize and analyze workspace requirements in building information models for construction safety planning. Automation in Construction, 60, 74–86. https://doi.org/10.1016/j.autcon.2015.09.009
Zhang, L., Wu, X., Zhu, H., & AbouRizk, S. M. (2017). Perceiving safety risk of buildings adjacent to tunneling excavation: An information fusion approach. Automation in Construction, 73, 88–101. https://doi.org/10.1016/j.autcon.2016.09.003
Zhang, M., Shi, R., & Yang, Z. (2020). A critical review of vision-based occupational health and safety monitoring of construction site workers. Safety Science, 126, Article 104658. https://doi.org/10.1016/j.ssci.2020.104658
Zhang, Y., Guo, X., & Ma, Y. (2025). A traffic conflict risk assessment model for highway construction zones based on trajectory data (SAE Technical Paper 2025-01-7217). https://doi.org/10.4271/2025-01-7217
Zhi-Qiang, H., & Ya-mei, Z. (2016). Research on risk assessment technology of the major hazard in harbor engineering. Procedia Engineering, 137, 843–848. https://doi.org/10.1016/j.proeng.2016.01.324
Zhong, B., Wu, H., Ding, L., Love, P. E., Li, H., Luo, H., & Jiao, L. (2019). Mapping computer vision research in construction: Developments, knowledge gaps and implications for research. Automation in Construction, 107, Article 102919. https://doi.org/10.1016/j.autcon.2019.102919
Zhu, Z., Park, M.-W., Koch, C., Soltani, M., Hammad, A., & Davari, K. (2016). Predicting movements of onsite workers and mobile equipment for enhancing construction site safety. Automation in Construction, 68, 95–101. https://doi.org/10.1016/j.autcon.2016.04.009
View article in other formats
CrossMark check
Published
Issue
Section
Copyright
Copyright (c) 2026 The Author(s). Published by Vilnius Gediminas Technical University.
License
This work is licensed under a Creative Commons Attribution 4.0 International License.