Novel hybrid model for addressing uncertainty of the road safety composite indicator: integration of DEA and weighted GRA
DOI: https://doi.org/10.3846/transport.2025.20539Abstract
Creating a composite indicator is a popular concept in evaluating and comparing road safety of territories. While many other approaches are used, most current interest is on Data Envelopment Analysis (DEA) for measuring the relative performance in efficiency terms. Usefulness of DEA, which measure performance in efficiency terms, has already been proven. However, the indicators commonly used to construct a road safety composite index are not always precise and accurate (particularly safety performance indicators), and the results obtained from this type of data does not seem to be solid. So, the main aim of this paper is to represent the novel methodology to effectively evaluate the state of road safety and create a reliable composite index of the selected entities when imprecise data are involved and, to produce reliable composite index under uncertain environment. DEA, the weighting method Fan–Ma, and the Grey Relational Analysis (GRA) were integrated into hybrid methodology to obtain a more realistic and relevant picture of road safety. Applying this hybrid methodology, peculiarity of DEA is retained, scores are further differentiated, and entities are ranked and classified according to the road safety level. A case study was conducted to evaluate and rank municipalities, determine road safety classes and benchmark the territories under study. Results were verified indicating the robustness and effectiveness of the proposed methodology and its superiority to basic DEA as regards the territory ranking.
First published online 3 February 2026
Keywords:
road safety, composite indicator, data envelopment analysis, uncertainty, grey relational analysis, Fan–MaHow to Cite
Share
License
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Al-Haji, G. 2007. Road Safety Development Index (RSDI): Theory, Philosophy and Practice. Dissertation No 1100. Linköping University, Norrköping, Sweden. 159 p. Available from Internet: https://urn.kb.se/resolve?urn=urn:nbn:se:liu:diva-8812
Alper, D.; Sinuany-Stern, Z.; Shinar, D. 2015. Evaluating the efficiency of local municipalities in providing traffic safety using the data envelopment analysis, Accident Analysis & Prevention 78: 39–50. https://doi.org/10.1016/j.aap.2015.02.014
Amini, M.; Dabbagh, R.; Omrani, H. 2019. A fuzzy data envelopment analysis based on credibility theory for estimating road safety, Decision Science Letters 8: 275–284. https://doi.org/10.5267/j.dsl.2019.1.001
Anderson, T. R.; Hollingsworth, K.; Inman, L. 2002. The fixed weighting nature of a cross-evaluation model, Journal of Productivity Analysis 17(3): 249–255. https://doi.org/10.1023/A:1015012121760
Antić, B.; Grdinić, M.; Pešić, D.; Pajković, V. 2020. Benchmarking of the road safety performance among the regions by using DEA, Transportation Research Procedia 45: 78–86. https://doi.org/10.1016/j.trpro.2020.02.065
Ayati, E.; Pirayesh Neghab, M. A.; Sadeghi, A. A.; Mohammadzadeh Moghaddam, A. 2012. Introducing roadside hazard severity indicator based on evidential reasoning approach, Safety Science 50(7): 1618–1626. https://doi.org/10.1016/j.ssci.2012.03.023
Babaee, S.; Bagherikahvarin, M.; Sarrazin, R.; Shen, Y.; Hermans, E. 2015. Use of DEA and PROMETHEE II to assess the performance of older drivers, Transportation Research Procedia 10: 798–808. https://doi.org/10.1016/j.trpro.2015.09.033
Babaee, S.; Toloo, M.; Hermans, E.; Shen, Y. 2021. A new approach for index construction: the case of the road user behavior index, Computers & Industrial Engineering 152: 106993. https://doi.org/10.1016/j.cie.2020.106993
Baležentis, A.; Baležentis, T. 2011. Assessing the efficiency of Lithuanian transport sector by applying the methods of MULTIMOORA and data envelopment analysis, Transport 26(3): 263–270. https://doi.org/10.3846/16484142.2011.621146
Banker, R. D.; Charnes, A.; Cooper, W. W. 1984. Some models for estimating technical and scale inefficiencies in data envelopment analysis, Management Science 30(9): 1078–1092. https://doi.org/10.1287/mnsc.30.9.1078
Bao, Q.; Ruan, D.; Shen, Y.; Hermans, E.; Janssens, D. 2012. Improved hierarchical fuzzy TOPSIS for road safety performance evaluation, Knowledge-Based Systems 32: 84–90. https://doi.org/10.1016/j.knosys.2011.08.014
Bastos, J. T.; Shen, Y.; Hermans, E.; Brijs, T.; Wets, G.; Ferraz, A. C. P. 2015. Traffic fatality indicators in Brazil: state diagnosis based on data envelopment analysis research, Accident Analysis & Prevention 81: 61–73. https://doi.org/10.1016/j.aap.2015.01.024
Behdani, Z.; Darehmiraki, M. 2022. An alternative approach to rank efficient DMUs in DEA via cross-efficiency evaluation, Gini coefficient, and Bonferroni mean, Journal of the Operations Research Society of China 10(4): 763–783. https://doi.org/10.1007/s40305-019-00264-x
Behnood, H. R.; Ayati, E.; Brijs, T.; Pirayesh Neghab, M.; Shen, Y. 2017. A fuzzy decision-support system in road safety planning, Proceedings of the Institution of Civil Engineers – Transport 170(5): 305–317. https://doi.org/10.1680/jtran.15.00062
Blagojević, A.; Vesković, S.; Kasalica, S.; Gojić, A.; Allamani, A. 2020. The application of the fuzzy AHP and DEA for measuring the efficiency of freight transport railway undertakings, Operational Research in Engineering Sciences: Theory and Applications 3(2): 1–23. Available from Internet: https://oresta.org/menu-script/index.php/oresta/article/view/52
Castro-Nuño, M.; Arévalo-Quijada, M. T. 2018. Assessing urban road safety through multidimensional indexes: Application of multicriteria decision making analysis to rank the Spanish provinces, Transport Policy 68: 118–129. https://doi.org/10.1016/j.tranpol.2018.04.017
Charnes, A.; Cooper, W. W.; Rhodes, E. 1978. Measuring the efficiency of decision making units, European Journal of Operational Research 2(6): 429–444. https://doi.org/10.1016/0377-2217(78)90138-8
Chen, F.; Wang, J.; Deng, Y. 2015. Road safety risk evaluation by means of improved entropy TOPSIS–RSR, Safety Science 79: 39–54. https://doi.org/10.1016/j.ssci.2015.05.006
Chen, F.; Wu, J.; Chen, X.; Wang, J.; Wang, D. 2016. Benchmarking road safety performance: identifying a meaningful reference (best-in-class), Accident Analysis & Prevention 86: 76–89. https://doi.org/10.1016/j.aap.2015.10.018
Deng, J. 1989. Introduction to Grey system theory, The Journal of Grey System 1(1): 1–24.
Dutta, P.; Jaikumar, B.; Arora, M. S. 2022. Applications of data envelopment analysis in supplier selection between 2000 and 2020: a literature review, Annals of Operations Research 315(2): 1399–1454. https://doi.org/10.1007/s10479-021-03931-6
Đalić, I.; Stević, Ž.; Ateljević, J.; Turskis, Z.; Zavadskas, E. K.; Mardani, A. 2021. A novel integrated MCDM-SWOT-TOWS model for the strategic decision analysis in transportation company, Facta Universitatis: Mechanical Engineering 19(3): 401–422. https://doi.org/10.22190/fume201125032d
Ehrgott, M.; Holder, A.; Nohadani, O. 2018. Uncertain data envelopment analysis, European Journal of Operational Research 268(1): 231–242. https://doi.org/10.1016/j.ejor.2018.01.005
ETSC. 2001. Transport Safety Performance Indicators. European Transport Safety Council (ETSC), Brussels, Belgium. 56 p. Available from Internet: https://etsc.eu/transport-safety-performance-indicators
Fan, Z.-P.; Zheng, L.-H.; Pan, D.-H. 1996. A Subjective and objective synthetic method for multiple attribute decision making, IFAC Proceedings Volumes 29(1): 5635–5640. https://doi.org/10.1016/S1474-6670(17)58580-8
Fancello, G.; Carta, M.; Serra, P. 2020. Data envelopment analysis for the assessment of road safety in urban road networks: a comparative study using CCR and BCC models, Case Studies on Transport Policy 8(3): 736–744. https://doi.org/10.1016/j.cstp.2020.07.007
Folla, K.; Nikolaou, P.; Dimitriou, L.; Yannis, G. 2021. Benchmarking analysis of road safety levels for an extensive and representative dataset of European cities, Advances in Intelligent Systems and Computing 1278: 1066–1075. https://doi.org/10.1007/978-3-030-61075-3_102
Geerlings, H.; Klementschitz, R.; Mulley, C. 2006. Development of a methodology for benchmarking public transportation organisations: a practical tool based on an industry sound methodology, Journal of Cleaner Production 14(2): 113–123. https://doi.org/10.1016/j.jclepro.2005.03.021
Gitelman, V.; Doveh, E.; Hakkert, S. 2010. Designing a composite indicator for road safety, Safety Science 48(9): 1212–1224. https://doi.org/10.1016/j.ssci.2010.01.011
Grdinić-Rakonjac, M.; Antić, B.; Pešić, D.; Pajković, V. 2021. Construction of road safety composite indicator using grey relational analysis, Promet – Traffic & Transportation 33(1): 103–116. Available from Internet: https://traffic2.fpz.hr/index.php/promtt/article/view/2914
Hermans, E. 2009. A Methodology for Developing a Composite Road Safety Performance Index for Cross-Country Comparison. PhD Dissertation. Hasselt University, Belgium. 261 p.
Hermans, E.; Van den Bosshe, F.; Wets, G. 2008. Combining road safety information in a performance index, Accident Analysis & Prevention 40(4): 1337–1344. https://doi.org/10.1016/j.aap.2008.02.004
Hu, Q.-Z.; Lu, H.-P.; Deng, W. 2010. Evaluating the urban public transit network based on the attribute recognition model, Transport 25(3): 300–306. https://doi.org/10.3846/transport.2010.37
Jameel, A. K.; Evdorides, H. 2021. Developing a safer road user behaviour index, IATSS Research 45(1): 70–78. https://doi.org/10.1016/j.iatssr.2020.06.006
Javed, S. A.; Khan, A. M.; Dong, W.; Raza, A.; Liu, S. 2019. Systems evaluation through new grey relational analysis approach: an application on thermal conductivity – petrophysical parameters′ relationships, Processes 7(6): 348. https://doi.org/10.3390/pr7060348
Jiang, B.; Lio, W.; Li, X. 2019. An uncertain DEA model for scale efficiency evaluation, IEEE Transactions on Fuzzy Systems 27(8): 1616–1624. https://doi.org/10.1109/tfuzz.2018.2883546
Kang, L.; Wu, C. 2022. Evaluating the performance of Chinese provincial road safety based on the output–input ratio, Transportation Letters: the International Journal of Transportation Research 14(2): 114–123. https://doi.org/10.1080/19427867.2020.1819077
Koornstra, M.; Lynam, D.; Nilsson, G.; Noordzij, P.; Pettersson, H.-E.; Wegman, F.; Wouters, P. 2002. SUNflower: a Comparative Study of the Development of Road Safety in Sweden, the United Kingdom, and the Netherlands. SWOV Institute for Road Safety Research, The Netherlands. 159 p.
Küçükönder, H.; Demirarslan, P. Ç.; Burgut, A.; Boğa, M. 2019. A hybrid approach of data envelopment analysis based grey relational analysis: a study on egg yield, Pakistan Journal of Zoology 51(3): 903–912. https://doi.org/10.17582/journal.pjz/2019.51.3.903.912
Lee, Y.-C. 2019. Ranking DMUs by combining cross-efficiency scores based on Shannon′s entropy, Entropy 21(5): 467. https://doi.org/10.3390/e21050467
Liu, B. 2012. Why is there a need for uncertainty theory?, Journal of Uncertain Systems 6(1): 3–10. Available from Internet: https://jus.worldscientific.com/pdf/jusVol06No1paper01.pdf
Liu, Y.; Huang, X.; Duan, J.; Zhang, H. 2017. The assessment of traffic accident risk based on grey relational analysis and fuzzy comprehensive evaluation method, Natural Hazards 88: 1409–1422. https://doi.org/10.1007/s11069-017-2923-2
Lu, M.; Wevers, K. 2007. Application of grey relational analysis for evaluating road traffic safety measures: advanced driver assistance systems against infrastructure redesign, IET Intelligent Transport Systems 1(1): 3–14. https://doi.org/10.1049/iet-its:20060022
Ma, J.; Fan, Z.-P.; Huang, L.-H. 1999. A subjective and objective integrated approach to determine attribute weights, European Journal of Operational Research 112(2): 397–404. https://doi.org/10.1016/S0377-2217(98)00141-6
Ma, Z.; Shao, C.; Ma, S.; Ye, Z. 2011. Constructing road safety performance indicators using fuzzy Delphi method and grey Delphi method, Expert Systems with Applications 38(3): 1509–1514. https://doi.org/10.1016/j.eswa.2010.07.062
Mahmoudi, R.; Emrouznejad, A.; Shetab-Boushehri, S.-N.; Hejazi S. R. 2020. The origins, development and future directions of data envelopment analysis approach in transportation systems, Socio-Economic Planning Sciences 69: 100672. https://doi.org/10.1016/j.seps.2018.11.009
Mardani, A.; Zavadskas, E. K.; Khalifah, Z.; Jusoh, A.; Nor, K. M. D. 2016. Multiple criteria decision-making techniques in transportation systems: a systematic review of the state of the art literature, Transport 31(3): 359–385. https://doi.org/10.3846/16484142.2015.1121517
Mardani, A.; Zavadskas, E. K.; Štreimikienė, D.; Jusoh, A.; Khoshnoudi, M. 2017. A comprehensive review of data envelopment analysis (DEA) approach in energy efficiency, Renewable and Sustainable Energy Reviews 70: 1298–1322. https://doi.org/10.1016/j.rser.2016.12.030
Markabi, M.; S.; Sabbagh, M. 2014. A hybrid method of grey relational analysis and data envelopment analysis for evaluating and selecting efficient suppliers plus a novel ranking method for grey numbers, Journal of Industrial Engineering and Management 7(5): 25. https://doi.org/10.3926/jiem.872
Memiş, S.; Demir, E.; Karamaşa, Ç.; Korucuk, S. 2020. Prioritization of road transportation risks: an application in Giresun province, Operational Research in Engineering Sciences: Theory and Applications 3(2): 111–126. Available from Internet: https://oresta.org/menu-script/index.php/oresta/article/view/63
Mirzapour Al-E-Hashem, S. M. J.; Malekly, H.; Aryanezhad, M. B. 2011. A multi-objective robust optimization model for multi-product multi-site aggregate production planning in a supply chain under uncertainty, International Journal of Production Economics 134(1): 28–42. https://doi.org/10.1016/j.ijpe.2011.01.027
Mitrović Simić, J.; Stević, Ž.; Zavadskas, E. K.; Bogdanović, V.; Subotić, M.; Mardani, A. 2020. A novel CRITIC-fuzzy FUCOM-DEA-fuzzy MARCOS model for safety evaluation of road sections based on geometric parameters of road, Symmetry 12(12): 2006. https://doi.org/10.3390/sym12122006
Nenadić, D. 2019. Ranking dangerous sections of the road using MCDM model, Decision Making: Applications in Management and Engineering 2(1): 115–131. https://doi.org/10.31181/dmame1901115n
Nikolaou, P.; Dimitriou, L. 2018. Evaluation of road safety policies performance across Europe: results from benchmark analysis for a decade, Transportation Research Part A: Policy and Practice 116: 232–246. https://doi.org/10.1016/j.tra.2018.06.026
OECD. 2008. Handbook on Constructing Composite Indicators: Methodology and User Guide. Organisation for Economic Co-Operation and Development (OECD). 162 p. https://doi.org/10.1787/9789264043466-en
Omrani, H.; Amini, M.; Alizadeh, A. 2020. An integrated group best–worst method – data envelopment analysis approach for evaluating road safety: a case of Iran, Measurement 152: 107330. https://doi.org/10.1016/j.measurement.2019.107330
Pakkar, M. S. 2016. A hierarchical aggregation approach for indicators based on data envelopment analysis and analytic hierarchy process, Systems 4(1): 6. https://doi.org/10.3390/systems4010006
Peykani, P.; Mohammadi, E.; Emrouznejad, A.; Pishvaee, M. S.; Rostamy-Malkhalifeh, M. 2019. Fuzzy data envelopment analysis: an adjustable approach, Expert Systems with Applications 136: 439–452. https://doi.org/10.1016/j.eswa.2019.06.039
Qazvini, A. W.; Javanshir, H.; Seyedhosseni, S. M. 2016. An application of fuzzy TOPSIS for identifying and analyzing black spots suburban areas, Management Science Letters 6: 561–568. https://doi.org/10.5267/j.msl.2016.6.005
Raheel Shah, S. A.; Ahmad, N.; Shen, Y.; Kamal, M. A.; Basheer, M. A.; Brijs, T. 2019. Relationship between road traffic features and accidents: An application of two-stage decision-making approach for transportation engineers, Journal of Safety Research 69: 201–215. https://doi.org/10.1016/j.jsr.2019.01.001
Rassafi, A. A.; Ganji, S. S.; Pourkhani, H. 2018. Road safety assessment under uncertainty using a multi attribute decision analysis based on Dempster–Shafer theory, KSCE Journal of Civil Engineering 22(8): 3137–3152. https://doi.org/10.1007/s12205-017-1854-5
René, S. H.; Becker, U.; Manz, H. 2016. Grey systems theory time series prediction applied to road traffic safety in Germany, IFAC – Papers on Line 49(3): 231–236. https://doi.org/10.1016/j.ifacol.2016.07.039
Rosić, M.; Pešić, D.; Kukić, D.; Antić, B.; Božović, M. 2017. Method for selection of optimal road safety composite index with examples from DEA and TOPSIS method, Accident Analysis & Prevention 98: 277–286. https://doi.org/10.1016/j.aap.2016.10.007
Rostamzadeh, R.; Akbarian, O.; Banaitis, A.; Soltani, Z. 2021. Application of DEA in benchmarking: a systematic literature review from 2003–2020, Technological and Economic Development of Economy 27(1): 175–222. https://doi.org/10.3846/tede.2021.13406
Sexton, T. R.; Silkman, R. H.; Hogan, A. J. 1986. Data envelopment analysis: critique and extensions, New Directions for Program Evaluation 1986(32): 73–105. https://doi.org/10.1002/ev.1441
Shen, Y.; Hermans, E.; Bao, Q.; Brijs, T.; Wets, G. 2013. Road safety development in Europe: a decade of changes (2001–2010), Accident Analysis & Prevention 60: 85–94. https://doi.org/10.1016/j.aap.2013.08.013
Shen, Y.; Hermans, E.; Bao, Q.; Brijs, T.; Wets, G. 2015. Serious injuries: an additional indicator to fatalities for road safety benchmarking, Traffic Injury Prevention 16(3): 246–253. https://doi.org/10.1080/15389588.2014.930831
Shen, Y.; Hermans, E.; Brijs, T.; Wets, G.; Vanhoof, K. 2012. Road safety risk evaluation and target setting using data envelopment analysis and its extensions, Accident Analysis & Prevention 48: 430–441. https://doi.org/10.1016/j.aap.2012.02.020
Shen, Y.; Hermans, E.; Ruan, D.; Wets, G.; Brijs, T.; Vanhoof, K. 2011. A generalized multiple layer data envelopment analysis model for hierarchical structure assessment: a case study in road safety performance evaluation, Expert Systems with Applications 38(12): 15262–15272. https://doi.org/10.1016/j.eswa.2011.05.073
Si, Q.; Ma, Z. 2019. DEA cross-efficiency ranking method based on grey correlation degree and relative entropy, Entropy 21(10): 966. https://doi.org/10.3390/e21100966
Stanković, M.; Stević, Ž.; Das, D. K.; Subotić, M.; Pamučar, D. 2020. A new fuzzy MARCOS method for road traffic risk analysis, Mathematics 8(3): 457. https://doi.org/10.3390/math8030457
Su, C.-H.; Lu, T. 2019. An entropy-based cross-efficiency under variable returns to scale, Entropy 21(12): 1205. https://doi.org/10.3390/e21121205
Tsaples, G.; Papathanasiou, J. 2021. Data envelopment analysis and the concept of sustainability: a review and analysis of the literature, Renewable and Sustainable Energy Reviews 138: 110664. https://doi.org/10.1016/j.rser.2020.110664
Tsolas, I. E. 2019. Utility exchange traded fund performance evaluation. a comparative approach using grey relational analysis and data envelopment analysis modelling, International Journal of Financial Studies 7(4): 67. https://doi.org/10.3390/ijfs7040067
Wang, Y.-M.; Chin, K.-S. 2011. The use of OWA operator weights for cross-efficiency aggregation, Omega 39(5): 493–503. https://doi.org/10.1016/j.omega.2010.10.007
Wang, Z.-X.; Yao, P.-Y. 2018. Grey relational analysis of economic policy uncertainty in selected European union countries, Economic Computation and Economic Cybernetics Studies and Research 52(2): 251–265. https://doi.org/10.24818/18423264/52.2.18.15
Xiong, X.; Chen, L.; Liang, J. 2018. Analysis of roadway traffic accidents based on rough sets and Bayesian networks, Promet – Traffic & Transportation 30(1): 71–81. Available from Internet: https://traffic2.fpz.hr/index.php/promtt/article/view/2713
Yang, Y.; Liu, S.; Xie, N. 2019. Uncertainty and grey data analytics, Marine Economics and Management 2(2): 73–86. https://doi.org/10.1108/maem-08-2019-0006
Yushimito, W. F.; Alves, P. N.; Canessa, E.; De Mateo, F. 2018. Relating efficiency with service compliance indices in public transportation using slack-based measure data envelopment analysis and shadow prices, Promet – Traffic & Transportation 30(6): 661–670. Available from Internet: https://traffic2.fpz.hr/index.php/promtt/article/view/2767
Zakowska, I.; Godycki-Cwirko, M. 2020. Data envelopment analysis applications in primary health care: a systematic review, Family Practice 37(2): 147–153. https://doi.org/10.1093/fampra/cmz057
Zhu, J.; Hipel, K. W. 2012. Multiple stages grey target decision making method with incomplete weight based on multi-granularity linguistic label, Information Sciences 212: 15–32. https://doi.org/10.1016/j.ins.2012.05.011
View article in other formats
CrossMark check
Published
Issue
Section
Copyright
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
License
This work is licensed under a Creative Commons Attribution 4.0 International License.