Fuzzy-based assessment of stakeholder feedback in software requirements
DOI: https://doi.org/10.3846/ntcs.2025.26832Abstract
Requirements engineering is essential for aligning software systems with stakeholder needs, yet incorporating stakeholder feedback into existing software requirements remains challenging due to ambiguity, inconsistency, and limited validation mechanisms. This paper proposes an AI-based evaluation approach for assessing the quality of software requirements and the correctness of feedback-driven modifications. The method combines natural language processing, large language models, and a hierarchical fuzzy inference system to support systematic evaluation. A multi-label text classification model is trained to identify common requirement defects, including ambiguity, subjectivity, vagueness, non-verifiability, and negativity. These indicators are aggregated using a fuzzy inference hierarchy to compute requirement quality scores and evaluate the preservation and correctness of changes introduced by stakeholder feedback. The approach is implemented as a web-based software system and evaluated against multiple AI-based methods and human assessments using defined quality criteria and performance metrics. Results indicate that the proposed hybrid method provides consistent and interpretable evaluations and can support more structured assessment of stakeholder feedback implementation in requirements engineering.
First published online 3 June 2026
Keywords:
requirement quality, modification, stakeholder, feedback, FIS, LLM, AI, text classification, assessmentHow to Cite
Share
License
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Alem, A. L., Gebretsadik, K. K., Mengistie, S. A., & Admas, M. F. (2025). Multi-label software requirement smells classification using deep learning. Scientific Reports, 15, Article 5761. https://doi.org/10.1038/s41598-025-86673-w
Alonso, J. M., & Magdalena, L. (2011). Special issue on interpretable fuzzy systems. Information Sciences, 181(20), 4331–4339. https://doi.org/10.1016/j.ins.2011.07.001
Bardossy, A., & Duckstein, L. (2022). Fuzzy rule-based modeling with applications to geophysical, biological and engineering systems. Taylor and Francis. https://doi.org/10.1201/9780138755133
Barzegar, A., Barzegar, Y., Verde, L., Bellini, F., Pisani, P., & Marrone, S. (2025). Measuring software product quality based on fuzzy inference system techniques in ISO standard. Procedia Computer Science, 270, 6045–6054. https://doi.org/10.1016/j.procs.2025.10.074
Binder, M., & Mezhuyev, V. (2024). A framework for creating an IoT system specification with ChatGPT. Internet of Things, 27, Article 101218. https://doi.org/10.1016/j.iot.2024.101218
Cheng, H., Husen, J. H., Lu, Y., Racharak, T., Yoshioka, N., Ubayashi, N., & Washizaki, H. (2026). Generative AI for requirements engineering: A systematic literature review. Software – Practice and Experience, 56(2), 141–170. https://doi.org/10.1002/spe.70029
Devlin, J., Chang, M. W., Lee, K., & Toutanova, K. (2018). BERT: Pre-training of deep bidirectional transformers for language understanding. In Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies (vol. 1, pp. 4171–4186). The Association for Computational Linguistics.
Dutu, L. C., Mauris, G., & Bolon, P. (2017). A fast and accurate rule-base generation method for mamdani fuzzy systems. IEEE Transactions on Fuzzy Systems, 26(2), 715–733. https://doi.org/10.1109/TFUZZ.2017.2688349
Ellsel, C., & Stark, R. (2025). Advancing requirements engineering with large language models. Procedia CIRP, 136, 701–706. https://doi.org/10.1016/j.procir.2025.08.120
Femmer, H., Mendez Fernandez, D., Juergens, E., Klose, M., Zimmer, I., & Zimmer, J. (2014). Rapid requirements checks with requirements smells: two case studies. In Proceedings of the 1st International Workshop on Rapid Continuous Software Engineering. Association for Computing Machinery. https://doi.org/10.1145/2593812.2593817
Gentili, E., & Falessi, D. (2025). Practitioners’ perceptions on requirements smells. Information and Software Technology, 187, Article 107823. https://doi.org/10.1016/j.infsof.2025.107823
International Organization for Standardization. (2018). Systems and software engineering – Life cycle processes – Requirements engineering (standard No. ISO/IEC/IEEE 29148:2018). https://www.iso.org/standard/72089.html#lifecycle
Krishna, M., Gaur, B., Verma, A., & Jalote, P. (2024). Using LLMs in software requirements specifications: An empirical evaluation. In Proceedings of the IEEE International Conference on Requirements Engineering (pp. 475–483). IEEE. https://doi.org/10.1109/RE59067.2024.00056
Norheim, J. J., Rebentisch, E., Xiao, D., Draeger, L., Kerbrat, A., & De Weck, O. L. (2024). Challenges in applying large language models to requirements engineering tasks. Design Science, 10, Article e16. https://doi.org/10.1017/dsj.2024.8
Papapanos, K., & Pfeifer, J. (2023). A literature review on the impact of artificial intelligence in requirements elicitation and analysis (MSc Thesis). Stockholm University. https://urn.kb.se/resolve?urn=urn:nbn:se:su:diva-219598
Parrales-Bravo, F., Gómez-Rodríguez, V., Chiquito-Vera, L., Rendón-Quijije, I., Caicedo-Quiroz, R., Tolozano-Benites, E., Vasquez-Cevallos, L., & Cevallos-Torres, L. (2024). DEAR: Detecting ambiguous requirements as a way to develop skills in requirement specifications. Electronics, 13(15), Article 3079. https://doi.org/10.3390/electronics13153079
Sami, M. A., Rasheed, Z., Waseem, M., Zhang, Z., Herda, T., & Abrahamsson, P. (2024). Prioritizing software requirements using large language models. arXiv. https://doi.org/10.48550/arXiv.2405.01564
Stein, A., Mirzai, A., Axmann, J., & Vietor, T. (2026). Integrating the capabilities offered by large language models into the requirements engineering process. Digital Engineering, 10, Article 100098. https://doi.org/10.1016/j.dte.2026.100098
Vogelsang, A., & Fischbach, J. (2024). Using large language models for natural language processing tasks in requirements engineering: A Systematic Guideline. arXiv. https://doi.org/10.48550/arXiv.2402.13823
Wolf, E., Trendowicz, A., & Siebert, J. (2026). Quality assessment of software requirements using artificial intelligence methods: A systematic literature review. Information and Software Technology, 191, Article 107979. https://doi.org/10.1016/j.infsof.2025.107979
Zakeri-Nasrabadi, M., & Parsa, S. (2024). Natural language requirements testability measurement based on requirement smells. Neural Computing and Applications, 36(21), 13051–13085. https://doi.org/10.1007/s00521-024-09730-x
Zhao, L., Alhoshan, W., Ferrari, A., Letsholo, K. J., Ajagbe, M. A., Chioasca, E.-V., & Batista-Navarro, R. T. (2020). Natural Language Processing (NLP) for requirements engineering: A systematic mapping study. arXiv. https://doi.org/10.48550/arXiv.2004.01099
View article in other formats
CrossMark check
Published
Issue
Section
Copyright
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
License
This work is licensed under a Creative Commons Attribution 4.0 International License.