Integration of BIM and ar with VSLAM to assist in construction site inspection
DOI: https://doi.org/10.3846/jcem.2025.24360Abstract
Building Information Modeling (BIM) has been widely adopted for construction inspections due to its ability to integrate multiple data sources. Engineers use BIM to identify and review site issues, yet inspection systems face several challenges. Firstly, positioning inspection areas on a construction site using BIM with Augmented Reality (AR) requires complex model manipulation. Additionally, signal or Internet connectivity issues may limit positioning technologies. Secondly, human error or interference is common in traditional inspection processes due to their complexity.
To overcome these barriers, this research applied BIM and AR with Visual Simultaneous Localization and Mapping (VSLAM) to help inspectors quickly and effectively record construction defects as photographs with notes and their locations. An efficient approach is proposed to integrate BIM and AR with VSLAM, and a prototype is developed to validate and demonstrate how the proposed system can assist a site inspector in performing quality management, even offline. The system uses a two-phase indoor positioning method: initial localization via visual markers and real-time tracking with VSLAM, enabling precise defect tracking and efficient model adjustments. While significantly improving inspection accuracy and efficiency, its performance is affected by environmental factors like lighting and marker placement, providing insights for future refinement.
Keywords:
Building Information Modeling (BIM), Visual Simultaneous Localization and Mapping (VSLAM), Augmented Reality (AR), construction site inspectionHow to Cite
Share
License
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
This work is licensed under a Creative Commons Attribution 4.0 International License.
References
Ashour, Z., & Yan, W. (2020). BIM-powered augmented reality for advancing human-building interaction. In Proceedings of the 38th Conference on Education and Research in Computer-Aided Architectural Design in Europe (eCAADe) (pp. 169–178), Berlin, Germany. https://doi.org/10.52842/conf.ecaade.2020.1.169
Acharya, D., Ramezani, M., Khoshelham, K., & Winter, S. (2019). BIM-Tracker: A model-based visual tracking approach for indoor localisation using a 3D building model. ISPRS Journal of Photogrammetry and Remote Sensing, 150, 157–171. https://doi.org/10.1016/j.isprsjprs.2019.02.014
Adebowale, O. J., & Agumba, J. N. (2022). Applications of augmented reality for construction productivity improvement: A systematic review. Smart and Sustainable Built Environment, 13(3), 479–495. https://doi.org/10.1108/SASBE-06-2022-0128
Alizadehsalehi, S., Hadavi, A., & Huang, J. C. (2020). From BIM to extended reality in AEC industry. Automation in Construction, 116, Article 103254. https://doi.org/10.1016/j.autcon.2020.103254
Achkar, E. (2016). A BIM-integrated approach to construction quality management. Enabling information and knowledge management during the execution phase of a project life cycle [Master’s thesis]. Eindhoven University of Technology, Netherlands.
Apple Inc. (2017). Augmented reality. https://developer.apple.com/videos/play/wwdc2018/610/
Baiburin, A. K. (2017). Errors, defects and safety control at construction stage. Procedia Engineering, 206, 807–813. https://doi.org/10.1016/j.proeng.2017.10.555
Bang, J., Lee, D., Kim, Y., & Lee, H. (2017). Camera pose estimation using optical flow and ORB descriptor in SLAM-based mobile AR game. In Proceedings of the 2017 International Conference on Platform Technology and Service (PlatCon), Busan, South Korea. https://doi.org/10.1109/PlatCon.2017.7883693
Bouhamatou, Z., & Abdessemed, F. (2024). Visual simultaneous localisation and mapping methodologies. Acta Mechanica et Automatica, 18(3), 451–462. https://doi.org/10.2478/ama-2024-0049
Chin, S., Kim, K., & Kim, Y. S. (2004). A process-based quality management information system. Automation in Construction, 13(2), 241–259. https://doi.org/10.1016/j.autcon.2003.08.010
Chen, L., & Luo, H. (2014). A BIM-based construction quality management model and its applications. Automation in Construction, 46, 64–73. https://doi.org/10.1016/j.autcon.2014.05.009
Chi, N. W., Chen, Y. W., Hsieh, S. H., Han, J. Y., & Huang, L. M. (2019). A BIM-based AR application for construction quality inspection. In International Conference on Civil and Building Engineering Informatics (ICCBEI 2019) (pp. 191–196), Sendai, Japan.
Calderon-Hernandez, C., & Brioso, X. (2018). Lean, BIM and augmented reality applied in the design and construction phase: A literature review. International Journal of Innovation, Management and Technology, 9(1), 60–63. https://doi.org/10.18178/ijimt.2018.9.1.788
Cadena, C., Carlone, L., Carrillo, H., Latif, Y., Scaramuzza, D., Neira, J., Reid, I. & Leonard, J. J. (2016). Past, present, and future of simultaneous localization and mapping: Toward the robust-perception age. IEEE Transactions on Robotics, 32(6), 1309–1332. https://doi.org/10.1109/TRO.2016.2624754
Chuang, T. Y., & Sung, C. C. (2020). Learning and SLAM based decision support platform for sewer inspection. Remote Sensing, 12(6), Article 968. https://doi.org/10.3390/rs12060968
Chowdhury, T., Adafin, J., & Wilkinson, S. (2019). Review of digital technologies to improve productivity of New Zealand construction industry. ITcon, 24, 569–587. https://doi.org/10.36680/j.itcon.2019.032
Dror, E., Zhao, J., Sacks, R., & Seppänen, O. (2019). Indoor tracking of construction workers using BLE: Mobile beacons and fixed gateways vs. fixed beacons and mobile gateways. In Proceedings of the 27th Annual Conference of the International Group for Lean Construction (IGLC) (pp. 831–842), Dublin, Ireland. https://doi.org/10.24928/2019/0154
Gashi, E. (2018). Management of defective works in infrastructure projects. International Review of Applied Sciences and Engineering, 9(1), 73–80. https://doi.org/10.1556/1848.2018.9.1.10
Herrera, A. L. V., Tecson, P. D. I., Eduardo, J. T., Rosas, M. F., & Barrameda, R. B. (2019). Utilizing simultaneous localization and mapping (SLAM) in augmented-reality shell game for iOS. TEST Engineering and Management, 81, 4973–4979.
Hsieh, S. H., Huang, B. K., & Kuo, W. L. (2023). U.S. Patent No. 11,631,195. Patent and Trademark Office, Washington, DC: U.S.
Herbers, P., & König, M. (2019). Indoor localization for augmented reality devices using BIM, point clouds, and template matching. Applied Sciences, 9(20), Article 4260. https://doi.org/10.3390/app9204260
Ibrahim, A., Faris, N., Zayed, T., Qureshi, A. H., Abdelkhalek, S., & Abdelkader, E. M. (2024). Application of infrared thermography in concrete bridge deck inspection: Current practices, challenges and future needs. Nondestructive Testing and Evaluation. https://doi.org/10.1080/10589759.2024.2443810
Jiang, J. R., & Subakti, H. (2023). An indoor location-based augmented reality framework. Sensors, 23(3), Article 1370. https://doi.org/10.3390/s23031370
Kwon, O. S., Park, C. S., & Lim, C. R. (2014). A defect management system for reinforced concrete work utilizing BIM, image-matching and augmented reality. Automation in Construction, 46, 74–81. https://doi.org/10.1016/j.autcon.2014.05.005
Krul, S., Pantos, C., Frangulea, M., & Valente, J. (2021). Visual SLAM for indoor livestock and farming using a small drone with a monocular camera: A feasibility study. Drones, 5(2), Article 41. https://doi.org/10.3390/drones5020041
Lai, X., Kan, Z., Sun, W., Song, X., Tian, B., & Yuan, T. (2024). Digital twin-based non-destructive testing for structural health monitoring of bridges. Nondestructive Testing and Evaluation, 39(1), 57–74. https://doi.org/10.1080/10589759.2023.2239434
Li, K., Tian, G. Y., Chen, X., Tang, C., Luo, H., & Li, W. (2019). AR-aided smart sensing for in-line condition monitoring of IGBT wafer. IEEE Transactions on Industrial Electronics, 66(10), 8197–8204. https://doi.org/10.1109/TIE.2018.2886775
Li, N., & Becerik-Gerber, B. (2011). Performance-based evaluation of RFID-based indoor location sensing solutions for the built environment. Advanced Engineering Informatics, 25(3), 535–546. https://doi.org/10.1016/j.aei.2011.02.004
Lin, I. C., & Dzeng, R. J. (2019). Developing anti-counterfeiting and error-proof mechanisms and automatic storage with construction inspection photos system. Journal of the Chinese Institute of Civil and Hydraulic Engineering, 31(2), 173–182.
Lin, Y. C., Chang, J. X., & Su, Y. C. (2016). Developing construction defect management system using BIM technology in quality inspection. Journal of Civil Engineering and Management, 22(7), 903–914. https://doi.org/10.3846/13923730.2014.928362
Liu, Y. C., Chen, J. R., & Chen, H. M. (2020). System development of an augmented reality on-site BIM viewer based on the integration of SLAM and BLE indoor positioning. In Proceedings of the 2020 International Symposium on Automation and Robotics in Construction (pp. 293–300), Kitakyushu, Japan. https://doi.org/10.22260/ISARC2020/0042
Liu, R., Zhang, J., Chen, S., Yang, T., & Arth, C. (2021). Accurate real-time visual SLAM combining building models and GPS for mobile robot. Journal of Real-Time Image Processing, 18, 419–429. https://doi.org/10.1007/s11554-020-00989-6
Lee, C. W., Chondro, P., Ruan, S. J., Christen, O., & Naroska, E. (2018). Improving mobility for the visually impaired: A wearable indoor positioning system based on visual markers. IEEE Consumer Electronics Magazine, 7(3), 12–20. https://doi.org/10.1109/MCE.2018.2797741
Mohanty, L., Chae, S., & Yang, Y. (2020). Identifying productive working patterns at construction sites using BLE sensor networks. Developments in the Built Environment, 4, Article 100025. https://doi.org/10.1016/j.dibe.2020.100025
Ma, Z., Cai, S., Mao, N., Yang, Q., Feng, J., & Wang, P. (2018). Construction quality management based on a collaborative system using BIM and indoor positioning. Automation in Construction, 92, 35–45. https://doi.org/10.1016/j.autcon.2018.03.027
Mirshokraei, M., De Gaetani, C. I., & Migliaccio, F. (2019). A web-based BIM–AR quality management system for structural elements. Applied Sciences, 9(19), Article 3984. https://doi.org/10.3390/app9193984
Nguyen, P. T., Vo, K. D., Phan, P. T., Huynh, V. D. B., Nguyen, T. A., Cao, T. M., & Nguyen, Q. L. H. T. T. (2018). Construction project quality management using building information modeling 360 field. International Journal of Advanced Computer Science and Applications, 9(10), 228–233. https://doi.org/10.14569/IJACSA.2018.091028
Neges, M., Koch, C., König, M., & Abramovici, M. (2017). Combining visual natural markers and IMU for improved AR based indoor navigation. Advanced Engineering Informatics, 31, 18–31. https://doi.org/10.1016/j.aei.2015.10.005
Oufqir, Z., El Abderrahmani, A., & Satori, K. (2020). ARKit and ARCore in serve to augmented reality. In Proceedings of the 2020 International Conference on Intelligent Systems and Computer Vision (ISCV), Fez, Morocco. https://doi.org/10.1109/ISCV49265.2020.9204243
Omer, M., & Tian, G. Y. (2018). Indoor distance estimation for passive UHF RFID tag based on RSSI and RCS. Measurement, 127, 425–430. https://doi.org/10.1016/j.measurement.2018.05.116
OMG. (2011). Business process model and notation (BPMN) Version 2.0, Object management group specification. https://www.omg.org/spec/BPMN/2.0/
Pratheesh Kumar, M. R., Reji, S., Abeneth, S., & Pradeep, K. (2020). On-site proactive construction defect management using mixed reality integrated with 5D building information modeling. International Journal of Virtual and Augmented Reality (IJVAR), 4(1), 19–34. https://doi.org/10.4018/IJVAR.2020010102
Park, J., Cho, Y. K., & Martinez, D. (2016). A BIM and UWB integrated mobile robot navigation system for indoor position tracking applications. Journal of Construction Engineering and Project Management, 6(2), 30–39. https://doi.org/10.6106/JCEPM.2016.6.2.030
Ratajczak, J., Riedl, M., & Matt, D. T. (2019). BIM-based and AR application combined with location-based management system for the improvement of the construction performance. Buildings, 9(5), Article 118. https://doi.org/10.3390/buildings9050118
Rao, A. S., Radanovic, M., Liu, Y., Hu, S., Fang, Y., Khoshelham, K., Palaniswami, M., & Ngo, T. (2022). Real-time monitoring of construction sites: Sensors, methods, and applications. Automation in Construction, 136, Article 104099. https://doi.org/10.1016/j.autcon.2022.104099
Sydora, C., & Stroulia, E. (2018). Augmented reality on building information models. In Proceedings of the 9th International Conference on Information, Intelligence, Systems and Applications (IISA), Zakynthos, Greece. https://doi.org/10.1109/IISA.2018.8633637
Shewail, S., Badr, M., & Tolba, A. (2024). Real-time indoor tracking for augmented reality using computer vision techniques. International Journal of Advanced Computer Science and Applications, 15(2), 112–120. https://doi.org/10.11591/ijai.v13.i2.pp1845-1857
Sidani, A., Dinis, F. M., Duarte, J., Sanhudo, L., Calvetti, D., Baptista, J. S., Martins, J. P. & Soeiro, A. (2021). Recent tools and techniques of BIM-based augmented reality: A systematic review. Journal of Building Engineering, 42, Article 102500. https://doi.org/10.1016/j.jobe.2021.102500
Shi, Y., Du, J., & Ragan, E. (2020). Review visual attention and spatial memory in building inspection: Toward a cognition-driven information system. Advanced Engineering Informatics, 44, Article 101061. https://doi.org/10.1016/j.aei.2020.101061
Song, W., Lee, H., Lee, S. H., Choi, M. H., & Hong, M. (2018). Implementation of Android application for indoor positioning system with Estimote BLE beacons. Journal of Internet Technology, 19(3), 871–878.
Tan, Y., Xu, W., Chen, P., & Zhang, S. (2024). Building defect inspection and data management using computer vision, augmented reality, and BIM technology. Automation in Construction, 160, Article 105318. https://doi.org/10.1016/j.autcon.2024.105318
Tsai, Y. H., & Hsieh, S. H. (2016). Process modeling of a BIM-enabled construction inspection approach with BPMN. In Proceedings of the 2016 International Conference on Innovative Production and Construction (pp. 80–83), Perth, Australia.
Tsai, Y. H., Hsieh, S. H., & Kang, S. C. (2014). A BIM-enabled approach for construction inspection. In Proceedings of 2014 International Conference on Computing in Civil and Building Engineering (pp. 721–728), Orlando, Florida, USA. https://doi.org/10.1061/9780784413616.090
Thrun, S. (2007). Simultaneous localization and mapping. In M. E., Jefferies, & W. K. Yeap (Eds.), Robotics and cognitive approaches to spatial mapping: Vol 38. Springer tracts in advanced robotics (pp. 13–41). Springer. https://doi.org/10.1007/978-3-540-75388-9_3
Tseng, P. Y., Lin, J. J., Chan, Y. C., & Chen, A. Y. (2022). Real-time indoor localization with visual SLAM for in-building emergency response. Automation in Construction, 140, Article 104319. https://doi.org/10.1016/j.autcon.2022.104319
Umer, W., & Siddiqui, M. K. (2020). Use of ultra-wide band real-time location system on construction jobsites: feasibility study and deployment alternatives. International Journal of Environmental Research and Public Health, 17(7), Article 2219. https://doi.org/10.3390/ijerph17072219
Vasilyev, R. S., Losev, K. Y., Cheprasov, A. G., & Bektash, D. T. (2019). BIM and QR-codes interaction on a construction site. Journal of Physics: Conference Series, 1425(1), Article 012089. https://doi.org/10.1088/1742-6596/1425/1/012089
Wei, Z., Chen, J., Tang, H., & Zhang, H. (2023). RSSI-based location fingerprint method for RFID indoor positioning: A review. Nondestructive Testing and Evaluation, 39(1), 3–31. https://doi.org/10.1080/10589759.2023.2253493
Wu, H., Zhong, B., Li, H., Guo, J., & Wang, Y. (2021). On-site construction quality inspection using blockchain and smart contracts. Journal of Management in Engineering, 37(6), Article 04021065. https://doi.org/10.1061/(ASCE)ME.1943-5479.0000967
Walker, M. E., Hedayati, H., & Szafir, D. (2019). Robot teleoperation with augmented reality virtual surrogates. In Proceedings of the 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI) (pp. 201–210), Daegu, South Korea. https://doi.org/10.1109/HRI.2019.8673306
Zhao, X., & Cheah, C. C. (2023). BIM-based indoor mobile robot initialization for construction automation using object detection. Automation in Construction, 146, Article 104647. https://doi.org/10.1016/j.autcon.2022.104647
Zhang, S., He, Y., Gu, Y., He, Y., Wang, H., Wang, H., Yang, R., Chady, T., & Zhou, B. (2025). UAV based defect detection and fault diagnosis for static and rotating wind turbine blade: A review. Nondestructive Testing and Evaluation, 40(4), 1691–1729. https://doi.org/10.1080/10589759.2024.2395363
Zhuang, S. (2020). Real-time indoor location tracking in construction site using BLE beacon trilateration [Master’s thesis]. School of Science, Aalto University, Finland.
View article in other formats
CrossMark check
Published
Issue
Section
Copyright
Copyright (c) 2025 The Author(s). Published by Vilnius Gediminas Technical University.
License
This work is licensed under a Creative Commons Attribution 4.0 International License.