Improved Post-Disaster Building Assessment from UAV Inspection Images by Integrating Adaptive Patch Vision Transformer

Authors

  • Hsiao-ting Yeh Department of Computer Science and Information Engineering, National Central University, Taoyuan, 32031, China
  • Yi-wen Tseng Department of Computer Science and Information Engineering, National Central University, Taoyuan, 32031, China
  • Shu-chun Kuo College of Information Technology, Chien Hsin University of Science and Technology, Taoyuan, 32097, China

DOI:

https://doi.org/10.64972/jaat.2024v2.325p30e:413-426

Keywords:

Adaptive Patch Vision Transformer, UAV Remote Sensing, Building Damage Assessment, Disaster Response, Hierarchical Token Aggregation

Abstract

Unmanned aerial vehicle (UAV) inspection photos used for rapid post-disaster building evaluation must properly identify structural damage under various imaging settings. The long-distance spatial linkages between roofs, walls, trash, shadows, and nearby facilities are typically overlooked by the earlier convolutional techniques, despite their effectiveness in capturing local texture. While standard Vision Transformer models enhance global reasoning, they employ fixed patch partitioning, which might lead to the fragmentation of tiny damaged regions or the introduction of duplicate tokens from the background. creation of a damage-adaptive vision transformer model for building assessment using UAV images. The model creates adaptive patches with various spatial resolutions after first predicting the local visual complexity and damage likelihood. Roof-level, building-level, and block-level context will be combined via a three-tier Token aggregation module. The distinction between undamaged, moderately damaged, severely damaged, and collapsed structures is further improved by a disaster-aware classification head. Accuracy, macro-F1, recall of high-risk damage, computational cost, and cross-disaster resilience are the foundations of quantitative appraisal. The new framework is still appropriate for emergency UAV inspection scenarios and can accurately detect damage.

Downloads

Published

2024-09-13

How to Cite

Yeh, H.- ting, Tseng, Y.- wen, & Kuo, S.- chun. (2024). Improved Post-Disaster Building Assessment from UAV Inspection Images by Integrating Adaptive Patch Vision Transformer. Journal of Applied Automation Technologies, 2, 30e:413–426. https://doi.org/10.64972/jaat.2024v2.325p30e:413-426

Issue

Section

Articles