Journal of South China University of Technology(Natural Science Edition) ›› 2024, Vol. 52 ›› Issue (10): 146-158.doi: 10.12141/j.issn.1000-565X.230350

• Image Processing • Previous Articles    

Virtual Generation Method of Transportation Infrastructure Crack Images

JIANG Shengchuan1  ZHONG Shan 2  WU Difei2   LIU Chenglong2   

  1. 1. Department of Traffic Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China;

    2. Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, 201804, Shanghai

  • Online:2024-10-25 Published:2024-01-26
  • Contact: 钟山(2000—),男,博士生,主要从事基础设施智能检测与损伤机理研究。 E-mail:zhongshanbetter@tongji.edu.cn
  • About author:蒋盛川(1987—),女,博士,副教授,主要从事交通基础设施智慧运维管理研究。E-mail:jsc@usst.edu.cn

Abstract:

The crack detection model for transportation infrastructure based on deep learning relies on large-scale data for training. To address the problem of limited availability of diverse crack samples in specific transportation facility scenarios, this paper proposes a transportation infrastructure crack image generation method based on Pix2pixHD. Firstly, the Pix2pixHD model is used to establish a spatial mapping relationship between real crack images and annotated labels based on a small amount of collected crack image data. Secondly, the objects in the label domain are edited to generate crack contours representing various forms, using methods such as label transfer from other datasets, manual editing, morphological dilation operations, and random superimposition operations. Finally, the edited label domain is transformed back to the image domain using the Pix2pixHD model, achieving adaptive augmentation of the transportation infrastructure crack dataset. Experimental results on the GAPS384, Tunnel200, and DeepCrack datasets demonstrate that the U-Net model trained with augmented data achieves higher detection accuracy and is more likely to avoid local optima. Compared to the DCGAN method, this approach exhibits better visual effects and FID quantification metric, thereby improving the generalization capability of the crack detection model in specific transportation infrastructure scenarios.

Key words: civil engineering, transportation infrastructure, image generation, crack detection, generative adversarial network

CLC Number: