华南理工大学学报(自然科学版) ›› 2021, Vol. 49 ›› Issue (7): 76-85,124.doi: 10.12141/j.issn.1000-565X.200749

所属专题: 2021年计算机科学与技术

• 计算机科学与技术 • 上一篇    下一篇

基于图像修复的无监督表面缺陷检测方法

胡广华 王宁 何文亮 唐辉雄   

  1. 华南理工大学 机械与汽车工程学院,广东 广州 510640
  • 收稿日期:2020-12-07 修回日期:2021-02-15 出版日期:2021-07-25 发布日期:2021-07-01
  • 通信作者: 胡广华 ( 1980-) ,男,博士,副教授,主要从事机器视觉和图像处理研究。 E-mail:ghhu@scut.edu.cn
  • 作者简介:胡广华 ( 1980-) ,男,博士,副教授,主要从事机器视觉和图像处理研究。
  • 基金资助:
    国家自然科学基金青年科学基金资助项目 ( 51505155) ; 广东省自然科学基金资助项目 ( 2020A1515010698) ; 华南理工 大 学 中 央 高 校 基 本 科 研 业 务 费 专 项 资 金 资 助项目 ( 2019MS056 ) ; 广东省普通高校特色创新项目 ( 2020KTSCX007)

Unsupervised Surface Defect Detection Method Based on Image Inpainting

HU Guanghua WANG Ning HE Wenliang TANG Huixiong   

  1. School of Mechanical and Automotive Engineering,South China University of Technology,Guangzhou 510640,Guangdong,China
  • Received:2020-12-07 Revised:2021-02-15 Online:2021-07-25 Published:2021-07-01
  • Contact: 胡广华 ( 1980-) ,男,博士,副教授,主要从事机器视觉和图像处理研究。 E-mail:ghhu@scut.edu.cn
  • About author:胡广华 ( 1980-) ,男,博士,副教授,主要从事机器视觉和图像处理研究。
  • Supported by:
    Supported by the National Natural Science Foundation of China for Youth ( 51505155) and the Natural Science Foundation of Guangdong Province ( 2020A1515010698)

摘要: 对于非均匀、非周期性欠规则纹理表面缺陷的检测,由于背景纹理为非平稳信 号,常规的图像重建较为困难。同时,由于难以事先获取缺陷的形状、灰度等图像特征 信息,且同类缺陷的视觉特征可呈现较大的分散性,现有的依赖于目标特征的检测方法 难以适用。为此,文中提出了一种基于图像修复的无监督学习表面缺陷检测方法。该方 法需要先将少量正常纹理样本图像作为训练集,用于训练网络模型; 然后在检测时,人 为地在样本图像中设置缺失区域,并利用网络模型预测缺失区域的内容; 最后根据重建 图像与待测图像的结构相似性评价及残差实现缺陷检测与分离。实验结果表明,文中方 法不仅能够有效检测规则纹理表面的缺陷,而且能够检测欠规则纹理表面的缺陷,具有 较强的实用性和适应性。

关键词: 欠规则纹理, 缺陷检测, 图像修复, 无监督学习

Abstract: For the detection of non-uniform and non-periodic irregular texture surface defects,it is difficult to achieve conventional image reconstruction as the background texture is a non-stationary signal. It is also difficult to obtain sufficient information about the defects such as shape,gray scale and other image features in advance. And the visual features of similar defects can present great dispersion. The existing detection methods based on target features are inapplicable. Therefore,this paper proposed an unsupervised learning surface defect detection method based on image inpainting. Firstly,the method used a small number of normal texture samples as training set to train the network model. Then,the missing area was set artificially in the sample image and the network model was used to predict the content of the missing areas during the testing stage. By combining the structural similarity evaluation and residual error of the reconstructed image and the image to be tested,the defect detection and separation were realized. The experimental results show that the proposed method can not only effectively detect the defects on the regular texture surface but also detect the defects of irregular texture surfaces effectively,showing good practicability and adaptability.

Key words: irregular texture, defect detection, image inpainting, unsupervised learning

中图分类号: