Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (02): 143-150.doi: 10.13475/j.fzxb.20220804308

• Textile Engineering • Previous Articles     Next Articles

Fabric defect detection based on deep-belief network

LI Yang1, PENG Laihu1,2, LI Jianqiang2(), LIU Jianting1, ZHENG Qiuyang1, HU Xudong1   

  1. 1. Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
    2. Zhejiang Sci-Tech University Longgang Research Institute, Wenzhou, Zhejiang 325000, China
  • Received:2022-08-16 Revised:2022-11-22 Online:2023-02-15 Published:2023-03-07

Abstract:

Objective In order to improve the quality of textile products, increase economic benefits, and reduce production costs in order to improve production efficiency, it is of great significance to achieve intelligent detection of fabric defects. A fabric defect detection method based on deep-belief network (DBN) is proposed, and the deep-belief network is trained by the improved restricted Boltzmann machine model to complete the construction of model recognition parameters, which can not only independently extract fabric image data features, screen effective information for transmission, but also have a short training time and fast model convergence speed.
Method In order to make the best training effect of the model, this paper enriches the samples by using the data augmentation method to meet the training requirements of the DBN model. The homomorphic filtering method is used to preprocess the image to reduce the low frequency and increase the high frequency, and sharpen the details of the image edges, making the defective image clearer and suppressing the background image. In order to solve the overfitting problem of the model and improve the generalization ability of the model, the DBN-Dropout model is used to set the output information in the network to 0, the contrastive divergence method is employed to initialize the visual layer of the training sample, the activation probability of neurons in the hidden layer of the model is calculated, and the activation status of neurons in the hidden layer and the visual layer is assessed. In Python language, a DBN model is built based on the TensorFlow framework, and the learning samples are obtained by processing the fabric defect images. In the weft knitting laboratory of the Knitting Engineering Technology Research Center at Zhejiang Sci-Tech University, the area scan CCD camera was combined with the 6 mm focal length lens (FL-HC0614-2M) produced by Ricoh Corporation of Japan, and 200 images were collected of different types of plain weft knitted fabrics produced by the RFSM20 high-speed seamless underwear machine developed by Zhejiang Rifa Textile Machinery Co., Ltd., including 50 images of normal flawless fabrics and 150 images of fabrics with various defects. The collected fabric image samples were grayscale images with a size of 512 pixels×512 pixels, and the 100 fabric images collected were detected by the DBN model.
Results Cross-entropy and Adam were used as loss functions and optimizers respectively, the activation function, loss function and optimizer of the model were studied with the fabric defect dataset, and then the activation function, Dropout value, learning rate and training batch number of the model were analyzed with the fabric defect dataset. The activation function was a Relu function, whose Dropout value was 0.3, pre-training learning rate was 0.1, fine-tuning learning rate was 0.000 1, and batch training number was 64, model and the parameter values were optimal. 512 pixel×512 pixel fabric images were used to conduct experiments in MatLab2019b environment, and the results of the experiments on the TILDA dataset using particle swarm optimization(PSO)-BP neural network and local contrast deviation method were compared with the algorithm proposed in this paper, and it is concluded that the proposed deep-belief network has better detection results and clearer target contour recognition for fabric defect detection under complex background than the other two methods. In order to evaluate the applicability of this algorithm, defect images weft knitted fabrics with different types of defects were used for detection. For the practical testing of 100 pictures, the experimental results were combined with the detection effect chart, which showed that the algorithm introduced in this paper has good detection results for fabric holes, oil pollution and yarn breaking defects, and its detection accuracy rate reaches 98%, which verifies the algorithm's adaptability, effectiveness and accuracy for fabric defect detection.
Conclusion The experimental results show that the DBN network model has a good detection effect on fabric defects, which can not only identify the shape and outline of fabric defects, but also detect different types of fabric defects, which shows the effectiveness of the algorithm.

Key words: fabric defect detection, deep learning, deep-belief network, restricted Boltzmann machine, image processing

CLC Number: 

  • TS181.9

Fig.1

Fabric defect detection process"

Fig.2

Comparison of images before and after preprocessing. (a) Original image; (b) Homomorphically filtered image"

Fig.3

Fabric defect date training result. (a)Activation function is Sigmoid;(b)Activation function is Relu"

Fig.4

Effect of pre-training learning rate on model loss values"

Fig.5

Effect of fine-tuning learning rate on model loss value"

Fig.6

Effect of batch training numbers on accuracy"

Fig.7

Detection results of different algorithms. (a) Hole; (b) Yarn breaking; (c) Creases"

Fig.8

Test results for defects in different types of fabrics. (a) Hole;(b) Oil pollution;(c) Yarn breaking"

Tab.1

Defect detection statistical results"

疵点
类型
检测数量/张 检测结果 综合检
测率/%
未检测出 检测出 准确率/% 虚警率/%
破洞 1 49 96.6 2.0 98
油污 2 48 96.0 4.0
断纱 1 49 96.6 2.0
不含疵点 0 50 100.0 0.0
[1] KAZM H B, TALU M F, ÖMER Faruk Ö. Fabric defect detection systems and methods:a systematic literature review[J]. Optik-International Journal for Light and Electron Optics, 2016, 127(24): 11960-11973.
doi: 10.1016/j.ijleo.2016.09.110
[2] 尉苗苗. 织物疵点检测算法研究和系统实现[D]. 无锡: 江南大学, 2017:1-2.
WEI Miaomiao. Research and system implementation of fabric defect detection algorithm[D]. Wuxi: Jiangnan University, 2017:1-2.
[3] 张星烨. 织物疵点自动检测系统关键技术的研究[D]. 无锡: 江南大学, 2012:2-4.
ZHANG Xingye. Research on key technologies of fabric defect spot automatic detection system[D]. Wuxi: Jiangnan University, 2012:2-4.
[4] CHAN C H, PANG G K H. Fabric defect detection by Fourier analysis[J]. IEEE Transactions on Industry Applications, 2000, 36 (5):1267-1276.
doi: 10.1109/28.871274
[5] 温智婕. 图像纹理特征表示方法研究与应用[D]. 大连: 大连理工大学, 2008:25-27.
WEN Zhijie. Research and application of image texture feature representation method[D]. Dalian: Dalian University of Technology, 2008:25-27.
[6] GONG C, TAO D, LIU W, et al. Saliency propagation from simple to difficult[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). Boston: IEEE, 2015: 44-57.
[7] 宫辰. 数据驱动的图推断算法研究[D]. 上海: 上海交通大学, 2017:111-119.
GONG Chen. Research on data-driven graph inference algorithm[D]. Shanghai: Shanghai Jiao Tong University, 2017:111-119.
[8] 沈咏军, 朱桂英. 基于人工神经网络的织物疵点检测[J]. 丝绸, 2007, 44(6):38-41.
SHEN Yongjun, ZHU Guiying. Fabric defect detection based on artificial neural network[J]. Journal of Silk, 2007, 44(6):38-41.
[9] LIU S, LIU J, ZHANG L. Classification of fabric defect based on PSO-BP neural network[C]// International Conference on Genetic & Evolutionary Computing. Jinzhou: IEEE, 2008:137-140.
[10] 王春静, 许圣梅. 基于内容的图像检索的相似度测量方法[J]. 数据采集与处理, 2017(1):104-110.
WANG Chunjing, XU Shengmei. Similarity measurement method based on content-based image retrieval[J]. Data Acquisition and Processing, 2017 (1):104-110.
[11] LI P F, ZHANG H H, JING J F, et al. Fabric defect detection based on local entropy[J]. Advanced Materials Research, 2012, 562-564:1998-2001.
[12] LIU Z, YAN L, LI C, et al. Fabric defect detection based on sparse representation of main local binary pattern[J]. International Journal of Clothing Science and Technology, 2017, 29(3):282-293.
doi: 10.1108/IJCST-04-2016-0040
[13] WANG Y, XU X, YUE N, et al. Edge-preserving background estimation using most similar neighbor patch for small target detection[C]// CCF Chinese Conference on Computer Vision. Singapore: Springer, 2017:84-95.
[14] 杜磊, 李立轻, 汪军, 等. 几种基于图像自适应阈值分割的织物疵点检测方法比较[J]. 纺织学报, 2014, 35(6): 56-61.
DU Lei, LI Liqing, WANG Jun, et al. Comparison of several fabric defect detection methods based on image adaptive threshold segmentation[J]. Journal of Textile Research, 2014, 35(6):56-61.
[15] 刘方园, 王水花, 张煜东. 深度置信网络模型及应用研究综述[J]. 计算机工程与应用, 2018, 54 (1): 11-18,47.
doi: 10.3778/j.issn.1002-8331.1711-0028
LIU Fangyuan, WANG Shuihua, ZHANG Yudong. A review of deep confidence network models and their applications[J]. Computer Engineering and Applications, 2018, 54(1): 11-18,47.
doi: 10.3778/j.issn.1002-8331.1711-0028
[16] HINTON G E. Training products of experts by minimizing cont-rastive divergence[J]. Neural Computation, 2002, 14(8) : 1771-1800.
doi: 10.1162/089976602760128018
[1] CHEN Jia, YANG Congcong, LIU Junping, HE Ruhan, LIANG Jinxing. Cross-domain generation for transferring hand-drawn sketches to garment images [J]. Journal of Textile Research, 2023, 44(01): 171-178.
[2] WANG Bin, LI Min, LEI Chenglin, HE Ruhan. Research progress in fabric defect detection based on deep learning [J]. Journal of Textile Research, 2023, 44(01): 219-227.
[3] AN Yijin, XUE Wenliang, DING Yi, ZHANG Shunlian. Evaluation of textile color rubbing fastness based on image processing [J]. Journal of Textile Research, 2022, 43(12): 131-137.
[4] ZHANG Dongjian, GAN Xuehui, YANG Chongchang, HAN Fuyi, LIU Xiangyu, TAN Yuan, LIAO He, WANG Songlin. Research progress in non-contact fiber tension detection technology in spinning process [J]. Journal of Textile Research, 2022, 43(11): 188-194.
[5] ZHENG Zhaolun, LU Yujun. Dual-algorithm for fabric defect detection based on singular value decomposition [J]. Journal of Textile Research, 2022, 43(11): 59-67.
[6] CHEN Jinguang, LI Xue, SHAO Jingfeng, MA Lili. Lightweight clothing detection method based on an improved YOLOv5 network [J]. Journal of Textile Research, 2022, 43(10): 155-160.
[7] YUAN Yanhong, ZENG Hongming, MAO Muquan. Needle selector detection system based on image processing [J]. Journal of Textile Research, 2022, 43(10): 176-182.
[8] DENG Zhongmin, HU Haodong, YU Dongyang, WANG Wen, KE Wei. Density detection method of weft knitted fabrics making use of combined image frequency domain and spatial domain [J]. Journal of Textile Research, 2022, 43(08): 67-73.
[9] MA Yunjiao, WANG Lei, PAN Ruru, GAO Weidong. Calibration method of three-dimensional yarn evenness based on mirrored image [J]. Journal of Textile Research, 2022, 43(07): 55-59.
[10] ZHOU Qihong, PENG Yi, CEN Junhao, ZHOU Shenhua, LI Shujia. Yarn breakage location for yarn joining robot based on machine vision [J]. Journal of Textile Research, 2022, 43(05): 163-169.
[11] ZHANG Ronggen, FENG Pei, LIU Dashuang, ZHANG Junping, YANG Chongchang. Research on on-line detection system of broken filaments in industrial polyester filament [J]. Journal of Textile Research, 2022, 43(04): 153-159.
[12] XIONG Jingjing, YANG Xue, SU Jing, WANG Hongbo. Testing method for fabric moisture conductivity based on image technology [J]. Journal of Textile Research, 2021, 42(12): 70-75.
[13] JIANG Hui, MA Biao. Style similarity algorithm based on clothing style [J]. Journal of Textile Research, 2021, 42(11): 129-136.
[14] LÜ Wentao, LIN Qiqi, ZHONG Jiaying, WANG Chengqun, XU Weiqiang. Research progress of image processing technology for fabric defect detection [J]. Journal of Textile Research, 2021, 42(11): 197-206.
[15] YANG Zhengyan, XUE Wenliang, ZHANG Chuanxiong, DING Yi, MA Yanxue. Recommendations for user's bottoms matching based on generative adversarial networks [J]. Journal of Textile Research, 2021, 42(07): 164-168.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
[1] . [J]. JOURNAL OF TEXTILE RESEARCH, 2003, 24(06): 35 -36 .
[2] . [J]. JOURNAL OF TEXTILE RESEARCH, 2004, 25(01): 1 -9 .
[3] . [J]. JOURNAL OF TEXTILE RESEARCH, 2004, 25(02): 108 -110 .
[4] PAN Xu-wei;GU Xin-jian;HAN Yong-sheng;CHENG Yao-dong. Research on quick response of apparel supply chain for collaboration[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(1): 54 -57 .
[5] GU Da-qiang;NIE Lin. Reinforcement fabric knitting machine for plastic pressure hose[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(1): 86 -88 .
[6] ZHONG Zhi-li;WANG Xun-gai. Application prospect of nanofibers[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(1): 107 -110 .
[7] LUO Jun;FEI Wan-chun. Distribution of the filament number of each cocoon layer in raw silk threads[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(2): 1 -4 .
[8] MA Xiao-guang;CUI Gui-xin;DONG Shao-wei . Study of gel form intelligent cotton knitgoods with polymer grafting initiated by microwave plasma[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(2): 13 -16 .
[9] BAO Xiao-min;WANG Ya-ming. Image segmentation based on the minimum risk Bayes decision[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(2): 33 -36 .
[10] WANG Xin-feng;LUO Xin;WANG Xiao-dong;WU Hui-li. Heat-melt adhesion and mechanical properties of modified thermoplastic polyurethane[J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(2): 58 -60 .