Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (07): 86-94.doi: 10.13475/j.fzxb.20220406301

• Textile Engineering • Previous Articles     Next Articles

Defect detection of jacquard knitted fabrics based on nonlinear diffusion and multi-feature fusion

SHI Weimin1, JIAN Qiang1, LI Jianqiang2(), RU Xin1, PENG Laihu1,2   

  1. 1. Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
    2. Research Institute of Zhejiang Sci-Tech University in Longgang,Wenzhou, Zhejiang 325802, China
  • Received:2022-04-19 Revised:2022-10-21 Online:2023-07-15 Published:2023-08-10

Abstract:

Objective Supervision and inspection are important parts in quality control of the knitted fabric production process. The defect detection by automation and machine vision technology can effectively improve the detection efficiency. Jacquard knitted fabrics have prominent yarn edges, obvious loop characteristics and patterns, which have a strong interference to the defect detection process. Therefore, it is necessary to design an effective and accurate pretreatment and defect detection method for the complex texture of jacquard knitted fabrics.

Method Improved PM (perona-malik)model was adopted to suppress the strong texture edge of jacquard knitted fabric. Firstly, the image was divided into texture and defect region by gradient difference before selecting the corresponding diffusion equation. The gradient threshold was determined according to the probability subset calculated by the gradient matrix and the relevant criteria to achieve regional diffusion. According to the texture distribution characteristics, the improved local binary pattern(LBP), entropy and correlation were extracted, and then the defect regions were further highlighted by neighborhood normalization and multi-feature fusion. Finally, the defect morphology was located and segmented by region growth method.

Results The effectiveness of the preprocessing method and the defect detection method for texture suppression was experimental investigated and analyzed, and defect information extraction of jacquard knitted fabric was demonstrated exhaustively. In addition, several different preprocessing algorithms and defect detection algorithms were compared and demonstrated. Comparison of defect image before and after preprocessing showed that the gray fluctuation amplitude of the image after preprocessing was smaller and the texture distribution was more concentrated. It was seen from the pretreatment experimental images and from the comparison effect with other preprocessing algorithms that the abrupt change of the texture edge area was still obvious, and the yarn spacing area of the fabric was still obvious in the visual effect. However, the proposed preprocessing algorithm effectively suppressed the strong texture edges and yarn spacing of patterns, and the intensity of texture edge filtering was greater. At the same time, in order to prove the robustness of the preprocessing effect more intuitively, the background suppression factor BSF, structure similarity SSIM and signal-to-noise ratio gain ISNR were used for index evaluation (Tab. 1). From characteristic reconstruction diagrams and normalized characteristic diagrams, the texture features selected in this paper effectively described the gray difference and gray distribution difference between defects and textures. In addition, the normalization of the row mean value without neighborhood effectively weakened the eigenvalue of the texture region and increased the difference between the texture and the defect. The effect of different defect detection algorithms on the defect image of jacquard knitted fabric was showed that, the algorithm in docoment [3] may misjudge the fabrics with single pattern or similar patterns, while the fabrics with multiple patterns may be interfered by complex patterns, resulting in false detection. The algorithm adopted in docoment[4] was not able to rule out that the interference of yarn coil spacing, which lead to missed inspection and false inspection. The algorithm in this paper achieved the localization of the defect area and extracts a relatively complete defect shape contour. The comparison results of the detection accuracy of each detection algorithm for 100 experimental images were obtained (Tab. 2). The false detection rate of the algorithm was 3.3% for normal fabric images and 98.6% for defective fabric images, further illustrating the effectiveness of the algorithm.

Conclusion Aiming at the complex texture of jacquard knitted fabric, this paper proposed a defect detection algorithm based on nonlinear diffusion and multi-feature fusion. The improved nonlinear diffusion model was used as the pretreatment means, and the single diffusion mode of the conventional PM model was improved to the regional diffusion by selecting the best diffusion equation and gradient threshold. At the same time, multi-feature extraction and fusion were used as detection means to further highlight the defect area by using without neighborhood normalization and weighted fusion methods, and finally the defect shape was segmented by using region growth method. The experimental results show that the improved PM model effectively weakens the complex texture of jacquard knitted fabric and eliminates the interference caused by texture. Feature extraction method and normalization method increase the difference between texture and defect, and further highlight the defect. Compared with other detection methods, the detection accuracy of this paper is higher for jacquard knitted fabric defect image, and the defect region segmentation is more perfect and accurate.

Key words: jacquard knitted fabric, PM model, diffusion equation, gradient threshold, improved local binary pattern, removed neighborhood normalization, multi-feature fusion

CLC Number: 

  • TS181.9

Fig. 1

Fabric defect detection process"

Fig. 2

Comparison of defect image before (a) and after (b) preprocessing"

Fig. 3

Characteristic diagrams before normalization. (a) Fabric gray images; (b)Local correlation;(c)Local entropy;(d)Improved LBP"

Fig. 4

Characteristic reconstruction diagrams and normalized characteristic diagrams. (a) Characteristic reconstruction diagrams; (b) Local correlation; (c) Local entropy; (d) Improved LBP"

Fig. 5

Schematic diagram of defect location and segmentation"

Tab. 1

Experimental results indexes of three algorithms"

算法 第①组疵点图像 第②组疵点图像 第③组疵点图像 第④组疵点图像
BSF SSIM ISNR BSF SSIM ISNR BSF SSIM ISNR BSF SSIM ISNR
文献[19] 1.41 0.49 1.13 1.62 0.59 1.27 1.56 0.46 1.37 1.80 0.26 2.79
文献20] 1.85 0.41 1.25 1.81 0.32 1.29 2.48 0.36 1.26 2.03 0.52 2.69
本文算法 2.23 0.19 1.40 1.98 0.28 1.55 3.00 0.16 1.48 2.15 0.21 2.97

Fig. 6

Pretreatment experimental images. (a)Fabric gray images;(b)Document [19] algorithm;(c)Document [20] algorithm;(d)Proposed preprocessing algorithm"

Fig. 7

Images of defect detection experiment. (a)Fabric gray images; (b)Detection results of document [3]; (c)Detection results of document [4];(d)Detection results of proposed algorithm"

Tab. 2

Comparison of detection accuracy of each algorithm for experimental images"

检测
方法
含疵点图像 不含疵点图像 综合
准确率/
%
正确
数目
错误
数目
准确
率/%
正确
数目
错误
数目
误检
率/%
文献[3] 32 38 45.7 16 14 46.7 48
文献[4] 36 34 51.4 25 5 16.7 61
文献[19]预处理+本文后续算法 53 17 75.7 12 18 60.0 65
文献[20]预处理+本文后续算法 51 19 72.9 10 20 66.7 61
本文算法 69 1 98.6 29 1 3.3 98
[1] SELVI S S T, NASIRA G M. An effective automatic fabric defect detection system using digital image processing[J]. J Environ Nanotechnol, 2017, 6(1): 79-85.
doi: 10.13074/jent
[2] NILESH T D, TANUJA K S. Fabric defect detection adopting combined GLCM, Gabor wavelet features and random decision forest[J]. 3D Research, 2019, 10(1): 1-13.
doi: 10.1007/s13319-018-0210-y
[3] CAO J J, ZHANG J, WEN Z, et al. Fabric defect inspection using prior knowledge guided least squares regression[J]. Multimedia Tools & Applications, 2017, 76(3): 4141-4157.
[4] TAJERIPOUR F, KABIR E, SHEIKHI A. Defect detection in patterned fabrics using modified local binary patterns[C]// International Conference on Conference on Computational Intelligence & Multimedia Applications. Sivakasi: IEEE, 2008: 261-267.
[5] BODNAROVA A, BENNAMOUN M, LATHAM S. Optimal Gabor filters for textile flaw detection[J]. Pattern Recognition, 2002(35): 2973-2991.
[6] 尉苗苗, 李岳阳, 蒋高明, 等. 应用最优Gabor滤波器的经编织物疵点检测[J]. 纺织学报, 2016, 37(11):48-54.
YU Miaomiao, LI Yueyang, JIANG Gaoming, et al. Warp knit fabric defect detection method based on optimal Gabor filter[J]. Journal of Textile Research, 2016, 37(11):48-54.
[7] JING Junfeng, ZHANG Huanhuan, WANG Jing, et al. Fabric defect detection using Gabor filters and defect classification based on LBP and Tamura method[J]. Journal of The Textile Institute, 2013, 104(1): 18-27.
doi: 10.1080/00405000.2012.692940
[8] 赵志勇. 基于深度学习的布匹缺陷识别与检测研究[D]. 武汉: 华中科技大学, 2019: 69.
ZHAO Zhiyong. Research on recognition and detection of textile defects based on deep learning[D]. Wuhan: Huazhong University of Science & Technology, 2019: 69.
[9] 王理顺, 钟勇. 基于深度学习的织物缺陷在线检测算法[J]. 计算机应用, 2019, 39(7): 2125-2128.
doi: 10.11772/j.issn.1001-9081.2019010110
WANG Lishun, ZHONG Yong. On-line fabric defect recognition algorithm based on deep learning[J]. Journal of Computer Applications, 2019, 39(7): 2125-2128.
doi: 10.11772/j.issn.1001-9081.2019010110
[10] HU Guanghua, HUANG Junfeng, WANG Qinghui, et al. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network[J]. Textile Research Journal, 2019, 90(3/4): 247-270.
doi: 10.1177/0040517519862880
[11] PERONA P, MALIK J. Scale-space and edge detection using anisotropic diffusion[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1990, 12(7): 29-39.
[12] 宋新, 杨明琴, 张莉. 基于PM模型扩散系数改进的加速算法[J]. 网络安全技术与应用, 2016(4): 52-54.
SONG Xin, YANG Mingqin, ZHANG Li. Improved acceleration algorithm based on diffusion coefficient of PM model[J]. Network Security Technology & Application, 2016(4): 52-54.
[13] 蒋成龙, 赵曜, 张柘. 基于相关准则的稀疏微波成像方位向采样优化方法[J]. 电子与信息学报, 2015, 37(3): 580-586.
JIANG Chenglong, ZHAO Zhuo, ZHANG Tuo. Azimuth sampling optimization method for sparse microwave imaging based on correlation criterion[J]. Journal of Electronics & Information Technology, 2015, 37(3): 580-586.
[14] OJALA T, PIETIKAINEN M, MAENPAA T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 971-987.
doi: 10.1109/TPAMI.2002.1017623
[15] OJALA T, PIETIKAINEN M, HARWOOD D. A comparative study of texture measures with classification based on featured distributions[J]. Pattern Recognition, 1996, 29(1): 51-59.
doi: 10.1016/0031-3203(95)00067-4
[16] 吴哲, 刘孝星, 郑力新, 等. 基于灰度共生矩阵特征图像的织物疵点检测方法[J]. 网络安全与数据治理, 2015, 34(21): 47-50.
WU Zhe, LIU Xiaoxing, ZHENG Lixin, et al. A fabric defect detection method based on gray level co-ocurrence matrix feature image[J]. Cyber security and Data Governance, 2015, 34 (21): 47-50.
[17] 李凡. 复杂背景抑制及弱小目标检测算法研究[D]. 西安: 西安电子科技大学, 2010: 26-28.
LI Fan. A study of algorithms for complex background suppression and small target detection[D]. Xi'an: Xidian University, 2010: 26-28.
[18] 史小雨. 基于结构相似度的遥感图像质量评价[D]. 西安: 西安科技大学, 2017: 21-25.
SHI Xiaoyu. Quality assessment of remote sensing image based on structural similarity[D]. Xi'an: Xi'an University of Science and Technology, 2017: 21-25.
[19] FENG Xiangfei, GUO Xiaoyu, HUANG Qinghua. Systematic evaluation on speckle suppression methods in examination of ultrasound breast images[J]. Applied Sciences, 2017.DOI:10.3390/app7010037.
doi: 10.3390/app7010037
[20] MATHIYALAGAN P, SUVITHA N. Image fusion using convolutional neural network with bilateral filtering[C]// International Conference on Computing, Communication and Networking Technologies. Bengaluru: IEEE, 2018: 1-11.
[1] XING Wenyu, DENG Na, XIN Binjie, YU Chen. Identification of wool and cashmere based on multi-feature fusion image analysis technology [J]. Journal of Textile Research, 2019, 40(03): 146-152.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!