Journal of Textile Research ›› 2024, Vol. 45 ›› Issue (04): 96-104.doi: 10.13475/j.fzxb.20230201001

• Textile Engineering • Previous Articles     Next Articles

Fabric defects detection algorithm based on multi-scale Laws texture energy and low-rank decomposition

WANG Zhenhua1, ZHANG Zhouqiang1,2(), ZAN Jie1, LIU Jianghao1   

  1. 1. School of Mechanical and Electrical Engineering, Xi'an Polytechnic University, Xi'an, Shaanxi 710600, China
    2. Shaanxi Key Laboratory of Functional Garment Fabrics, Xi'an Polytechnic University, Xi'an, Shaanxi 710600, China
  • Received:2023-02-06 Revised:2023-09-04 Online:2024-04-15 Published:2024-05-13

Abstract:

Objective In order to improve the universality and accuracy of fabric defects detection algorithm for simple textured fabric, pattern textured fabric and stripe textured fabric. A fabric defects detection algorithm based on multiscale Laws of texture energy and low-rank decomposition was proposed.

Method Firstly, the fabric image is equalized by histogram, and the image is evenly divided into sub-image blocks. Secondly, 28 texture energy features were extracted from each sub-image block (7 Laws filter templates were used to extract the features on 4 scales), and the mean values of all sub-image blocks were calculated, and the feature matrix was formed. Then, the low-rank decomposition model is constructed by the feature matrix, and the low-rank and spare parts are obtained by the direction alternation method (ADM). Finally, the defect saliency maps are generated from the sparse part, which is segmented by iterative threshold segmentation method, and the fabric defect detection results are obtained.

Results To validate the effectiveness of the proposed algorithm, the ZJU-Leaper colored fabric dataset is used for experiments. Three images, including simple textured fabric, patterned textured fabric, and striped textured fabric, were selected for the experiment, including common defects such as wrong weft, broken warp, flaking and holes. The image size is 512 pixels × 512 pixels. First, the key elements of the algorithm are analyzed. In the feature extraction section, the saliency maps generated with different numbers of Laws filter templates are compared. In the low-rank decomposition part, the saliency maps generated by choosing different balance factors are compared. The experimental results show that 28 Laws filter templates have the best detection effect, and the fabric defect saliency maps is the best when λ values of simple texture, pattern texture and stripe texture fabric are 0.02, 0.12 and 0.05, respectively. Secondly, the defect saliency maps generated by the proposed algorithm in this paper is compared with Gabor combined with low-rank decomposition algorithm (the following content is expressed in Gabor+LR), HOG combined with low-rank decomposition algorithm (the following content is expressed in HOG+LR), and Gabor combined with HOG combined with low-rank decomposition algorithm to generate saliency maps (the following content is expressed in GHOG+LR). Experimental results show that: in the detection of simple texture fabrics, impurities exist in the detection results of Gabor+LR algorithm and HOG+LR algorithm, and the results of GHOG+LR algorithm and the results of the algorithm in this paper are satisfactory. In the detection of pattern-texturing fabrics, the results of the proposed algorithm in this paper are ideal. However, error detection occurs in the detection results of Gabor+ LR algorithm and HOG+LR algorithm, and a small number of impurities also occur in the detection results of GHOG+LR algorithm. In the detection of striped texture fabrics, the results of the proposed algorithm in this paper also are relatively ideal. A small number of impurities appears in the detection results of the GHOG+LR algorithm, while the Gabor+LR algorithm will have error detection when the fabric image does not have obvious defects, and a large number of impurities still appear in the detection of the HOG+LR algorithm. Finally, the timeliness analysis of the algorithm is carried out, and the results show that the detection speed of the proposed algorithm has certain advantages.

Conclusion In this paper, we propose a fabric defect detection algorithm based on multiscale Laws texture energy and low-rank decomposition. In the feature extraction part, 28 Laws texture energy features are extracted based on four image scales to generate the feature matrix. In the low-rank decomposition part, the low-rank decomposition model is established, and the direction alternation method (ADM) is used to optimize it to get the low-rank and sparse parts of the feature matrix. Experimental results show that the proposed algorithm performs better than other algorithms in detecting simple textured fabrics, patterned textured fabrics, and striped textured fabrics, with some advantages in detection speed. Therefore, the proposed algorithm has better generality, accuracy and detection efficiency.

Key words: fabric defect, defect detection, Laws texture, texture energy, feature extraction, matrix low-rank decomposition

CLC Number: 

  • TS101

Fig.1

Algorithm detection procedure"

Fig.2

Characteristic matrix generation process"

Fig.3

ADM solution flow chart"

Fig.4

Fabric type. (a) Simple textured fabric; (b) Pattern textured fabric;(c) Striped textured fabric"

Fig.5

Comparison of defect saliency maps with different number of filter templates. (a) Initial image; (b) 7 filter templates saliency maps; (c)14 filter templates saliency maps; (d) 21 filter templates saliency maps; (e) 28 filter templates saliency maps; (f) 28 filter templates segmentation maps"

Fig.6

Comparison of defect saliency maps with different balance factor λ.(a) Initial image;(b) λ= 0.02; (c) λ= 0.05; (d) λ= 0.08; (e) λ= 0.12; (f) λ= 0.18"

Fig.7

Comparison of defect saliency maps of simple textured fabrics under different methods. (a) Initial image;(b) Gabor+LR algorithm defect saliency maps; (c) HOG+LR algorithm defect saliency maps; (d) GHOG+LR algorithm defect saliency maps; (e) Proposed algorithm defect saliency maps; (f) Proposed algorithm defect segmentation maps"

Fig.8

Comparison of defect saliency maps of pattern textured fabrics under different methods. (a) Initial image;(b) Gabor+LR algorithm defect saliency maps; (c) HOG+LR algorithm defect saliency maps; (d) GHOG+LR algorithm defect saliency maps; (e) Proposed algorithm defect saliency maps; (f) Proposed algorithm defect segmentation maps"

Fig.9

Comparison of defect saliency maps of striped fabric under different methods. (a) Initial image;(b) Gabor+LR algorithm defect saliency maps; (c) HOG+LR algorithm defect saliency maps; (d) GHOG+LR algorithm defect saliency maps; (e) Proposed algorithm defect saliency maps; (f) Proposed algorithm defect segmentation maps"

Tab.1

Comparison of average detection time of algorithms"

算法 平均检测时间/s
Gabor+LR 0.824
HOG+LR 0.433
GHOG+LR 0.524
本文算法 0.321

Fig.10

Detects speed comparison"

[1] LI C, LI J, LI Y, et al. Fabric defect detection in textile manufacturing: a survey of the state of the art[J]. Security and Communication Networks, 2021, 2021: 1-13.
[2] 吕文涛, 林琪琪, 钟佳莹, 等. 面向织物疵点检测的图像处理技术研究进展[J]. 纺织学报, 2021, 42(11): 197-206.
doi: 10.13475/j.fzxb.20200702710
LÜ Wentao, LIN Qiqi, ZHONG Jiaying, et al. Research progress of image processing technology for fabric defect detection[J]. Journal of Textile Research, 2021, 42(11): 197-206.
doi: 10.13475/j.fzxb.20200702710
[3] SHI B, LIANG J, DI L, et al. Fabric defect detection via low-rank decomposition with gradient information and structured graph algorithm[J]. Information Sciences, 2021, 546: 608-626.
[4] LI C, GAO G, LIU Z, et al. Defect detection for patterned fabric images based on GHOG and low-rank decomposition[J]. IEEE Access, 2019, 7: 83962-83973.
[5] 景军锋, 李江南, 李鹏飞. 改进型奇异值分解在织物疵点检测上的应用[J]. 纺织学报, 2014, 35(6): 62-67.
JING Junfeng, LI Jiangnan, LI Pengfei. Research on detection of defects in fabrics using improved singular value decomposition[J]. Journal of Textile Research, 2014, 35(6):62-67.
[6] YUAN X, YANG J. Sparse and low-rank matrix decomposition via alternating direction methods[J]. Pacific Journal of Optimization, 2009, 12(2):1-16.
[7] PEREZ A, GONZALEZ R C. An iterative thresholding algorithm for image segmentation[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1987 (6): 742-751.
pmid: 21869436
[8] PIZER S M, AMBURN E P, AUSTIN J D, et al. Adaptive histogram equalization and its variations[J]. Computer Vision, Graphics, and Image Processing, 1987, 39(3): 355-368.
[9] OJALA T, PIETIKäINEN M, HARWOOD D. A comparative study of texture measures with classification based on featured distributions[J]. Pattern Recognition, 1996, 29(1): 51-59.
[10] GANASALA P, PRASAD A D. Medical image fusion based on laws of texture energy measures in stationary wavelet transform domain[J]. International Journal of Imaging Systems and Technology, 2020, 30(3): 544-557.
[11] ZHANG C, FENG S, WANG X, et al. ZJU-Leaper: a benchmark dataset for fabric defect detection and a comparative study[J]. IEEE Transactions on Artificial Intelligence, 2020, 1(3):219-232.
[12] 李春雷, 王珺璞, 刘洲峰, 等. 基于对偶范数低秩分解的织物疵点检测方法[J]. 棉纺织技术, 2019, 47(1):5-10.
LI Chunlei, WANG Junpu, LIU Zhoufeng, et al. Fabric defect detection method based on dual norm low-rank decomposition[J]. Cotton Textile Technology, 2019, 47(1):5-10.
[13] 李春雷, 高广帅, 刘洲峰, 等. 应用方向梯度直方图和低秩分解的织物疵点检测算法[J]. 纺织学报, 2017, 38(3): 149-154.
LI Chunlei, GAO Guangshuai, LIU Zhoufeng, et al. Fabric defect detection algorithm based on histogram of oriented gradient and low-rank decomposition[J]. Journal of Textile Research, 2017, 38(3): 149-154.
[1] REN Jie, ZHANG Jie, WANG Junliang. Multi-fault feature adaptive extraction method for textile typical equipment [J]. Journal of Textile Research, 2024, 45(04): 211-220.
[2] WANG Xiaohu, PAN Ruru, GAO Weidong, ZHOU Jian. Fabric defect detection method using optimized sparse dictionary [J]. Journal of Textile Research, 2023, 44(08): 81-87.
[3] FU Han, HU Feng, GONG Jie, YU Lianqing. Defect reconstruction algorithm for fabric defect detection [J]. Journal of Textile Research, 2023, 44(07): 103-109.
[4] YAN Benchao, PAN Ruru, ZHOU Jian, WANG Lei, WANG Xiaohu. Real-time detection of fabric defects based on use of improved Itti salient model [J]. Journal of Textile Research, 2023, 44(07): 95-102.
[5] LIU Junping, ZHANG Fuhong, HU Xinrong, PENG Tao, LI Li, ZHU Qiang, ZHANG Junjie. Personalized clothing matching recommendation based on multi-modal fusion [J]. Journal of Textile Research, 2023, 44(03): 176-186.
[6] LI Yang, PENG Laihu, LI Jianqiang, LIU Jianting, ZHENG Qiuyang, HU Xudong. Fabric defect detection based on deep-belief network [J]. Journal of Textile Research, 2023, 44(02): 143-150.
[7] MA Chuanxu, ZHANG Ning, PAN Ruru. Detection of cheese yarn bobbin varieties based on support vector machine [J]. Journal of Textile Research, 2023, 44(01): 194-200.
[8] WANG Bin, LI Min, LEI Chenglin, HE Ruhan. Research progress in fabric defect detection based on deep learning [J]. Journal of Textile Research, 2023, 44(01): 219-227.
[9] ZHENG Zhaolun, LU Yujun. Dual-algorithm for fabric defect detection based on singular value decomposition [J]. Journal of Textile Research, 2022, 43(11): 59-67.
[10] LÜ Wentao, LIN Qiqi, ZHONG Jiaying, WANG Chengqun, XU Weiqiang. Research progress of image processing technology for fabric defect detection [J]. Journal of Textile Research, 2021, 42(11): 197-206.
[11] LIU Guowei, PAN Ruru, GAO Weidong, ZHOU Jian. Fabric defects segmentation using total variation [J]. Journal of Textile Research, 2021, 42(11): 64-70.
[12] XU Zengbo, ZHANG Ling, ZHANG Yanhong, CHEN Guiqing. Research on clothing collar types based on complex network extraction and support vector machine classification [J]. Journal of Textile Research, 2021, 42(06): 146-152.
[13] ZHENG Xiaoping, LIU Chengxia. Objective evaluation of woven garment bagging performance by laser measurement [J]. Journal of Textile Research, 2021, 42(05): 143-149.
[14] ZHU Lei, REN Mengfan, PAN Yang, LI Botao. Fabric defect detection based on similarity location and superpixel segmentation [J]. Journal of Textile Research, 2020, 41(10): 58-66.
[15] DI Lan, YANG Da, LIANG Jiuzhen, MA Mingyin. Fabric defect detection method based on primitive segmentation and Gabor filtering [J]. Journal of Textile Research, 2020, 41(09): 59-66.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!