Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (07): 95-102.doi: 10.13475/j.fzxb.20220308301

• Textile Engineering • Previous Articles     Next Articles

Real-time detection of fabric defects based on use of improved Itti salient model

YAN Benchao, PAN Ruru(), ZHOU Jian, WANG Lei, WANG Xiaohu   

  1. College of Textile Science and Engineering, Jiangnan University, Wuxi, Jiangsu 214122, China
  • Received:2022-03-24 Revised:2022-10-09 Online:2023-07-15 Published:2023-08-10

Abstract:

Objective Conventional manual testing relies on the subjective experience and rating standards of inspectors to complete the appearance quality testing and evaluation of fabrics, which has problems such as backward productivity, poor detection accuracy, low efficiency and easy fatigue. Fabric defects automatic detection technology is one of the key links for textile enterprises to develop into intelligent manufacturing. Thus, this paper intends to develop a real-time detection system in order to achieve the automatic detection of fabric defects so as to overcome the disadvantages seen in manual detection.

Method The system adopts the motor drive to realize the fabric winding and the automatic transfer of the roll. Unwinding and transmission can be stably, with high automation and accuracy. In order to meet the different lighting requirements, three rows of LED lights are installed, and they have more lighting modes than other systems. Eight industrial cameras are arranged side by side to realize the image acquisition of the fabric. The acquired images were rapidly detected by the image defects based on an improved Itti salient model fault detection algorithm. The model has shorter detection time for fabric image and has higher accuracy, which can meet the real-time detection requirements of fabric defects.

Results The schematic diagram of the fabric image acquisition system is established (Fig. 1). The fabric is rewound by the motor and can be stably transmitted to the image acquisition area in a specific route. In the image acquisition area, fabric images of different thickness fabrics with different light sources are obtained (Fig. 3). It can be seen that the sharpness of the images taken by different light sources is different, which meets the detection requirements of different thickness fabrics. It also indicates that the installed camera has a high shooting definition. The images were detected based on the improved Itti salient model. Different directions can effectively extract the features of the fabric image and detect the edge information inside the image. The fabric fault significance graph is obtained by manipulating the normalized brightness and orientation feature, and the significant graph is divided by the custom threshold to effectively detect the defect information(Fig. 8, Fig. 9). It can effectively detect fabric defects in industrial grey fabric and denim, such as oil and holes. The defect detection rate is 93%. Compared with other fabric defect detection algorithms, the detection accuracy is higher. At the same time, it can be seen that the detection time of this method is short (Tab. 3), and the detection speed is 48 m/min. The real-time detection speed is further improved.

Conclusion In order to improve the disadvantages of the convenitional artificial fabric fault detection, a fabric image acquisition platform and a real-time fabric fault detection system based on the significance detection algorithm are proposed. The fabric platform can be driven by a motor, which is more stable than the previous roll transmission system and takes clearer photos. The improved significance detection algorithm detects the images and achieves good detection results. By comparison, the method has high detection accuracy and real-time performance, and the detection time of the algorithm meets the requirements of dynamic detection. The designed fabric real-time detection platform can run effectively and stably, and have higher real-time detection performance.

Key words: defect detection, real-time detection, Gabor filtering, Gaussian pyramid, Itti saliency

CLC Number: 

  • TS941.26

Fig. 1

Hardware platform of fabric defect detection"

Fig. 2

Light source configuration in different directions"

Fig. 3

Fabric images under different light sources. (a)Light fabric under backlight;(b)Light fabric under reflected light;(c)Thick fabric under backlight;(d)Thick fabric under reflected light"

Fig. 4

Flow chart of detection algorithm"

Fig. 5

Pyramid image"

Fig. 6

Filter graph in different directions. (a)Original image;(b)0° direction; (c)45° direction;(d) 90° direction;(e) 135° direction;(f)Four directions"

Fig. 7

Images of segmentation effect. (a) Defect image; (b) Saliency image; (c) k=1; (d) k=2; (e) k=3; (f) k=4; (g) k=5; (h) k=6"

Tab. 1

Fabric types and parameters"

织物
种类
密度/(根·
(10 cm)-1)
面密度/
(g·m-2)
织物组织 织物
特征
采集
光源
经纱 纬纱
纯棉
白坯布
470 196 110 平纹 轻薄、
易透光
投射光+
背光
纯棉蓝色
牛仔布
276 144 330 斜纹 厚重、透光
性差
投射光+
反射光

Fig. 8

Test results of industrial grey fabric. (a) Oil stains; (b) Broken warp; (c) Hole"

Fig. 9

Test results of industrial denim. (a) Wrong pattern; (b) Weft exposure; (c) Hole"

Tab. 2

Defect type and detection result"

织物 疵点类型 疵点图像/张 检出量/张 漏检量/张 误检量/张


油污 20 20 0 0
断经 7 7 0 0
缺纬 5 4 1 0
破洞 8 8 0 0
褶皱 0 2 0 2
无疵点 10 10 0 0


错花 8 7 1 0
爆纬 26 21 1 0
纬缩 6 5 1 0
无疵点 10 7 3 0
总计 100 93 7 2

Tab. 3

Comparison of results of different methods"

算法 正检率/% 误检率/% 检测时间/(s·张-1)
文献[3] 82 18 0.150
文献[10] 91 9 0.950
文献[11] 95 5 0.750
文献[16] 82 18 0.510
本文方法 93 7 0.038

Fig. 10

Test images (a) and defect detection results by algorithms of document[3](b), document[10](c), document[11](d), document[16](e) and this paper (f)"

[1] SONG Shaojun, JING Junfeng, HUANG Yanqing, et al. Efficient det for fabric defect detection based on edge computing[J]. Journal of Engineered Fibers and Fabrics, 2021, 16:1-13.
[2] 朱磊, 任梦凡, 潘杨, 等. 基于相似性定位和超像素分割的织物疵点检测[J]. 纺织学报, 2020, 41(10):58-66.
ZHU Lei, REN Mengfan, PAN Yang, et al. Fabric defect detection based on similarity location and superpixel segmentation[J]. Journal of Textile Research, 2020, 41(10):58-66.
[3] 占竹, 汪军. 基于字典学习的机织物疵点图像等级评定研究[J]. 毛纺科技, 2019, 47(1):80-85.
ZHAN Zhu, WANG Jun. Study on image grading of woven fabric defect based on dictionary learning[J]. Wool Textile Journal, 2019, 47(1):80-85.
[4] CHANG Haifeng. Design and implementation of real-time fabric defect detection system[J]. Advances in information Sciences and Service Sciences, 2012, 4(21):23-30.
[5] WEI Wei, DENG Dexiang, ZENG Lin, et al. Realtime implementation of fabric defect detection based on variational automatic encoder with structure similarity[J]. Journal of Real-Time Image Processing, 2021, 18(3):807-823.
doi: 10.1007/s11554-020-01023-5
[6] CHEN Mengqi, YU Lingjie, ZHI Chao, et al. Improved faster R-CNN for fabric defect detection based on Gabor filter with genetic algorithm optimization[J]. Computers in Industry, 2022(134):1-10.
[7] 李文羽, 程隆棣. 基于机器视觉和图像处理的织物疵点检测研究新进展[J]. 纺织学报, 2014, 35(3):158-164.
LI Wenyu, CHENG Longdi. New progress of fabric defect detection based on computer vision and image process-ing[J]. Journal of Textile Research, 2014, 35(3):158-164.
[8] 刘荣清. 织物疵点自动检测系统的发展和展望[J]. 棉纺织技术, 2017, 45(10):13-15.
LIU Rongqing. Development and prospect of fabric defect automatic inspecting system[J]. Cotton Textile Technology, 2017, 45(10):13-15.
[9] ITTI Laurent, KOCH Christof, NIEBUR Ernst. A model of saliency-based visual attention for rapid scene analysis[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 1998, 20(11):1254-1259.
[10] GUAN Shenqi, GAO Zhaoyuan. Fabric defect image segmentation based on the visual attention mechanism of the wavelet domain[J]. Textile Research Journal, 2014, 84(10):1018-1033.
doi: 10.1177/0040517513517964
[11] 周文明, 周建, 潘如如. 应用遗传算法优化Gabor滤波器的机织物疵点检测[J]. 东华大学学报(自然科学版), 2020, 46(4):535-541.
ZHOU Wenming, ZHOU Jian, PAN Ruru. Woven fabric defect detection using Gabor filter optimized by genetic algorithm[J]. Journal of Donghua University(Natural Science), 2020, 46(4):535-541.
[12] 杨宏珊. 织物疵点检测系统组件及选择[J]. 中国纤检, 2021(4):118-120.
YANG Hongshan. Components and selections of fabric defect detection system[J]. China Fiber Inspection, 2021(4):118-120.
[13] 王传桐, 胡峰, 徐启永, 等. 采用Gabor滤波簇和等距映射算法的织物疵点检测方法[J]. 纺织学报, 2017, 38(3):163-167.
WANG Chuantong, HU Feng, XU Qiyong, et al. Detection of fabric defects based on Gabor filters and Isomap[J]. Journal of Textile Research, 2017, 38(3):163-167.
[14] SARKAR A, PADMAVATHI S. Image pyramid for automatic segmentation of fabric defects[J]. Lecture Notes in Computational Vision and Biomechanics, 2018, 28:569-578.
[15] MA Shuangbao, LIU Wen, YOU Changli, et al. An improved defect detection algorithm of jean fabric based on optimized Gabor filter[J]. Journal of Information Processing Systems, 2020, 16(5):1008-1014.
[16] JING Junfeng, ZHANG Min, ZHANG Huanhuan, et al. A coarse-to-fine method for glass fiber fabric surface defect detection[J]. Journal of The Textile Institute, 2021, 112(3):388-397.
doi: 10.1080/00405000.2020.1758454
[1] FU Han, HU Feng, GONG Jie, YU Lianqing. Defect reconstruction algorithm for fabric defect detection [J]. Journal of Textile Research, 2023, 44(07): 103-109.
[2] LI Yang, PENG Laihu, LI Jianqiang, LIU Jianting, ZHENG Qiuyang, HU Xudong. Fabric defect detection based on deep-belief network [J]. Journal of Textile Research, 2023, 44(02): 143-150.
[3] WANG Bin, LI Min, LEI Chenglin, HE Ruhan. Research progress in fabric defect detection based on deep learning [J]. Journal of Textile Research, 2023, 44(01): 219-227.
[4] ZHENG Zhaolun, LU Yujun. Dual-algorithm for fabric defect detection based on singular value decomposition [J]. Journal of Textile Research, 2022, 43(11): 59-67.
[5] LÜ Wentao, LIN Qiqi, ZHONG Jiaying, WANG Chengqun, XU Weiqiang. Research progress of image processing technology for fabric defect detection [J]. Journal of Textile Research, 2021, 42(11): 197-206.
[6] ZHU Lei, REN Mengfan, PAN Yang, LI Botao. Fabric defect detection based on similarity location and superpixel segmentation [J]. Journal of Textile Research, 2020, 41(10): 58-66.
[7] DI Lan, YANG Da, LIANG Jiuzhen, MA Mingyin. Fabric defect detection method based on primitive segmentation and Gabor filtering [J]. Journal of Textile Research, 2020, 41(09): 59-66.
[8] ZHOU Wenming, ZHOU Jian, PAN Ruru. Yarn-dyed fabric defect detection based on context visual saliency [J]. Journal of Textile Research, 2020, 41(08): 39-44.
[9] YANG Enjun, LIAO Yihui, LIU Andong, YU Li. Detection for fabric defects based on low-rank decomposition [J]. Journal of Textile Research, 2020, 41(05): 72-78.
[10] LU Hao, CHEN Yuan. Surface defect detection method of carbon fiber prepreg based on machine vision [J]. Journal of Textile Research, 2020, 41(04): 51-57.
[11] JING Junfeng, ZHANG Junyang, ZHANG Huanhuan, SU Zebin. Defect detection on surface of draw texturing yarn packages in gradient space [J]. Journal of Textile Research, 2020, 41(02): 44-51.
[12] ZHANG Huanhuan, MA Jinxiu, JING Junfeng, LI Pengfei. Fabric defect detection method based on improved fast weighted median filtering and K-means [J]. Journal of Textile Research, 2019, 40(12): 50-56.
[13] XIAO Zhitao, GUO Yongmin, GENG Lei, WU Jun, ZHANG Fang, WANG Wen, LIU Yanbei. Internal defect detection method for thin test pieces of woven laminated composites based on ultrasonic phased array [J]. Journal of Textile Research, 2019, 40(11): 81-87.
[14] ZHU Hao, DING Hui, SHANG Yuanyuan, SHAO Zhuhong. Defect detection algorithm for multiple texture hierarchical fusion fabric [J]. Journal of Textile Research, 2019, 40(06): 117-124.
[15] DU Shuai, LI Yueyang, WANG Mengtao, LUO Haichi, JIANG Gaoming. Fabric defect detection based on improved local adaptive contrast method [J]. Journal of Textile Research, 2019, 40(02): 38-44.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!