纺织学报 ›› 2023, Vol. 44 ›› Issue (01): 219-227.doi: 10.13475/j.fzxb.20211105509
王斌1,2, 李敏2,3(), 雷承霖1,2, 何儒汉2,3
WANG Bin1,2, LI Min2,3(), LEI Chenglin1,2, HE Ruhan2,3
摘要:
为提高疵点检测的准确性和通用性,实现使用简洁而有效的形式对织物图像的特点和疵点的本质特征进行综合表达,首先,介绍了深度学习技术,对引入了深度学习的疵点检测方法进行综述,同时对深度学习与疵点检测的内在关系进行阐述;然后,分析总结了深度学习的概念及代表性的计算模型,并对引入深度学习的疵点检测方法进行归纳、总结和分类;最后,对典型的方法进行了分析,讨论了各种方法的优缺点,并对未来的研究趋势进行了展望。指出:随着深度学习的发展,探索更加通用的检测方法是推进深度学习在织物疵点检测领域应用的努力方向。
中图分类号:
[1] |
ZHU Q P, WU M Y, LI J, et al. Fabric defect detection via small scale over-complete basis set[J]. Textile Research Journal, 2014, 84(15):1634-1649.
doi: 10.1177/0040517514525880 |
[2] | 纺织行业“十四五”发展纲要[J]. 纺织科学研究, 2021(7): 40-49. |
Development outline of textile industry during the 14th five-year plan[J]. Textile Science Research, 2021(7): 40-49. | |
[3] | 吕文涛, 林琪琪, 钟佳莹, 等. 面向织物疵点检测的图像处理技术研究进展[J]. 纺织学报, 2021, 42(11): 197-206. |
LÜ Wentao, LIN Qiqi, ZHONG Jiaying, et al. Research progress of image processing technology for fabric defect detection[J]. Journal of Textile Research, 2021, 42(11): 197-206. | |
[4] | 郑胤, 陈权崎, 章毓晋. 深度学习及其在目标和行为识别中的新进展[J]. 中国图像图形学报, 2014, 19(2): 175-184. |
ZHENG Yin, CHEN Quanqi, ZHANG Yujin. Deep Learning and its new progress in goal and behavior recognition[J]. Journal of Image and Graphics, 2014, 19(2): 175-184. | |
[5] | 景军锋, 李江南, 李鹏飞. 改进型奇异值分解在织物疵点检测上的应用[J]. 纺织学报, 2014, 35(6): 62-67. |
JING Junfeng, LI Jiangnan, LI Pengfei. Application of improved singular value decomposition in fabric defect detection[J]. Journal of Textile Research, 2014, 35(6): 62-67. | |
[6] | 刘洲峰, 赵全军, 李春雷, 等. 基于局部统计与整体显著性的织物疵点检测算法[J]. 纺织学报, 2014, 35(11): 62-67. |
LIU Zhoufeng, ZHAO Quanjun, LI Chunlei, et al. Fabric defect detection algorithm based on local statistics and global significance[J]. Journal of Textile Research, 2014, 35(11): 62-67. | |
[7] | 张缓缓, 李仁忠, 景军锋, 等. Frangi滤波器和模糊C均值算法相结合的织物瑕疵检测[J]. 纺织学报, 2015, 36(9): 120-124. |
ZHANG Huanhuan, LI Renzhong, JING Junfeng, et al. Fabric defect detection based on Frangi filter and Fuzzy C-means algorithm[J]. Journal of Textile Research, 2015, 36(9): 120-124. | |
[8] | 景军锋, 赵娟. 基于MeanShift滤波的织物疵点检测方法[J]. 电子测量与仪器学报, 2016, 30(5): 739-747. |
JING Junfeng, ZHAO Juan. Fabric defect detection method based on MeanShift filter[J]. Journal of Electronic Measurement and Instruments, 2016, 30(5): 739-747. | |
[9] |
DI L, LONG H, LIANG J. Fabric defect detection based on illumination correction and visual salient features[J]. Sensors (Basel), 2020. DOI: 10.3390/s20185147.
doi: 10.3390/s20185147 |
[10] |
PRACH Y, BUMRUNG K. Defect detection in textile fabrics with snake active contour and support vector machines[J]. Journal of Physics: Conference Series, 2019. DOI: 10.1088/1742-6596/1195/1/012006.
doi: 10.1088/1742-6596/1195/1/012006 |
[11] |
LI Y Y, LUO H C, YU M M, et al. Fabric defect detection algorithm using RDPSO-based optimal Gabor filter[J]. Journal of The Textile Institute, 2019, 110(4):487-495.
doi: 10.1080/00405000.2018.1489951 |
[12] | 杨晓波. 基于GMRF模型的统计特征畸变织物疵点识别[J]. 纺织学报, 2013, 34(4): 137-142. |
YANG Xiaobo. Fabric defect detection of statistic aberration feature based on GMRF model[J]. Journal of Textile Research, 2013, 34(4): 137-142. | |
[13] | 杨晓波. 基于Gabor滤波器的织物疵点检测[J]. 纺织学报, 2010, 31(4): 55-59. |
YANG Xiaobo. Fabric defect detection based on Gabor filter[J]. Journal of Textile Research, 2010, 31(4): 55-59. | |
[14] | JING J F, ZHUO D, ZHANG H H, et al. Fabric defect detection using the improved YOLOv3 model[J]. Journal of Engineered Fibers and Fabrics, 2020, 2(4):1-10. |
[15] | 晏琳, 景军锋, 李鹏飞. Faster RCNN模型在坯布疵点检测中的应用[J]. 棉纺织技术, 2019, 47(2): 24-27. |
YAN Lin, JING Junfeng, LI Pengfei. Application of faster RCNN model in defect detection of gray fabric[J]. Cotton Textile Technology, 2019, 47(2): 24-27. | |
[16] | 杜磊, 李立轻, 汪军, 等. 几种基于图像自适应阈值分割的织物疵点检测方法比较[J]. 纺织学报, 2014, 35(6): 56-61. |
DU Lei, LI Liqing, WANG Jun, et al. Comparison of several fabric defect detection methods based on image adaptive threshold segmentation[J]. Journal of Textile Research, 2014, 35(6): 56-61. | |
[17] | 管声启, 石秀华. 基于频域滤波的织物疵点检测[J]. 计算机应用, 2008(10): 2673-2675. |
GUAN Shengqi, SHI Xiuhua. Fabric defect detection based on frequency domain filtering[J]. Journal of Computer Application, 2008(10): 2673-2675. | |
[18] |
ZHAO S X, YIN L, ZANG J, et al. Real-time fabric defect detection based on multi-scale convolutional neural network[J]. IET Collaborative Intelligent Manufacturing, 2020, 2(4):189-196.
doi: 10.1049/iet-cim.2020.0062 |
[19] | 汪坤. 基于深度学习的织物疵点检测算法研究[D]. 杭州: 浙江理工大学, 2020:22-23. |
WANG Kun. Research on fabric defect detection algorithm based on deep learning[D]. Hangzhou: Zhejiang Sci-Tech University, 2020:22-23. | |
[20] |
KRIZHEVSKY A, SUTSKEVER I, HINTON G E. ImageNet classification with deep convolutional neural networks[J]. Communications of the ACM, 2017, 60(6): 84-90.
doi: 10.1145/3065386 |
[21] | ZEILER M D, KRISHNAN D, TAYLOR G W, et al. Deconvolutional networks[C] // 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Illinois :IEEE, 2010:2528-2535. |
[22] |
邓俊锋, 张晓龙. 基于自动编码器组合的深度学习优化方法[J]. 计算机应用, 2016, 36(3): 697-702.
doi: 10.11772/j.issn.1001-9081.2016.03.697 |
DENG Junfeng, ZHANG Xiaolong. Deep learning optimization method based on automatic encoder combination[J]. Journal of Computer Application, 2016, 36(3): 697-702. | |
[23] |
GEOFFREY H, RUSLAN S. Discovering binary codes for documents by learning deep generative models[J]. Topics in Cognitive Science, 2011, 3(1):74-91.
doi: 10.1111/j.1756-8765.2010.01109.x pmid: 25164175 |
[24] |
GEOFFREY E, SIMON O, YEE T. A fast learning algorithm for deep belief nets[J]. Neural Computation, 2006, 18(7):1527-1554.
doi: 10.1162/neco.2006.18.7.1527 pmid: 16764513 |
[25] |
PANDIA R J, EDWARD R S J. Computer vision for automatic detection and classification of fabric defect employing deep learning algorithm[J]. International Journal of Clothing Science and Technology, 2019, 31(4):510-521.
doi: 10.1108/IJCST-11-2018-0135 |
[26] |
WU Y, ZHANG X D, FANG F Z. Automatic fabric defect detection using cascaded mixed feature pyramid with guided localization[J]. Sensors, 2020, 20(3):871.
doi: 10.3390/s20030871 |
[27] | 安萌, 郑飂默, 王诗宇, 等. 一种改进Faster R-CNN的面料疵点检测方法[J]. 小型微型计算机系统, 2021, 42(5): 1029-1033. |
AN Meng, ZHENG Liaomo, WANG Shiyu, et al. A fabric defect detection method based on improved Faster R-CNN[J]. Journal of Chinese Computer Systems, 2021, 42(5): 1029-1033. | |
[28] |
LIU J H, WANG C Y, SU H, et al. Multistage GAN for fabric defect detection[J]. IEEE Transactions on Image Processing, 2019, 29(1):3388-3400.
doi: 10.1109/TIP.2019.2959741 |
[29] | 李明, 景军锋, 李鹏飞. 应用GAN和Faster R-CNN的色织物缺陷识别[J]. 西安工程大学学报, 2018, 32(6): 663-669. |
LI Ming, JING Junfeng, LI Pengfei. Defect recognition of dyed fabric using GAN and Faster R-CNN[J]. Journal of Xi'an Polytechnic University, 2018, 32(6): 663-669. | |
[30] |
HU G H, HUANG J F, WANG Q H, et al. Unsupervised fabric defect detection based on a deep convolutional generative adversarial network[J]. Textile Research Journal, 2020, 90(3/4):247-270.
doi: 10.1177/0040517519862880 |
[31] |
PENG P R, WANG Y, HAO C, et al. Automatic fabric defect detection method using PRAN-Net[J]. Applied Sciences, 2020, 10(23):8434-8437.
doi: 10.3390/app10238434 |
[32] |
XIE H, WU Z. A robust fabric defect detection method based on improved RefineDet[J]. Sensors (Basel), 2020, 20(15):4260-4284.
doi: 10.3390/s20154260 |
[33] | LIU Z F, HUO Z C, LI C L, et al. DLSE-net: a robust weakly supervised network for fabric defect detection[J]. Displays, 2021, 68(12):102-110. |
[34] |
JUN X, WANG J G, ZHOU J, et al. Fabric defect detection based on a deep convolutional neural network using a two-stage strategy[J]. Textile Research Journal, 2021, 91(1/2):130-142.
doi: 10.1177/0040517520935984 |
[35] |
LI C X, LIU T, YE W. A novel feature-based network with sequential information for textile defect detection[J]. Coloration Technology, 2020, 136(6):476-484.
doi: 10.1111/cote.12493 |
[36] |
WEN Z J, ZHAO Q K, TONG L N. CNN-based minor fabric defects detection[J]. International Journal of Clothing Science and Technology, 2020, 33(1):1-12.
doi: 10.1108/IJCST-11-2019-0177 |
[37] |
HO C C, CHOU W C, SU E G. Deep convolutional neural network optimization for defect detection in fabric inspection[J]. Sensors, 2021, 21(21):7074.
doi: 10.3390/s21217074 |
[38] |
LI Y D, ZHAO W G, PAN J H. Deformable patterned fabric defect detection with fisher criterion-based deep learning[J]. IEEE Transactions on Automation Science and Engineering, 2017, 14(2):1256-1264.
doi: 10.1109/TASE.2016.2520955 |
[39] |
MEI S, WANG Y, WEN G. Automatic fabric defect detection with a multi-scale convolutional denoising autoencoder network model[J]. Sensors (Basel), 2018. DOI:10.3390/s18041064.
doi: 10.3390/s18041064 |
[40] | 景军锋, 党永强, 苏泽斌, 等. 基于改进SAE网络的织物疵点检测算法[J]. 电子测量与仪器学报, 2017, 31(8): 1321-1329. |
JING Junfeng, DANG Yongqiang, SU Zebin, et al. Fabric defect detection algorithm based on improved SAE network[J]. Journal of Electronic Measurement and Instrument, 2017, 31(8): 1321-1329. | |
[41] |
HAN Y J, YU H J. Fabric defect detection system using stacked convolutional denoising auto-encoders trained with synthetic defect data[J]. Applied Sciences, 2020, 10(7):26-36.
doi: 10.3390/app10010026 |
[42] | 刘洲峰, 闫磊, 李春雷, 等. 基于稀疏优化的织物疵点检测算法[J]. 纺织学报, 2016, 37(5):56-61. |
LIU Zhoufeng, YAN Lei, LI Chunlei, et al. Fabric defect detection algorithm based on sparse optimization[J]. Journal of Textlie Research, 2016, 37(5):56-61. | |
[43] |
CHEN M Q, YU L J, ZHI C, et al. Improved faster R-CNN for fabric defect detection based on Gabor filter with Genetic algorithm optimization[J]. Computers in Industry, 2022.DOI: j.compind.2021.103551.
doi: j.compind.2021.103551 |
[1] | 乌婧, 江振林, 吉鹏, 谢锐敏, 陈烨, 陈向玲, 王华平. 纺织品前瞻性制备技术及应用研究现状与发展趋势[J]. 纺织学报, 2023, 44(01): 1-10. |
[2] | 陈佳, 杨聪聪, 刘军平, 何儒汉, 梁金星. 手绘草图到服装图像的跨域生成[J]. 纺织学报, 2023, 44(01): 171-178. |
[3] | 蒲海红, 贺芃鑫, 宋柏青, 赵丁莹, 李欣峰, 张天一, 马建华. 纤维素/碳纳米管复合纤维的制备及其功能化应用[J]. 纺织学报, 2023, 44(01): 79-86. |
[4] | 张楚丹, 王锐, 王文庆, 刘燕燕, 陈睿. 阳离子改性阻燃涤纶织物的制备及其性能[J]. 纺织学报, 2022, 43(12): 109-117. |
[5] | 尹喆, 赵海浪, 徐红, 毛志平, 谭玉静. 纺织品中喹啉含量的快速测定[J]. 纺织学报, 2022, 43(12): 125-130. |
[6] | 安亦锦, 薛文良, 丁亦, 张顺连. 基于图像处理的纺织品耐摩擦色牢度评级[J]. 纺织学报, 2022, 43(12): 131-137. |
[7] | 赵伦玉, 隋晓锋, 毛志平, 李卫东, 冯雪凌. 气凝胶材料在纺织品上的应用研究进展[J]. 纺织学报, 2022, 43(12): 181-189. |
[8] | 方寅春, 陈吕鑫, 李俊伟. 阻燃超疏水涤/棉混纺织物的制备及其性能[J]. 纺织学报, 2022, 43(11): 113-118. |
[9] | 顾梅花, 刘杰, 李立瑶, 崔琳. 结合特征学习与注意力机制的服装图像分割[J]. 纺织学报, 2022, 43(11): 163-171. |
[10] | 张福沐, 刘端武, 胡跃明. 染色机助剂智能配送系统的构建及实践[J]. 纺织学报, 2022, 43(11): 179-187. |
[11] | 曹聪聪, 汤龙世, 刘元军, 赵晓明. 无机抗菌织物的研究进展[J]. 纺织学报, 2022, 43(11): 203-211. |
[12] | 王铭亮, 张慧乐, 岳晓丽, 陈慧敏. 基于数字图像相关法的纱线和织物微观变形测量[J]. 纺织学报, 2022, 43(11): 52-58. |
[13] | 陈金广, 李雪, 邵景峰, 马丽丽. 改进YOLOv5网络的轻量级服装目标检测方法[J]. 纺织学报, 2022, 43(10): 155-160. |
[14] | 程宁波, 缪东洋, 王先锋, 王朝晖, 丁彬, 俞建勇. 用于个人热湿舒适管理的功能纺织品研究进展[J]. 纺织学报, 2022, 43(10): 200-208. |
[15] | 肖渊, 李倩, 张威, 胡汉春, 郭鑫雷. 微喷印原电池置换成型织物基柔性导电线路的影响因素研究[J]. 纺织学报, 2022, 43(10): 89-96. |
|