Journal of Textile Research ›› 2020, Vol. 41 ›› Issue (04): 51-57.doi: 10.13475/j.fzxb.20190502107

• Textile Engineering • Previous Articles     Next Articles

Surface defect detection method of carbon fiber prepreg based on machine vision

LU Hao, CHEN Yuan()   

  1. School of Mechanical, Electronic & Information Engineering, Shandong University, Weihai, Shandong 264209, China
  • Received:2019-05-13 Revised:2020-01-19 Online:2020-04-15 Published:2020-04-27
  • Contact: CHEN Yuan E-mail:cyzghysy@sdu.edu.cn

RichHTML

24

PDF (PC)

698

Abstract:

Aiming at low efficiency, high cost and poor real-time of artificial detection of surface defects of carbon fiber prepregs, an automatic detection method based on machine vision was proposed. Two high resolution line scanning cameras were used to collect images quickly and continuously in the carbon fiber production line, from which 1 000 images with defects were randomly selected. After that, the image enhancement algorithm based on the atmospheric light scattering model was used to pre-process the images to eliminate the interference of white resin. The YOLOv2 object detection network was refined with 19 convolution layers and 5 maximum pooling layers for improvement in detect detection. Finally, the pre-processed images were trained, image features were extracted, image objects were identified, and the trained network was verified. The experimental results show that the proposed method has high accuracy and robustness under complex industrial environment, the recognition success rate in this research is over 94%, and the detection time of each image is less than 0.1 s, meeting the requirements of precision and real-time in industrial production.

Key words: machine vision, carbon fiber prepreg, surface defect detection, image pre-procession, YOLOv2 algorithm

CLC Number: 

  • TP391

Fig.1

Surface defect detection system of carbon fiber prepreg"

Fig.2

Surface defects of carbon fiber prepreg. (a) Normal; (b) Crack; (c) Hairball; (d) Hole"

Fig.3

Image pre-processing. (a) Original image;(b) Dehazing image; (c) Enhanced image"

Fig.4

Algorithm framework of YOLOv2"

Tab.1

Architecture of convolutional neural network of Darknet-19"

类型 滤波器个数 卷积核/步长 输出特征尺寸
卷积层1 32 3×3 224像素×224像素
最大池化层1 1 2×2/2 112像素×112像素
卷积层2 64 3×3 112像素×112像素
最大池化层2 1 2×2/2 56像素×56像素
卷积层3 128 3×3 56像素×56像素
卷积层4 64 1×1 56像素×56像素
卷积层5 128 3×3 56像素×56像素
最大池化层3 1 2×2/2 28像素×28像素
卷积层6 256 3×3 28像素×28像素
卷积层7 128 1×1 28像素×28像素
卷积层8 256 3×3 28像素×28像素
最大池化层4 1 2×2/2 14像素×14像素
卷积层9 512 3×3 14像素×14像素
卷积层10 256 1×1 14像素×14像素
卷积层11 512 3×3 14像素×14像素
卷积层12 256 1×1 14像素×14像素
卷积层13 512 3×3 14像素×14像素
最大池化层5 1 2×2/2 7像素×7像素
卷积层14 1 024 3×3 7像素×7像素
卷积层15 512 1×1 7像素×7像素
卷积层16 1 024 3×3 7像素×7像素
卷积层17 512 1×1 7像素×7像素
卷积层18 1 024 3×3 7像素×7像素
卷积层19 1 000 1×1 7像素×7像素
平均池化 全局 1 000

Fig.5

Process of non-maximum suppression"

Fig.6

Bounding box regression"

Fig.7

Training results of carbon fiber prepreg surface defect"

Tab.2

YOLOv2 model training results comparison"

YOLOv2模型 数据集 mAP 训练时间/h
YOLO-VOC 训练数据集 76.8 5
Tiny-YOLO 训练数据集 75.4 3

Tab.3

Tiny-YOLO multi-scale training results"

图像分辨率/像素 数据集 mAP 处理速度/(帧·s-1)
288×288 训练数据集 69.6 82
416×416 训练数据集 73.5 55
544×544 训练数据集 74.2 40

Fig.8

Detect results of carbon fiber prepreg surface defects. (a) Crack defect inspection results;(b) Hair mass defect detection results; (c) Hole defect detection results"

Tab.4

System detect effect%"

缺陷类型 检出率 误检率
裂缝 98.0 0.0
毛团 96.0 1.0
孔洞 97.0 1.0
[1] 高奇. 新形势下我国碳纤维产业发展探究[J]. 合成纤维工业, 2019,42(5):1-7.
GAO Qi. Research on the development of China's carbon fiber industry in the new situation[J]. China Synthetic Fiber Industry, 2019,42(5):1-7.
[2] 顾佳杰. 碳纤维产业研究发展报告[J]. 上海化工, 2019,44(3):32-36.
GU Jiajie. Carbon fiber industry development report[J]. Shanghai Chemical, 2019,44(3):32-36.
[3] 杨玉娥, 张文习. 碳纤维复合材料的无损检测综述[J]. 济南大学学报(自然科学版), 2015,29(6):471-476.
YANG Yu'e, ZHANG Wenxi. Summary of nondestructive testing of carbon fiber composites[J]. Journal of University of Jinan (Science and Technology), 2015,29(6):471-476.
[4] 倪金辉. 基于机器视觉的预浸纱缺陷检测系统的研究[D]. 南京: 南京航空航天大学, 2015: 1-5.
NI Jinhui. Defect detection system for prepreg based on machine vision[D]. Nanjing: Nanjing University of Aeronautics and Astronautics, 2015: 1-5.
[5] 李文羽, 程隆棣. 基于机器视觉和图像处理的织物疵点检测研究新进展[J]. 纺织学报, 2014,35(3):158-164.
LI Wenyu, CHENG Longdi. New progress in fabric defect detection based on machine vision and image processing[J]. Journal of Textile Reaearch, 2014,35(3):158-164.
[6] 张浩. 基于深度学习的表面缺陷检测方法研究[D]. 苏州: 苏州大学, 2018: 1-3.
ZHANG Hao. Study on surface defect detection method based on deep learning[D]. Suzhou: Soochow University, 2018: 1-3.
[7] REDMON Joseph, DIVVALA Santosh, GIRSHICK Ross, et al. You look only once: unified, real-time objection detection [C]//2016 IEEE conference on computer vision and pattern recognition(CVPR). Las Vegas: IEEE, 2016: 779-788.
[8] REDMON Joseph, FARHADI Ali. YOLO9000: better, faster, stronger [C]//2017 IEEE conference on computer vision and pattern recognition(CVPR). Venice: IEEE, 2017: 1-9.
[9] REN Shaoqing, HE Kaiming, GIRSHICK Ross. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017,39(6):1137-1149.
[10] 牟新刚, 蔡逸超, 周晓, 等. 基于机器视觉的筒子纱缺陷在线检测系统[J]. 纺织学报, 2018,39(1):139-145.
MOU Xingang, CAI Yichao, ZHOU Xiao, et al. Online yarn cone defects detection system based on machine vision[J]. Journal of Textile Reasearch, 2018,39(1):139-145.
[11] HE Kaiming, SUN Jian, TANG Xiaoou. Single image haze removal using dark channel prior [C]//2009 IEEE conference on computer vision and pattern recogni-tion(CVPR). Miami: IEEE, 2009: 1956-1963.
[12] WANG Xuelong, GAO Ying, DONG Junyu. Surface defects detection of paper dish based on Mask R-CNN [C]//Third international workshop on pattern recognition(IWPR). Jinan: Proceeding of Spie, 2018: 1-6.
[13] LIN Min, CHEN Qiang, YAN Shuichen. Network in network [C]//International conference on learning representations. Banff: ICLR, 2014: 1-10.
[14] IOFFE Sergey, SZEGEDY Christian. Batch normalization: accelerating deep network training by reducing internal covariate shift [C]//International conference on macine learning(ICML). Lille: IMLS, 2015: 448-456.
[15] CHA Youngjin, CHOI Wooram. Deep learning based crack damage detection using convolutional neural networks[J]. Computer-Aided Civil and Infrastucture Engineering, 2017,32:361-378.
[16] LENG Jianwei, GUO Kai. Research on monocular visual gesture positioning based on YOLOv2[C]//Proceeding of the 37th chinese control conference. Shanghai: Shanghai Systems Science Press, 2018: 9101-9106.
[17] ZHANG Hongwei, ZHANG Lingjie, LI Pengfei, et al. Yarn-dyed fabric defect detection with YOLOv2 based on deep convolution neural networks [C]//Data driven control and learning systems conference. Enshi: IEEE, 2018: 170-174.
[18] 何晓昀, 韦平, 张林. 基于深度学习的籽棉中异性纤维检测方法[J]. 纺织学报, 2018,39(6):131-135.
HE Xiaoyun, WEI Ping, ZHANG Lin. Detection method of foreign fibers in seed cotton based on deep-learning[J]. Journal of Textile Reasearch, 2018,39(6):131-135.
[1] ZHU Shigen, YANG Hongxian, BAI Yunfeng, DING Hao, ZHU Qiaolian. Investigation on automatic deformation inspection system of long and thin parts with hooks [J]. Journal of Textile Research, 2020, 41(10): 158-163.
[2] ZHANG Jianxin, LI Qi. Online cheese package yarn density detection system based on machine vision [J]. Journal of Textile Research, 2020, 41(06): 141-146.
[3] WANG Wensheng, LI Tianjian, RAN Yuchen, LU Ying, HUANG Min. Method for position detection of cheese yarn rod [J]. Journal of Textile Research, 2020, 41(03): 160-167.
[4] JIN Shoufeng, LIN Qiangqiang, MA Qiurui, ZHANG Hao. Method for detecting fluff quality of fabric surface based on BP neural network [J]. Journal of Textile Research, 2020, 41(02): 69-76.
[5] JING Junfeng, ZHANG Junyang, ZHANG Huanhuan, SU Zebin. Defect detection on surface of draw texturing yarn packages in gradient space [J]. Journal of Textile Research, 2020, 41(02): 44-51.
[6] SUN Weihong, RUAN Mianjiang, SHAO Tiefeng, LIANG Man. Detection method of cohesive performance of raw silk based on machine vision [J]. Journal of Textile Research, 2019, 40(08): 164-168.
[7] JING Junfeng, ZHANG Xingxing. Fiber glass bobbin yarn hairiness detection based on machine vision [J]. Journal of Textile Research, 2019, 40(05): 157-162.
[8] XU Yang, ZHU Zhichao, SHENG Xiaowei, YU Zhiqi, SUN Yize. Improvement recognition method of vamp's feature points based on machine vision [J]. Journal of Textile Research, 2019, 40(03): 168-174.
[9] JING Junfeng, GUO Gen. Yarn packages hairiness detection based on machine vision [J]. Journal of Textile Research, 2019, 40(01): 147-152.
[10] . On-line yarn cone defects detection system based on machine vision [J]. JOURNAL OF TEXTILE RESEARCH, 2018, 39(01): 139-145.
[11] . Characterization on anisotropy of fabric wrinkle recovery [J]. JOURNAL OF TEXTILE RESEARCH, 2016, 37(06): 42-47.
[12] . Testing system for high-speed solenoid valve of knitting machinery based on virtual instrument [J]. JOURNAL OF TEXTILE RESEARCH, 2011, 32(10): 134-0.
[13] LI Chunlei;CUI Bin;WU Xingkuan;YANG Chongchang;FENG Pei. Study on auto-detecting of spinneret by machine vision [J]. JOURNAL OF TEXTILE RESEARCH, 2010, 31(11): 126-130.
[14] LI Yong;ZHOU Ying;SHANG Huichao;OUYANG Chengzi. Automatic grey inspection technology based on machine vision [J]. JOURNAL OF TEXTILE RESEARCH, 2007, 28(8): 124-128.
[15] ZHOU Zhi-yu;LIU Xi-ang;YANG Dong-he. Application of machine vision in measurement of cocoon superficial area [J]. JOURNAL OF TEXTILE RESEARCH, 2006, 27(12): 29-31.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
京ICP备14006648号
Copyright 2021 © Editorial office of Journal of Textile Research
Supported by Beijing Magtech Co.Ltd