Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (12): 35-42.doi: 10.13475/j.fzxb.20220702801

• Textile Engineering • Previous Articles     Next Articles

Cotton foreign fibers detection algorithm based on residual structure

SHI Hongyu1(), WEI Yingjie1, GUAN Shengqi2, LI Yi1   

  1. 1. School of Computer Science, Xi'an Polytechnic University, Xi'an, Shaanxi 710048, China
    2. School of Mechanical & Electronic Engineering, Xi'an Polytechnic University, Xi'an, Shaanxi 710048, China
  • Received:2022-12-11 Revised:2023-01-02 Online:2023-12-15 Published:2024-01-22

Abstract:

Objective Aiming at the low detection accuracy of foreign fibers in cotton, and the poor detection effect caused by the hidden or corner position of foreign fibers, the author propose cotton foreign fibers detection algorithm based on residual structure. Its design is based on the characteristics of the different colors and shapes of foreign fibers in cotton, as well as the different shades and light layers of foreign fibers.
Method For the detection target, an online detection scheme for cotton foreign fibers was proposed. A mixed dataset of deep and shallow layers was constructed based on the color, texture, position, and other characteristics of foreign fibers. Building upon this, a foreign fiber detection network model algorithm with a residual structure was designed, addressing issues such as low accuracy in existing detection algorithms and the presence of hidden or corner-positioned foreign fibers.
Results Ultimately, the dataset constructed in this paper includes five common types of foreign fibers, which are plastic film, plastic rope, polypropylene thread, polyester thread, and hair strand. In order to enrich the dataset and increase the validity of the experiment, the dataset also contains samples with no foreign fibers. Comparative experiments are carried out by using the newly developed detection algorithm and other classical algorithms. In the constructed dataset, the experimental results show that the detection accuracy of foreign fibers and plastic film are as high as 92.81% and 95.76%, respectively, while the identification accuracy of hair, polypropylene thread and polyester wire is low (Tab. 1). Plastic film and plastic rope, which are larger than hair strand, are easier to detect. In industry, there are foreign fibers such as hair, polypropylene thread, polyester thread, etc. in the deep and shallow layers of cotton, and the characteristics of these deep foreign fibers are not obvious. Especially the targets of smaller hair strands, After a series of convolutional extraction features. The deep information is more abstracted, so there is less semantic information of such small target objects. In this paper, the attention mechanism is introduced into the residual structure, and different weights are given to the feature map to enhance the representation ability of the key feature of foreign fibers. Experimental results showed that the algorithm reported in this paper achieved remarkable success on deep and shallow datasets. The average detection accuracy of the deep and shallow dataset was 88.48% (Tab. 3). In addition, the algorithm performed well when processing a single image, with an average detection speed of only 0.019 s per image. In comparison to classical algorithms such as GoogleNet, MobileNetV1, MobileNetV2 and EfficientNet, the algorithm improved accuracy by 10.85%, 3.32%, 26.47% and 26.96%, respectively. Compared to MobileNetV2 and EfficientNet, the algorithm tested a single image with shorter running times and higher accuracy. Hence, the algorithm offered a balance between high accuracy and moderate detection speed in foreign fiber detection, catering to the real-time requirements of the industry. It addressed the issues of low accuracy in existing detection algorithms and the presence of hidden or corner-positioned foreign fibers. Furthermore, it introduced a novel approach to foreign fiber detection in cotton.
Conclusion In this paper, the algorithm not only achieves a high detection effect on shallow cotton foreign fibers dataset, but also achieves a good results on the mixed dataset of deep and shallow layers cotton foreign fiber. However, for the small objects in the deep depth of the actual industry, the method in this paper will also have false detection and missed detection. In the future, the network structure and network parameters will be optimized to improve the real-time detection of foreign fibers in cotton while maintaining a high detection accuracy.

Key words: foreign fiber detection, cotton, attention mechanism, residual structure, depth wise separable convolution, network model

CLC Number: 

  • TP391

Fig. 1

Diagram of online detection scheme of cotton foreign fibers"

Fig. 2

Original image of part cotton foreign fibers. (a)Plastic film;(b)Polypropylene thread; (c)Hair strand;(d)Plastic rope;(e)Polyester thread"

Fig. 3

Network model for detection of cotton foreign fibers"

Fig. 4

mAP and Loss values of training set and validation set. (a)mAP values for training and validation sets of our dataset; (b)Loss values for training and validation sets of our dataset;(c)mAP values of training and validation sets under some shallow datasets;(d)Loss values of training set and validation set under some shallow datasets"

Tab. 1

Accuracy of deep shallow mixed test set"

异性纤维类别 张数 准确率/%
无异性纤维 167 92.81
塑料薄膜 165 95.76
塑料绳 165 90.91
丙纶纱线 168 89.88
涤纶纱线 160 84.38
头发丝 165 76.97
合计 990 88.48

Fig. 5

Analysis of intermediate characteristic diagram"

Tab. 2

Test set detection accuracy under some shallow datasets"

异性纤维类别 张数 准确率/%
塑料薄膜 120 97.50
塑料绳 105 97.14
丙纶纱线 93 100.00
合计 318 98.21

Tab. 3

Comparison of cotton foreign fibers detection results of various algorithms under mixed data set"

检测算法 输入 准确率/% 模型大小/MB 时间/s
GoogleNet[13] RGB 79.82 23.568 0.020
MobileNetV1[12] RGB 85.64 2.161 0.070
MobileNetV2[16] RGB 69.96 8.875 0.011
EfficientNet[17] RGB 69.69 13.878 0.017
本文算法 RGB 88.48 17.902 0.019
[1] 汪文忠. 浅谈棉花异性纤维含量检验技术[J]. 中国棉花加工, 2019(3): 24-25.
WANG Wenzhong. Talking about the testing technology of cotton foreign fiber fontent[J]. China Cotton Processing, 2019(3): 24-25.
[2] 陈亚军, 吴婷荣, 史书伟, 等. 基于光学成像的棉花异性纤维检测方法研究进展[J]. 激光与光电子学进展, 2021, 58(16):138-154.
CHEN Yajun, WU Tingrong, SHI Shuwei, et al. Review of cotton foreign fiber detection method using optical imaging[J]. Laser & Optoelectronics Progress, 2021, 58(16): 138-154.
[3] 任维佳, 杜玉红, 左恒力, 等. 棉花中异性纤维检测图像分割和边缘检测方法研究进展[J]. 纺织学报, 2021, 42(12): 196-204.
REN Weijia, DU Yuhong, ZUO Hengli, et al. Research progress in image segmentation and edge detection methods for alien fibers detection in cotton[J]. Journal of Textile Research, 2021, 42(12): 196-204.
[4] WANG Y, HAO Z, ZUO F, et al. A fabric defect detection system based omproved YOLOv5 detector[C]// Journal of Physics: Conference Series. Lanzhou: IOP Publishing, 2021. DOI: 10.1088/1742-6596/2010/1/012191.
[5] 杜玉红, 董超群, 赵地, 等. 改进Faster RCNN模型在棉花异性纤维识别中的应用[J]. 激光与光电子学进展, 2020, 57(12): 132-141.
DU Yuhong, DONG Chaoqun, ZHAO Di, et al. Application of improved faster RCNN model for foreign fiber identification in cotton[J]. Laser & Optoelectronics Progress, 2020, 57(12): 132-141.
[6] 巫明秀, 吴谨, 张晨, 等. 基于改进YOLOv3的棉花异性纤维检测[J]. 液晶与显示, 2020, 35(11): 1195-1203.
WU Mingxiu, WU Jin, ZHANG Chen, et al. Detection of foreign fiber in cotton based on improved YOLOv3[J]. Chinese Journal of Liquid Crystals and Displays, 2020, 35(11): 1195-1203.
[7] ZHAO Xuehua, GUO Xiangyun, LUO Jie. et al. Efficient detection method for foreign fibers in cotton[J]. Information Processing in Agriculture, 2018, 5(3): 320-328.
[8] 赵学华, 李道亮, 杨文柱, 等. 基于改进蚁群算法的棉花异性纤维目标特征选择方法[J]. 农业机械学报, 2011, 41(4): 173-178.
ZHAO Xuehua, LI Daoliang, YANG Wenzhu, et al. Feature selection for cotton foreign fiber objects based on improved ant colony algorithm[J]. Transactions of the Chinese Society for Agricultural Machinery, 2011, 41(4): 173-178.
[9] 张云, 许江淳, 王志伟, 等. 基于机器视觉的棉花异性纤维检测技术优化研究[J]. 中国农机化学报, 2018, 39(9): 61-65.
ZHANG Yun, XU Jiangchun, WANG Zhiwei, et al. Optimization of cotton heterosexual detection technology based on machine vision[J]. Journal of Chinese Agricultural Mechanization, 2018, 39(9): 61-65.
[10] 戴永成, 焦智. 基于DSP的棉花异性纤维实时分拣算法研究与实现[J]. 科技通报, 2017, 33(5): 203-207.
DAI Yongcheng, JIAO Zhi. Research and implementation of cotton foreign fiber real-time sorting algorithm based on DSP[J]. Bulletin of Science and Technology, 2017, 33(5): 203-207.
[11] 何晓昀, 韦平, 张林, 等. 基于深度学习的籽棉中异性纤维检测方法[J]. 纺织学报, 2018, 39(6): 131-135.
HE Xiaoyun, WEI Ping, ZHANG Lin, et al. Detection method of foreign fibers in seed cotton based on deep-learning[J]. Journal of Textile Research, 2018, 39(6):131-135.
[12] CHOLLET F. Xception: deep learning with depthwise separable convolutions[C]// IEEE Conference on Computer Vision and Pattern Recognition. Honolulu: IEEE, 2017: 1800-1807.
[13] SZEGEDY C, LIU W, JIA Y Q, et al. Going deeper with convolutions[C]// IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 1-9.
[14] HE K M, ZHANG X Y, REN S Q, et al. Deep residual learning for image recognition[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Los Alamitos: IEEE Computer Society Press, 2016: 770-778.
[15] WOO S, PARK J, LEE J Y, et al. CBAM: convolutional block attention module[C]// Proceedings of the European Conference on Computer Vision. Seoul: ECCV, 2018: 3-19.
[16] SANDLER M, HOWARD A, ZHU M, et al. Mobilenetv2: inverted residuals and linear bottlenecks[C]// Proceedings of the IEEE conference on computer vision and pattern recognition. Salt Lake City: IEEE, 2018: 4510-4520.
[17] TAN M, LE Q V. EfficientNet: rethinking model scaling for convolutional neural networks[C]// Proceedings of International Conference on Machine Learning. Vancouver: PMLR, 2019: 6105-6114.
[1] CHEN Shun, QIAN Kun, LIANG Fuwei, GUO Wenwen. Preparation and properties of flame retardant hydrophobic cotton fabric with eugenol-based composite coating [J]. Journal of Textile Research, 2023, 44(12): 115-122.
[2] CHEN Bei, REN Lipei, XIAO Xingfang. Preparation and pH-detection properties of Tb-metal-organic frameworks modified cotton fabric [J]. Journal of Textile Research, 2023, 44(12): 123-129.
[3] LIU Juntao, SUN Ting, TU Hu, HU Min, ZHANG Ruquan, SUN Lei, LUO Xia, JI Hua. Optimization of plasma cold pad-batch degreasing/bleaching process for cotton spunlace nonwoven by response surface method [J]. Journal of Textile Research, 2023, 44(11): 132-141.
[4] ZHENG Xianhong, TANG Jinhao, LI Changlong, WANG Wei. Preparation and electromagnetic shielding performance of hollow magnetic Fe3O4 nanosphere/MXene composite cotton fabrics [J]. Journal of Textile Research, 2023, 44(11): 142-150.
[5] WANG Luyan, ZHANG Caining, ZHAO Qianqian, MA Zhihao, WANG Xuman. Preparation and properties of superhydrophobic cotton fabrics with ultraviolet/ammonia dual responsiveness [J]. Journal of Textile Research, 2023, 44(11): 160-166.
[6] QIAN Yaowei, YIN Lianbo, LI Jiawei, YANG Xiaoming, LI Yaobang, QI Dongming. Preparation and properties of flame retardant cotton fabrics by layer-by-layer assembly of polyvinylphosphonic acid and polyethylene polyamine [J]. Journal of Textile Research, 2023, 44(09): 144-152.
[7] SHAO Yanzheng, SUN Jianghao, WEI Chunyan, LÜ Lihua. Preparation and properties of adsorption fiber made from cotton stalk bark microcrystalline cellulose/modified chitosan [J]. Journal of Textile Research, 2023, 44(08): 18-25.
[8] MA Chuangjia, QI Lizhe, GAO Xiaofei, WANG Ziheng, SUN Yunquan. Stitch quality detection method based on improved YOLOv4-Tiny [J]. Journal of Textile Research, 2023, 44(08): 181-188.
[9] WANG Menglei, WANG Jing'an, GAO Weidong. Research progress in computer aided cotton blending technology [J]. Journal of Textile Research, 2023, 44(08): 225-233.
[10] FU Han, HU Feng, GONG Jie, YU Lianqing. Defect reconstruction algorithm for fabric defect detection [J]. Journal of Textile Research, 2023, 44(07): 103-109.
[11] GUO Yuqiu, ZHONG Yi, XU Hong, MAO Zhiping. Multi-component quantitative analysis method for dyeing with reactive dyes [J]. Journal of Textile Research, 2023, 44(07): 141-150.
[12] CHEN Jiahui, LIANG Yueyao, CHEN Ni, FANG Kuanjun. Research and application of ink jet printing on cotton fabrics [J]. Journal of Textile Research, 2023, 44(07): 159-166.
[13] TAN Jialing, LIU Jiayin, YU Weidong, YIN Yunjie, WANG Chaoxia. Preparation and properties of multichromatic thermochromic cotton fabrics using SiO2 microcapsules [J]. Journal of Textile Research, 2023, 44(07): 167-174.
[14] WANG Wei, WU Jiaxin, ZHANG Xiaoyun, ZHANG Chuanjie, GONG Zhaoqing. Decolorization properties and mechanism of waste cotton fabrics for preparing cotton pulp [J]. Journal of Textile Research, 2023, 44(07): 175-183.
[15] YUAN Tiantian, WANG Xin, LUO Weihao, MEI Chennan, WEI Jingyan, ZHONG Yueqi. Three-dimensional virtual try-on network based on attention mechanism and vision transformer [J]. Journal of Textile Research, 2023, 44(07): 192-198.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!