关键词: 纱线状态识别, 轻量化神经网络, 知识蒸馏, 迁移学习, 模型部署, 针织

Abstract:

Objective The knotting machine in the circular weft knitting production line absorbs the yarn at the end of different yarn cylinders through the yarn guide tube, and sends the absorbed yarn to the knotting device to complete the knotting process. Aiming at the problem that it is difficult to detect the multi-state and multi-type yarn absorption in the yarn guide tube of the splitter, a detection scheme based on machine vision was proposed to realize the real-time monitoring of yarn number and color in the yarn guide tube of the knot machine to ensure the reliability of the joint.

Method In order to overcome the limitation of convenional yarn detection, an image classification method based on deep learning was proposed. 3 500 collected images were divided into 2 800 training sets and 700 test sets, and 560 images were separated from the training set as the verification set. Following that, a lightweight self-built student network was constructed by using superposition depth separable convolution. In order to overcome the defects of low accuracy and weak generalization performance of students' network, the combination training method of transfer learning and knowledge distillation was utilized to train the self-built network, and the final trained student network weight was deployed on the mobile terminal.

Results Experimental results showed that the teacher network using transfer learning had a verification set accuracy of more than 92% after the first round, and the convergence speed of the loss curve was also significantly accelerated (Fig. 9). When the student network was trained by knowledge distillation, the setting of loss weight α and distillation temperature T had no rule on the verification accuracy of the network. Compared with the student network verification accuracy of 95.7% before distillation, it was improved in general (Tab. 3). When the loss weight α was set to 0.2 and the distillation temperature T was set to 3, the best effect was achieved, and the top-1 accuracy on the verification set reached 99.57%. Comparative experiments of model reasoning were conducted on student network, teacher network and typical lightweight network before and after distillation (Tab. 4). The accuracy of the student network, which was originally 96.00% accurate on the test set, was improved to 99.28% after distillation. In addition, compared with the current typical lightweight model, the self-built lightweight student network had fewer parameters and less computation, which indirectly improved the forward reasoning time of the model. When the trained self-built network was deployed on the embedded terminal for actual test, the probability of a single yarn was higher than 70% (Fig. 11), while the probability of a double yarn was higher than 80%. The actual yarn detection accuracy rate was 98.86% after repeated experimental test on the yarn (Tab. 5). The difference in test accuracy between PC and embedded terminal was observed. The analysis showed that the PC side test was in the form of pictures taken before, while the embedded side test was in the form of actual video stream. On the other hand, the precision of weight parameters may be lost during the process of model quantization acceleration and deployment.

Conclusion The analysis result shows that, on the one hand, the PC side test is in the form of pictures taken before, while the embedded side test is in the form of actual video stream. On the other hand, the precision of weight parameters may be lost during the process of model quantization acceleration and deployment. It can be seen from the above yarn testing results that it meets the practical application needs and lays a solid foundation for promoting the application and popularization of the later knotting machine. In addition, the current yarn detection device is suitable for the knotting machine, but only it is necessary to optimize and upgrade the hardware and algorithm, useful in many occasions relating to yarn detection. Its lightweight size and low cost are undoubtedly progressed with commercial promotion value and significance.

Key words: yarn recognition, lightweight neural network, knowledge distillation, transfer learning, deployment model, knitting