Journal of Textile Research ›› 2024, Vol. 45 ›› Issue (03): 185-193.doi: 10.13475/j.fzxb.20220710001

• Machinery & Equipment • Previous Articles     Next Articles

Algorithm for detecting yarn bobbin margin based on inverse projection transformation

WANG Junru, WANG Hongpeng, RU Xin, CHEN Zhifeng(), SHI Weimin   

  1. Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
  • Received:2022-07-30 Revised:2023-08-30 Online:2024-03-15 Published:2024-04-15
  • Contact: CHEN Zhifeng E-mail:10584215@qq.com

Abstract:

Objective The detection of bobbin yarn margin is an important part of the automatic production process in the textile industry, of which the design of an image algorithm is a key part for facilitating the automatic bobbin change system. Because the bobbin installed on the take-up bar rotates in two directions and the front image of the bobbin is oval, it is necessary to design a bobbin yarn margin detection algorithm suitable for the actual production situation.

Method In view of the special imaging effect of the bobbin and considering the actual production situation, the inverse projection transformation algorithm was designed based on the multi-point perspective model. The initial inverse projection transformation matrix was calculated according to the spatial position relationship between the bobbin and the camera, and then the bobbin area was segmented to obtain the inner and outer bobbin areas of the bobbin and calculate the position information of the inner and outer bobbin areas. The compensation matrix was set, and the transformation matrix was optimized according to the position information of the inner and outer bobbin and the element transformation characteristics of the transformation matrix. The polar coordinates of the image were expanded after the inverse projection transformation and the bobbin yarn margin was calculated according to the set yarn margin calculation criteria.

Results The processing effect of this method and the experimental results were discussed in detail. The inverse projection transformation effect of the algorithm was compared with that of the conventional three-point perspective model. It was seen that the conventional inverse projection transformation was difficult to consider the transformation effect of the inner and outer cylinders, and the yarn width in the same direction of the yarn area was not equal or even different. Therefore, the compensation matrix was set based on conventional inverse projection transformation to optimize the effect of inverse projection transformation. The element value of the compensation matrix was determined according to the position relationship between the inner and outer barrels of the bobbin. Therefore, the inner and outer barrels of the bobbin were first segmented, and the contour of the inner and outer barrels was fitted. The position information of the inner and outer cylinder, such as roundness, direction angle and area size, were calculated by obtaining the contour of the inner and outer cylinder. The compensation matrix was solved according to the element transformation characteristics of the compensation matrix after obtaining the position information of the inner and outer drums and the yarn area width at the inner and outer drums. Taking the square calibration board as an example, the transformation characteristics of the compensation matrix elements were shown in compensation matrix factor transformation effect. The fifth bobbin was selected to calculate the compensation matrix, and the product of the initial transformation matrix and the compensation matrix were as the inverse projection transformation matrix. Considering the limitations of the transformation effect, the conventional ellipse polar coordinates were optimized, and the angle information of the ellipse was added to the polar coordinate transformation to obtain the polar coordinate expansion diagram of the corrected bobbin image. The yarn margin of the bobbin was obtained according to the specified yarn margin calculation criteria. The objective in this paper was to determine different types of yarn bobbins under the sampling angle, so that the two types of yarn bobbins could be considered separately in the experiment. The test results of partial yarn margin of cylindrical bobbin were shown in margin detection results. It was seen that the test error was mostly within 5 mm, but it reached over 10% under some circumstances. In fact, although the error of the bobbin with large margin is relatively large, it will not have a significant impact on the actual production. This is because the main purpose of this algorithm is to provide warnings when there is less yarn surplus. Therefore, as long as the yarn surplus is detected before it is used up, the system can calculate the remaining usage time based on the yarn usage speed. The test results of part of the yarn margin of the cone bobbin were shown in margin detection result. The test error was within 4 mm, the error accuracy was about 95%, and the yarn width of the sample with large error was within 40 mm.

Conclusion In order to solve the problems of poor transformation effect and high requirement of experimental conditions in general inverse projection transformation algorithm, this paper proposes a yarn margin detection algorithm based on inverse projection transformation based on multi-point perspective model. The experimental results show that the algorithm proposed in this paper can obtain good transformation effect of inner and outer bobbin at the same time for different types of bobbins under the determined sampling angle, and the detection error of yarn margin is within 5 mm, which meets the practical production requirements. Compared with other inverse projection transformation algorithms, this algorithm is simpler to implement and has higher detection efficiency. In the future work, the bobbin at different angles and different distances, and design filters to further reduce the interference of external environmental factors on the algorithm will be further studied, to enhance the detection accuracy of the algorithm.

Key words: bobbin, yarn margin detection, inverse projection transformation model, three-point inverse projection transformation, ellipse polar coordinate

CLC Number: 

  • TS181

Fig.1

Enterprise production.(a)Production layout; (b)Image acquisition system"

Fig.2

Camera calibration. (a)Multi-angle calibration image; (b)Calibration corner plot"

Fig.3

Camera calibration result.(a)Camera calibration error; (b)Camera calibration angle"

Fig.4

To-be-inspected bobbins with different characteristics. (a) Cylindrical type with small surplus bobbin; (b) Cylindrical type with surplus bobbin; (c) Conical type with small surplus bobbin; (d) Conical type with surplus bobbin"

Fig.5

Spatial position of creel and camera when image is acquired. (a) Schematic diagram; (b)Single-row creel rotates φ about Z-axis; (c) Single-row creel rotates θ about Y-axis"

Fig.6

Compensation matrix factor transformation effect. (a) Original image of checkerboard calibration board; (b) Transformation effect of scaling factor in axis direction; (c) Transformation effect of shear factor; (d)Transformation effect of projection factor"

Fig.7

Inner and outer bobbin position information"

Fig.8

Ellipse coordinate system conversion before and after rotation"

Fig.9

Inverse projection transformation correction effect. (a) Original image of cylinder bobbin. (b) Transformation and correction effect of conventional model; (c) Transformation and correction effect of model in this paper"

Tab.1

Coordinates of center point of bobbin and rotation angle in standard state"

检测对象 坐标值 检测对象 坐标值
纱筒1 (140,870) 纱筒5 (660,870)
纱筒2 (140,772) 纱筒6 (660,772)
纱筒3 (140,674) 纱筒7 (660,674)
纱筒4 (140,576) 纱筒8 (660,576)
旋转角度1 23.7° 相机 (300,440)
旋转角度2 32.2°

Fig.10

Image initial transformation.(a) Original image; (b) Transformed image"

Fig.11

Image filter and edge extraction.(a) Initial image; (b)Filterd image; (c)Inner bobbin extraction; (d)Edge extraction of inner and outer bobbins"

Tab.2

Calculation results of position information of inner and outer bobbins"

评价指标 计算值 评价指标 计算值
D1 93 C1 0.865
D2 273 C2 0.903
D3 260
D4 121

Fig.12

Flow chart of inverse projection transformation of yarn bobbin; (a) Original image; (b)Filtered image; (c)Initial inverse projection transformed image; (d) Inverse projection transformed image after compensation matrix correction"

Fig.13

Polar coordinate expansion diagram and its distortion diagram"

Fig.14

Sectional view of cylindrical bobbin"

Fig.15

Cylindrical bobbin yarn detection errors"

Fig.16

Sectional views of A-type ard B-type cone bobbins"

Fig.17

Conical bobbin yarn detection errors"

[1] 常亚平. 中国纺织产业分析和发展战略[M]. 北京: 中国纺织出版社, 2018: 10-12.
CHANG Yaping. Analysis and development strategy of Chinese textile industry[M]. Beijing: China Textile & Apparel Press, 2018: 10-12.
[2] 史伟民, 韩思捷, 屠佳佳, 等. 基于机器视觉的空纱筒口定位方法[J]. 纺织学报, 2023, 44 (11): 105-112.
SHI Weimin, HAN Sijie, TU Jiajia, et al. Empty yarn bobbin positioning method based on machine vision[J]. Journal of Textile Research, 2023, 44 (11): 105-112.
[3] 黄旭. 纺织机械智能化探究[J]. 机电信息, 2018(36):75-77.
HUANG Xu. Research on the intelligence of textile machinery[J]. Electromechanical Information, 2018(36):75-77.
[4] 朱建青. 纺织机械产品的可用性设计研究与应用[J]. 中国新技术新产品, 2017(11):37-38.
ZHU Jianqing. Research and application of usability design of textile machinery products[J]. China New Technology and New Products, 2017(11):37-38.
[5] 吕渭贤. 自动化产品在纺织机械上的应用[J]. 纺织机械, 2002(2):25-26.
LÜ Weixian. Application of automation products in textile machinery[J]. Textile Machinery, 2002(2):25-26.
[6] 杨佳丽, 高美凤. 一种QR码的预处理方法[J]. 计算机工程, 2011, 37(2):218-220.
doi: 10.3969/j.issn.1000-3428.2011.02.076
YANG Jiali, GAO Meifeng. A QR code preprocessing method[J]. Computer Engineering, 2011, 37(2):218-220.
doi: 10.3969/j.issn.1000-3428.2011.02.076
[7] 彭来湖, 祝孝裕, 张少民, 等. 筒子纱包装自动配重方法研究[J]. 纺织学报, 2020, 41 (6): 147-152.
PENG Laihu, ZHU Xiaoyu, ZHANG Shaomin, et al. Research on automatic counterweight scheme for cheese yarn packaging[J]. Journal of Textile Research, 2020, 41 (6): 147-152.
[8] 陈威兵, 杨高波, 冯璐. 一种QR码识别的低复杂度图像预处理方法[J]. 湖南大学学报(自然科学版), 2012, 39(10):93-97.
CHEN Weibing, YANG Gaobo, FENG Lu. A low-complexity image preprocessing method for QR code recognition[J]. Journal of Hunan University(Natural Science Edition), 2012, 39(10):93-97.
[9] 苗立刚. 基于形态学的文档图像透视校正算法[J]. 光电子·激光, 2009, 20(9):1262-1266.
MIAO Ligang. A document image perspective correction algorithm based on morphology[J]. Optoelectronics: Laser, 2009, 20(9):1262-1266.
[10] 丁卓, 童卫青, 赵骥. 基于三点透视的人脸姿态估计算法[J]. 华东师范大学学报(自然科学版), 2014(4):43-53.
DING Zhuo, TONG Weiqing, ZHAO Ji. Face pose estimation algorithm based on three-point perspec-tive[J]. Journal of East China Normal University (Natural Science Edition), 2014(4):43-53.
[11] 王钲旋. 《关于透视变换的研究》一文商榷[J]. 计算机辅助设计与图形学学报, 2001(12):1148-1149.
WANG Zhengxuan. Discussion on perspective transformation[J]. Journal of Computer Aided Design and Graphics, 2001(12):1148-1149.
[12] 丁伟利, 王明魁, 谷朝, 等. 一种多目标QR码图像快速校正方法[J]. 光学学报, 2017, 37(10):106-114.
DING Weili, WANG Mingkui, GU Chao, et al. A fast correction method for multi-target QR code images[J]. Acta Optics, 2017, 37(10):106-114.
[13] FAUGERAS O D. Stratification of three-dimensional vision:projective, affine,and metric representation[J]. Journal of the Optical Society of America A, 1995, 12(3): 465-484.
doi: 10.1364/JOSAA.12.000465
[14] 孙山河. 透视变换矩阵与三点透视[J]. 湖南大学学报(自然科学版), 1995(5):95-100.
SUN Shanhe. Perspective transformation matrix and three-point perspective[J]. Journal of Hunan University (Natural Science Edition), 1995(5):95-100.
[1] LU Weijian, TU Jiajia, WANG Junru, HAN Sijie, SHI Weimin. Model for empty bobbin recognition based on improved residual network [J]. Journal of Textile Research, 2024, 45(01): 194-202.
[2] SUN Lei, TU Jiajia, MAO Huimin, WANG Junru, SHI Weimin. Task scheduling technology for automatic bobbin replacement in intelligent knitting workshop [J]. Journal of Textile Research, 2023, 44(12): 189-196.
[3] SHI Weimin, HAN Sijie, TU Jiajia, LU Weijian, DUAN Yutang. Empty yarn bobbin positioning method based on machine vision [J]. Journal of Textile Research, 2023, 44(11): 105-112.
[4] ZHOU Qihong, HAN Weilong, CHEN Peng, HONG Wei, CEN Junhao. Prediction of measuring error of bobbin winding density based on grey system theory [J]. Journal of Textile Research, 2023, 44(10): 60-67.
[5] LUO Hailin, SU Jian, JIN Wanhui, FU Yaqin. Process optimization of novel silk reeling technique [J]. Journal of Textile Research, 2023, 44(04): 46-54.
[6] MA Chuanxu, ZHANG Ning, PAN Ruru. Detection of cheese yarn bobbin varieties based on support vector machine [J]. Journal of Textile Research, 2023, 44(01): 194-200.
[7] TU Jiajia, SUN Lei, MAO Huimin, DAI Ning, ZHU Wanzhen, SHI Weimin. Automatic bobbin changing technology for circular weft knitting machines [J]. Journal of Textile Research, 2022, 43(07): 178-185.
[8] LUO Hailin, FU Yaqin, LIU Ke. Structural design of automatic silk reeling machine for direct silk winding [J]. Journal of Textile Research, 2020, 41(08): 115-120.
[9] JING Junfeng, ZHANG Xingxing. Fiber glass bobbin yarn hairiness detection based on machine vision [J]. Journal of Textile Research, 2019, 40(05): 157-162.
[10] . Inspection of remaining yarn on bobbin based on odd Gabor filters [J]. Journal of Textile Research, 2018, 39(10): 138-142.
[11] . Modeling and numerical simulating for for residual ammonia volatilization from yarn bobbin [J]. JOURNAL OF TEXTILE RESEARCH, 2017, 38(09): 149-154.
[12] . Engineering plant adn process for dyeing of polyester bobbins in supercritical CO2 fluid [J]. JOURNAL OF TEXTILE RESEARCH, 2017, 38(08): 86-90.
[13] . Design of automatic bottom thread replacing system in super multi-head embroidery machine [J]. Journal of Textile Research, 2015, 36(04): 134-139.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!