纺织学报 ›› 2024, Vol. 45 ›› Issue (03): 185-193.doi: 10.13475/j.fzxb.20220710001

• 机械与设备 • 上一篇    下一篇

基于逆投影变换的纱筒纱线余量检测算法

王俊茹, 王宏鹏, 汝欣, 陈智锋(), 史伟民   

  1. 浙江理工大学 浙江省现代纺织装备技术重点实验室, 浙江 杭州 300018
  • 收稿日期:2022-07-30 修回日期:2023-08-30 出版日期:2024-03-15 发布日期:2024-04-15
  • 通讯作者: 陈智锋
  • 作者简介:王俊茹(1974—),女,副教授。主要研究方向为机器视觉检测。
  • 基金资助:
    国家重点研发计划项目(2017YFB1304000)

Algorithm for detecting yarn bobbin margin based on inverse projection transformation

WANG Junru, WANG Hongpeng, RU Xin, CHEN Zhifeng(), SHI Weimin   

  1. Key Laboratory of Modern Textile Machinery & Technology of Zhejiang Province, Zhejiang Sci-Tech University, Hangzhou, Zhejiang 310018, China
  • Received:2022-07-30 Revised:2023-08-30 Published:2024-03-15 Online:2024-04-15
  • Contact: CHEN Zhifeng

摘要:

纱筒纱线余量检测是纺织行业自动化生产过程中的重要一环,针对目前纱线余量检测算法检测精度低的问题,提出一种基于三点逆投影变换模型的纱筒纱线余量检测技术。根据实际生产过程中相机与纱筒的位置关系,建立三点逆投影变换模型进行初步矫正。为得到更好的图像矫正结果,设置补偿矩阵并根据内外筒位置信息优化变换矩阵,最后将逆投影变换后的图像按照改进的椭圆坐标变换模型展开为矩形,根据余量计算准则计算得到纱筒纱线余量。在自主搭建的检测平台上进行实验,结果表明,本文算法检测精度在5 mm以内,基本满足实际生产要求,可为纺织产业自动化生产提供依据。

关键词: 纱筒, 纱线余量检测, 逆投影变换模型, 三点逆投影变换, 椭圆极坐标

Abstract:

Objective The detection of bobbin yarn margin is an important part of the automatic production process in the textile industry, of which the design of an image algorithm is a key part for facilitating the automatic bobbin change system. Because the bobbin installed on the take-up bar rotates in two directions and the front image of the bobbin is oval, it is necessary to design a bobbin yarn margin detection algorithm suitable for the actual production situation.

Method In view of the special imaging effect of the bobbin and considering the actual production situation, the inverse projection transformation algorithm was designed based on the multi-point perspective model. The initial inverse projection transformation matrix was calculated according to the spatial position relationship between the bobbin and the camera, and then the bobbin area was segmented to obtain the inner and outer bobbin areas of the bobbin and calculate the position information of the inner and outer bobbin areas. The compensation matrix was set, and the transformation matrix was optimized according to the position information of the inner and outer bobbin and the element transformation characteristics of the transformation matrix. The polar coordinates of the image were expanded after the inverse projection transformation and the bobbin yarn margin was calculated according to the set yarn margin calculation criteria.

Results The processing effect of this method and the experimental results were discussed in detail. The inverse projection transformation effect of the algorithm was compared with that of the conventional three-point perspective model. It was seen that the conventional inverse projection transformation was difficult to consider the transformation effect of the inner and outer cylinders, and the yarn width in the same direction of the yarn area was not equal or even different. Therefore, the compensation matrix was set based on conventional inverse projection transformation to optimize the effect of inverse projection transformation. The element value of the compensation matrix was determined according to the position relationship between the inner and outer barrels of the bobbin. Therefore, the inner and outer barrels of the bobbin were first segmented, and the contour of the inner and outer barrels was fitted. The position information of the inner and outer cylinder, such as roundness, direction angle and area size, were calculated by obtaining the contour of the inner and outer cylinder. The compensation matrix was solved according to the element transformation characteristics of the compensation matrix after obtaining the position information of the inner and outer drums and the yarn area width at the inner and outer drums. Taking the square calibration board as an example, the transformation characteristics of the compensation matrix elements were shown in compensation matrix factor transformation effect. The fifth bobbin was selected to calculate the compensation matrix, and the product of the initial transformation matrix and the compensation matrix were as the inverse projection transformation matrix. Considering the limitations of the transformation effect, the conventional ellipse polar coordinates were optimized, and the angle information of the ellipse was added to the polar coordinate transformation to obtain the polar coordinate expansion diagram of the corrected bobbin image. The yarn margin of the bobbin was obtained according to the specified yarn margin calculation criteria. The objective in this paper was to determine different types of yarn bobbins under the sampling angle, so that the two types of yarn bobbins could be considered separately in the experiment. The test results of partial yarn margin of cylindrical bobbin were shown in margin detection results. It was seen that the test error was mostly within 5 mm, but it reached over 10% under some circumstances. In fact, although the error of the bobbin with large margin is relatively large, it will not have a significant impact on the actual production. This is because the main purpose of this algorithm is to provide warnings when there is less yarn surplus. Therefore, as long as the yarn surplus is detected before it is used up, the system can calculate the remaining usage time based on the yarn usage speed. The test results of part of the yarn margin of the cone bobbin were shown in margin detection result. The test error was within 4 mm, the error accuracy was about 95%, and the yarn width of the sample with large error was within 40 mm.

Conclusion In order to solve the problems of poor transformation effect and high requirement of experimental conditions in general inverse projection transformation algorithm, this paper proposes a yarn margin detection algorithm based on inverse projection transformation based on multi-point perspective model. The experimental results show that the algorithm proposed in this paper can obtain good transformation effect of inner and outer bobbin at the same time for different types of bobbins under the determined sampling angle, and the detection error of yarn margin is within 5 mm, which meets the practical production requirements. Compared with other inverse projection transformation algorithms, this algorithm is simpler to implement and has higher detection efficiency. In the future work, the bobbin at different angles and different distances, and design filters to further reduce the interference of external environmental factors on the algorithm will be further studied, to enhance the detection accuracy of the algorithm.

Key words: bobbin, yarn margin detection, inverse projection transformation model, three-point inverse projection transformation, ellipse polar coordinate

中图分类号: 

  • TS181

图1

企业生产实况"

图2

相机标定"

图3

相机标定结果"

图4

不同特点的待检测纱筒"

图5

图像获取时纱筒和相机的空间位置状态"

图6

补偿矩阵因子变换效果"

图7

内外筒位置信息"

图8

旋转前后椭圆坐标系转换"

图9

逆投影变换矫正效果"

表1

标准状态下纱筒中心点坐标以及旋转角度"

检测对象 坐标值 检测对象 坐标值
纱筒1 (140,870) 纱筒5 (660,870)
纱筒2 (140,772) 纱筒6 (660,772)
纱筒3 (140,674) 纱筒7 (660,674)
纱筒4 (140,576) 纱筒8 (660,576)
旋转角度1 23.7° 相机 (300,440)
旋转角度2 32.2°

图10

图像初始变换"

图11

图像滤波以及边缘提取"

表2

内外筒位置信息计算结果"

评价指标 计算值 评价指标 计算值
D1 93 C1 0.865
D2 273 C2 0.903
D3 260
D4 121

图12

纱筒逆投影变换流程图"

图13

极坐标展开图及其畸变示意图"

图14

圆柱形纱筒剖面图"

图15

圆柱形纱筒纱线检测误差"

图16

A、B型圆锥形纱筒剖面图"

图17

圆锥形纱筒纱线检测误差"

[1] 常亚平. 中国纺织产业分析和发展战略[M]. 北京: 中国纺织出版社, 2018: 10-12.
CHANG Yaping. Analysis and development strategy of Chinese textile industry[M]. Beijing: China Textile & Apparel Press, 2018: 10-12.
[2] 史伟民, 韩思捷, 屠佳佳, 等. 基于机器视觉的空纱筒口定位方法[J]. 纺织学报, 2023, 44 (11): 105-112.
SHI Weimin, HAN Sijie, TU Jiajia, et al. Empty yarn bobbin positioning method based on machine vision[J]. Journal of Textile Research, 2023, 44 (11): 105-112.
[3] 黄旭. 纺织机械智能化探究[J]. 机电信息, 2018(36):75-77.
HUANG Xu. Research on the intelligence of textile machinery[J]. Electromechanical Information, 2018(36):75-77.
[4] 朱建青. 纺织机械产品的可用性设计研究与应用[J]. 中国新技术新产品, 2017(11):37-38.
ZHU Jianqing. Research and application of usability design of textile machinery products[J]. China New Technology and New Products, 2017(11):37-38.
[5] 吕渭贤. 自动化产品在纺织机械上的应用[J]. 纺织机械, 2002(2):25-26.
LÜ Weixian. Application of automation products in textile machinery[J]. Textile Machinery, 2002(2):25-26.
[6] 杨佳丽, 高美凤. 一种QR码的预处理方法[J]. 计算机工程, 2011, 37(2):218-220.
doi: 10.3969/j.issn.1000-3428.2011.02.076
YANG Jiali, GAO Meifeng. A QR code preprocessing method[J]. Computer Engineering, 2011, 37(2):218-220.
doi: 10.3969/j.issn.1000-3428.2011.02.076
[7] 彭来湖, 祝孝裕, 张少民, 等. 筒子纱包装自动配重方法研究[J]. 纺织学报, 2020, 41 (6): 147-152.
PENG Laihu, ZHU Xiaoyu, ZHANG Shaomin, et al. Research on automatic counterweight scheme for cheese yarn packaging[J]. Journal of Textile Research, 2020, 41 (6): 147-152.
[8] 陈威兵, 杨高波, 冯璐. 一种QR码识别的低复杂度图像预处理方法[J]. 湖南大学学报(自然科学版), 2012, 39(10):93-97.
CHEN Weibing, YANG Gaobo, FENG Lu. A low-complexity image preprocessing method for QR code recognition[J]. Journal of Hunan University(Natural Science Edition), 2012, 39(10):93-97.
[9] 苗立刚. 基于形态学的文档图像透视校正算法[J]. 光电子·激光, 2009, 20(9):1262-1266.
MIAO Ligang. A document image perspective correction algorithm based on morphology[J]. Optoelectronics: Laser, 2009, 20(9):1262-1266.
[10] 丁卓, 童卫青, 赵骥. 基于三点透视的人脸姿态估计算法[J]. 华东师范大学学报(自然科学版), 2014(4):43-53.
DING Zhuo, TONG Weiqing, ZHAO Ji. Face pose estimation algorithm based on three-point perspec-tive[J]. Journal of East China Normal University (Natural Science Edition), 2014(4):43-53.
[11] 王钲旋. 《关于透视变换的研究》一文商榷[J]. 计算机辅助设计与图形学学报, 2001(12):1148-1149.
WANG Zhengxuan. Discussion on perspective transformation[J]. Journal of Computer Aided Design and Graphics, 2001(12):1148-1149.
[12] 丁伟利, 王明魁, 谷朝, 等. 一种多目标QR码图像快速校正方法[J]. 光学学报, 2017, 37(10):106-114.
DING Weili, WANG Mingkui, GU Chao, et al. A fast correction method for multi-target QR code images[J]. Acta Optics, 2017, 37(10):106-114.
[13] FAUGERAS O D. Stratification of three-dimensional vision:projective, affine,and metric representation[J]. Journal of the Optical Society of America A, 1995, 12(3): 465-484.
doi: 10.1364/JOSAA.12.000465
[14] 孙山河. 透视变换矩阵与三点透视[J]. 湖南大学学报(自然科学版), 1995(5):95-100.
SUN Shanhe. Perspective transformation matrix and three-point perspective[J]. Journal of Hunan University (Natural Science Edition), 1995(5):95-100.
[1] 陆伟健, 屠佳佳, 王俊茹, 韩思捷, 史伟民. 基于改进残差网络的空纱筒识别模型[J]. 纺织学报, 2024, 45(01): 194-202.
[2] 孙磊, 屠佳佳, 毛慧敏, 王俊茹, 史伟民. 针织智能车间自动换筒任务调度技术[J]. 纺织学报, 2023, 44(12): 189-196.
[3] 史伟民, 韩思捷, 屠佳佳, 陆伟健, 段玉堂. 基于机器视觉的空纱筒口定位方法[J]. 纺织学报, 2023, 44(11): 105-112.
[4] 屠佳佳, 孙磊, 毛慧敏, 戴宁, 朱婉珍, 史伟民. 圆纬机纱架自动换筒技术[J]. 纺织学报, 2022, 43(07): 178-185.
[5] 张东 孟婥. 纱筒残余氨的扩散过程建模与数值模拟[J]. 纺织学报, 2017, 38(09): 149-154.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!