Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (08): 197-204.doi: 10.13475/j.fzxb.20220200701

• Machinery & Accessories • Previous Articles     Next Articles

Research and development of key technologies and whole-set equipment for intelligent sewing

CHEN Gang1(), JIN Guiyang2, WU Jing1, LUO Qian3   

  1. 1. School of Automation, Zhejiang Institute of Mechanical & Electrical Engineering, Hangzhou, Zhejiang 310059, China
    2. Faculty of Mechanical Engineering & Mechanics, Ningbo University, Ningbo, Zhejiang 315210, China
    3. Supreme Intelligent Technology Co., Ltd., Ningbo, Zhejiang 315100, China
  • Received:2022-02-09 Revised:2023-04-11 Online:2023-08-15 Published:2023-09-21

Abstract:

Objective In response to problems such as high labor demand, low automation, and low efficiency in the process of fabric stitching, machine vision, industrial robot, and sewing machine technologies were studied and applied to the design and development of intelligent sewing equipment. By combining these technologies, it helps to improve the absolute positioning accuracy of the industrial robot, as well as the ability to extract fabric contours and ensure the consistency of sewing quality. This has reduced the need for manual labor and has helped drive the transformation and upgrading of the garment sewing industry.

Method Firstly, the absolute positioning kinematics parameter error compensation technology of industrial robot based on wire encoder was studied, so that the absolute positioning accuracy of industrial robot can meet the requirements of sewing task. Secondly, the technology of fabric contour and key points extraction based on Canny operator was studied, which provides data basis for the sewing path plan. Thirdly, the speed synchronization control algorithm of industrial robot and sewing machine based on proportional integral differential (PID) law was developed to solve the problem of irregular stitches caused by the unsynchronization of industrial robot and sewing machine.

Results A double-layer garment piece intelligent sewing equipment consisting of industrial robot, camera, sewing machine, working platform, loading, unloading and other auxiliary mechanisms was developed according to customer needs (Fig. 3,4). The calibration software was developed by applying the optimization compensation technology for the absolute positioning error of the industrial robot based on the wire encoder, which reduced the absolute positioning accuracy error of the central point of the industrial robot tool from the average 1.263 5 mm to 0.128 5 mm. Sewing effect showed the comparison of sewing effects before and after optimization of absolute positioning error. Sewing effect before error compensation shows the sewing stitches prior to error optimization and sewing effect after error compensation shows the sewing stitches after error optimization. It can be seen from sewing effect that the sewing quality of the fabric was greatly improved by adopting the error optimization technology. Using fabric contour extraction technology based on Canny operator, a fabric contour and key point's extraction program based on OpenCV was developed. The original fabric image was a fabric of arbitrary shape, representing various contours of real fabric such as straight line, arc and curve. Fabric contour extraction showed the effect of the contour and key points extraction program, generating different numbers of key points according to different contour curvature. The larger the curvature, the more key points were to be extracted, which was convenient for trajectory planning of the industrial robot and improves the sewing quality. The control block diagram and corresponding control program were constructed by using the speed synchronization control technology of the industrial robot and the sewing machine. The sewing machine needle speed was on open loop control, and its speed was proportional to the Tool Center Point (TCP) speed of the industrial robot. The speed of the cloth feeding wheel of the sewing machine was controlled in a closed loop, which improved the ability of the cloth feeding wheel speed to follow the TCP speed of the industrial robot. Sewing effect and stitches demonstrated the effect before and after the speed synchronization of the industrial robot and the sewing machine, leading to significant improvement of the quality of stitches.

Conclusion Combined with machine vision, absolute positioning error compensation of industrial robot, contour extraction technology, synchronous control technology of manipulator and sewing machine, and this research systematically studied the technical system required for intelligent sewing equipment. The research and development of intelligent sewing equipment has effectively reduced the number of equipment operators, solved the problem of shortage of sewing workers, provided technical accumulation for the automation and intelligence of sewing equipment, and also provided a technical basis for the automation, intelligence and digital transformation of the sewing process in the sewing industry. It is recommended that the sewing equipment should be further improved mainly from the following two aspects, i.e., the 6-axis industrial robot should be changed to Selective Compliance Assembly Robot Arm (SCARA) to reduce equipment costs and improve the absolute positioning accuracy, and a simple and easy-to-use human-computer interface should be designed to facilitate operation and switching sewing tasks.

Key words: machine vision, error compensation, contour extraction, synchronization technology, intelligent sewing

CLC Number: 

  • TH166

Fig. 1

Components of intelligent sewing machine"

Fig. 2

Two points distance error on base coordinate"

Fig. 3

Feeding system of sewing equipment"

Fig. 4

Sewing system of sewing equipment"

Fig. 5

Sewing equipment control system architecture"

Fig. 6

Calibration interface of calibration software"

Tab. 1

Robotic arm TCP error information before and after error compensation"

补偿前后 最小值 均值 最大值
误差补偿前 0.590 1 1.263 5 2.568 6
误差补偿后 0.050 6 0.128 5 0.205 7

Fig. 7

Sewing effect before error compensation(a)and after error compensation(b)"

Fig. 8

Fabric contour extraction. (a) Fabric; (b)Contour line and key points"

Fig. 9

Industrial robot and sewing machine synchronous control block diagram"

Fig. 10

Sewing effect with robot and sewing needle not synchronized. (a)Stitches become denser with curvature is large; (b)Stitches become sparse with robot has acceleration"

Fig. 11

Stitches remains constant with curvature is large"

[1] 吴柳波, 李新荣, 杜金丽. 基于轮廓提取的缝纫机器人运动轨迹规划研究进展[J]. 纺织学报, 2021, 42(4): 10-19.
WU Liubo, LI Xinrong, DU Jinli. Research progress of motion trajectory planning of sewing robot based on contour extraction[J]. Journal of Textile Research, 2021, 42(4):10-19.
doi: 10.1177/004051757204200103
[2] 吴锦辉, 陶友瑞. 工业机器人定位精度可靠性研究现状综述[J]. 中国机械工程, 2020, 31(18):9-17.
WU Jinhui, TAO Yourui. Review on research status of positioning accuracy reliability of industrial robots[J]. China Mechanical Engineering, 2020, 31(18):9-17.
[3] 宫思远, 赵子越, 刘倩頔. 工业机器人校准技术与补偿方法发展现状及趋势[J]. 计测技术, 2021, 41(3):1-8.
GONG Siyuan, ZHAO Ziyue, LIU Qiandi. Development status and trend of industrial robot calibration technology and compensation method[J]. Metrology & Measurement Technology, 2021, 41(3):1-8.
[4] 乔贵方, 吕仲艳, 张颖, 等. 基于BAS-PSO算法的机器人定位精度提升[J]. 光学精密工程, 2021, 29(4):763-771.
QIAO Guifang, LÜ Zhongyan, ZHANG Ying, et al. Improvement of robot kinematic accuracy based on BAS-PSO algorithm[J]. Optics and Precision Engineering, 2021, 29(4):763-771.
doi: 10.37188/OPE.20212904.0763
[5] 周星, 黄石峰, 朱志红. 六关节工业机器人TCP标定模型研究与算法改进[J]. 机械工程学报, 2019, 55(11): 186-196.
doi: 10.3901/JME.2019.11.186
ZHOU Xing, HUANG Shifeng, ZHU Zhihong. TCP calibration model research and algorithm improvement of six joint industrial robot[J]. Journal of Mechanical Engineering, 2019, 55(11):186-196.
doi: 10.3901/JME.2019.11.186
[6] 刘汉邦, 李新荣, 刘立东. 服装面料自动抓取转移方法的研究进展[J]. 纺织学报, 2021, 42(1):7-13.
LIU Hanbang, LI Xinrong, LIU Lidong. Research progress of automatic grabbing and transfer methods for garment fabrics[J]. Journal of Textile Research, 2021, 42(1):7-13.
doi: 10.1177/004051757204200102
[7] 田鹏飞, 杨树明, 吴孜越, 等. 结合精度补偿的机器人优化手眼标定方法[J]. 西安交通大学学报, 2020, 54(8): 99-106.
TIAN Pengfei, YANG Shuming, WU Ziyue, et al. An optimal hand-eye calibration method for robots based on precision compensation[J]. Journal of Xi'an Jiaotong University, 2020, 54(8):99-106.
[8] 倪华康, 杨泽源, 杨一帆, 等. 考虑基坐标系误差的机器人运动学标定方法[J]. 中国机械工程, 2022, 33(6): 647-655.
NI Huakang, YANG Zeyuan, YANG Yifan, et al. Robot kinematics calibration method considering base frame error[J]. China Mechanical Engineering, 2022, 33(6): 647-655.
[9] 梅江平, 孙思嘉, 罗振军, 等. 基于单维拉线测量系统的码垛机器人定位误差分析及运动学标定[J]. 天津大学学报, 2018, 51(7):748-754.
MEI Jiangping, SUN Sijia, LUO Zhenjun, et al. Positioning error analysis and kinematic calibration of robot palletizer based on one-dimensional cable measurement system[J]. Journal of Tianjin University, 2018, 51(7):748-754.
[10] 谢习华, 李智勇, 周烜亦, 等. 机械臂运动学标定技术发展概况[J]. 宇航计测技术, 2018, 38(6):25-32.
XIE Xihua, LI Zhiyong, ZHOU Xuanyi, et al. Review on kinematics calibration technology of manipulator[J]. Journal of Astronautic Metrology and Measurement, 2018, 38(6):25-32.
[11] 杜泽峰, 王晗, 刘湛基, 等. 基于粒子群算法的拉线位移传感器三维坐标测量[J]. 组合机床与自动化加工技术, 2017(11):84-87.
DU Zefeng, WANG Han, LIU Zhanji, et al. Three-dimensional coordinate measurement of cable displacement sensor based on particle swarm optimization[J]. Modular Machine Tool & Automatic Manufacturing Technique, 2017(11):84-87.
[12] 陈宵燕, 张秋菊, 孙沂琳. 串联机器人多模式标定与刚柔耦合误差补偿方法研究[J]. 农业机械学报, 2019, 50(3): 396-403.
CHEN Xiaoyan, ZHANG Qiuju, SUN Yilin. Multi-mode calibration and rigid-flexible coupling error compensation method of serial Robot[J]. Transactions of the Chinese Society for Agricultural Machinery, 2019, 50(3):396-403.
[1] SHI Weimin, HAN Sijie, TU Jiajia, LU Weijian, DUAN Yutang. Empty yarn bobbin positioning method based on machine vision [J]. Journal of Textile Research, 2023, 44(11): 105-112.
[2] CHEN Taifang, ZHOU Yaqin, WANG Junliang, XU Chuqiao, LI Dongwu. Online detection of yarn breakage based on visual feature enhancement and extraction [J]. Journal of Textile Research, 2023, 44(08): 63-72.
[3] JI Yue, PAN Dong, MA Jiedong, SONG Limei, DONG Jiuzhi. Yarn tension non-contacts detection system on string vibration based on machine vision [J]. Journal of Textile Research, 2023, 44(05): 198-204.
[4] TAO Jing, WANG Junliang, XU Chuqiao, ZHANG Jie. Feature extraction method for ring-spun-yarn evenness online detection based on visual calibration [J]. Journal of Textile Research, 2023, 44(04): 70-77.
[5] GU Bingfei, ZHANG Jian, XU Kaiyi, ZHAO Songling, YE Fan, HOU Jue. Human contour and parameter extraction from complex background [J]. Journal of Textile Research, 2023, 44(03): 168-175.
[6] WANG Bin, LI Min, LEI Chenglin, HE Ruhan. Research progress in fabric defect detection based on deep learning [J]. Journal of Textile Research, 2023, 44(01): 219-227.
[7] JIN Shoufeng, HOU Yize, JIAO Hang, ZHNAG Peng, LI Yutao. An improved AlexNet model for fleece fabric quality inspection [J]. Journal of Textile Research, 2022, 43(06): 133-139.
[8] ZHOU Qihong, PENG Yi, CEN Junhao, ZHOU Shenhua, LI Shujia. Yarn breakage location for yarn joining robot based on machine vision [J]. Journal of Textile Research, 2022, 43(05): 163-169.
[9] LÜ Wentao, LIN Qiqi, ZHONG Jiaying, WANG Chengqun, XU Weiqiang. Research progress of image processing technology for fabric defect detection [J]. Journal of Textile Research, 2021, 42(11): 197-206.
[10] WU Liubo, LI Xinrong, DU Jinli. Research progress of motion trajectory planning of sewing robot based on contour extraction [J]. Journal of Textile Research, 2021, 42(04): 191-200.
[11] TIAN Yuhang, WANG Shaozong, ZHANG Wenchang, ZHANG Qian. Rapid detection method of single-component dye liquor concentration based on machine vision [J]. Journal of Textile Research, 2021, 42(03): 115-121.
[12] FENG Wenqian, LI Xinrong, YANG Shuai. Research progress in machine vision algorithm for human contour detection [J]. Journal of Textile Research, 2021, 42(03): 190-196.
[13] ZHU Shigen, YANG Hongxian, BAI Yunfeng, DING Hao, ZHU Qiaolian. Investigation on automatic deformation inspection system of long and thin parts with hooks [J]. Journal of Textile Research, 2020, 41(10): 158-163.
[14] ZHANG Jianxin, LI Qi. Online cheese package yarn density detection system based on machine vision [J]. Journal of Textile Research, 2020, 41(06): 141-146.
[15] LU Hao, CHEN Yuan. Surface defect detection method of carbon fiber prepreg based on machine vision [J]. Journal of Textile Research, 2020, 41(04): 51-57.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!