Journal of Textile Research ›› 2021, Vol. 42 ›› Issue (09): 144-149.doi: 10.13475/j.fzxb.20201200406

• Apparel Engineering • Previous Articles     Next Articles

3-D virtual try-on technique based on dynamic feature of body postures

LI Bowen, WANG Ping(), LIU Yuye   

  1. College of Information Science and Technology, Donghua University, Shanghai 201620, China
  • Received:2020-12-02 Revised:2021-05-26 Online:2021-09-15 Published:2021-09-27
  • Contact: WANG Ping E-mail:pingwang@dhu.edu.cn

RichHTML

22

PDF (PC)

149

Abstract:

Aiming at the dynamic perception of personalized postures and the tracking and matching of human body's posture by clothing modeling, this paper established the hierarchical 3-D clothing skeleton points model based on two types of the motion features of the human postures, distinguishing the trunk (global) from the limbs (local), and integrating the clothing model with the body circumferencial features extracted using Kinect camera. In parallel, the global-local singular value decomposition algorithm (GL-SVD) was designed to hierarchically control the deformation of 3-D clothing skeleton model cooperatively. The results from virtual try-on test system show that relative tracking error of the new method is reduced by about 10%, the real-time tracking accuracy and matching precision between the clothing model and the human body is obviously improved. This new technique supports the complex posture (such as leg lifts, lunges) trying-on scenarios of various clothing types such as skirts, pants, tops, and more.

Key words: 3-D virtual try-on, dynamic features of human body, cooperative tracking, hierarchical model of clothing skeleton points, global-local singular value decomposition

CLC Number: 

  • TS942.8

Fig.1

Kinect human skeleton point model"

Fig.2

Clothing skeleton point model"

Tab.1

Personalized human circumference feature"

性别 胸围/cm 腰围/cm 臀围/cm 大腿围/cm
男 93 84 88 34
女 86 72 85 28

Fig.3

Cooperative tracking based on GL-SVD"

Fig.4

Sketch map of projection imaging"

Fig.5

Quaternion rotation diagram"

Fig.6

Schematic design of virtual try-on system"

Tab.2

Testing scenarios for virtual try-on"

场景编号 图序 视角 姿态 服装类型
1 图7(b) 正面 侧抬腿 抹胸裙
2 图7(c) 正面 前抬腿 抹胸裙
3 图8(b) 正面 左右弓步 七分裤
4 图8(c) 正面 前后弓步 七分裤
5 图9(b) 正面 T字型 短袖上衣
6 图9(c) 侧面 站立 短袖上衣

Fig.7

Try-on effect of leg raising posture. (a)3-D Bra skirt; (b)Side leg lift; (c)Front leg lift"

Fig.8

Try-on effect of lunge posture. (a)3-D cropped trousers (b)Left-right lunges; (c)Forward-backward lunges"

Fig.9

Try-on effect of top posture. (a)3-D short sleeve; (b) T-pose; (c)Side"

Fig.10

Avatar try-on effect of other papers. (a)Side leg lift; (b) T-pose"

Fig.11

Tracking accuracy and computing time"

Fig.12

Performance comparison on tracking accuracy"

[1] YU L, ZHONG Y, WANG X. Inpainting-based virtual try-on network for selective garment transfer[J]. IEEE Access, 2019(7):134125-134136.
[2] HSIEH C, CHEN C, CHOU C, et al. Fit-me: image-based virtual try-on with arbitrary poses[C]// 2019 IEEE International Conference on Image Processing. [s.l.]: IEEE, 2019:4694-4698.
[3] LIU T, XU H, ZHANG X. 3-D clothing transfer in virtual fitting based on UV mapping[C]// International Congress on Image and Signal Processing. Beijing:IEEE, 2018:1-5.
[4] 潘博, 钟跃崎. 基于二维图像的三维服装重建[J]. 纺织学报, 2020, 41(4):123-128.
PAN Bo, ZHONG Yueqi. Image-based three-dimensional garment reconstruction[J]. Journal of Textile Research, 2020, 41(4):123-128.
[5] 朱伟明, 谢琴, 彭卉. 男西服数字化智能化量身定制系统研发[J]. 纺织学报, 2017, 38(4):151-157.
ZHU Weiming, XIE Qin, PENG Hui. Research and development of digital intelligent customization system for men's suits[J]. Acta textile Sinica, 2017, 38(4):151-157.
[6] 薛静雅. 基于Kinect的虚拟试衣系统设计[D]. 呼和浩特:内蒙古大学, 2018:12-45.
XUE Jingya. Design of virtual fitting system based on Kinect[D]. Huhhot: Inner Mongolia University, 2018:12-45.
[7] YUAN M, KHAN I R, FARBIZ F, et al. A mixed reality virtual clothes try-on system[J]. IEEE Transactions on Multimedia, 2013, 15(8):1958-1968.
doi: 10.1109/TMM.2013.2280560
[8] YOUSEF K M A, MOHD B J, AL-OMARI M. Kinect-based virtual try-on system: a case study[C]// Jordan International Joint Conference on Electrical Engineering and Information Technology (JEEIT). Amman Jordan: IEEE, 2019:91-96.
[9] 李涛, 冯向阳. 基于加权随机森林算法的虚拟试衣型号推荐技术研究[J]. 智能计算机与应用, 2019, 9(4):116-124.
LI Tao, FENG Xiangyang. Research on virtual fitting model recommendation technology based on weighted random forest algorithm[J]. Intelligent Computer and Application, 2019, 9(4):116-124.
[10] 万燕, 陈林下. 基于Kinect的虚拟试衣相关技术的研究[J]. 智能计算机与应用, 2018, 8(4):63-68.
WAN Yan, CHEN Linxia. Research on virtual fitting technology based on Kinect[J]. Intelligent Computer and Application, 2018, 8(4):63-68.
[11] LI B, HAN C, BAI B. Hybrid approach for human posture recognition using anthropometry and BP neural network based on Kinect V2[J]. EURASIP Journal on Image and Video Processing, 2019, 8(2019):1-4.
[1] PAN Bo, ZHONG Yueqi. Image-based three-dimensional garment reconstruction [J]. Journal of Textile Research, 2020, 41(04): 123-128.
[2] XU Pinghua, MAO Hailin, HUANG Qinqin. Common cognitive evaluation method for fashion visual scenes [J]. Journal of Textile Research, 2019, 40(09): 192-196.
[3] . Display optimizing of retail clothing store based on visual search [J]. JOURNAL OF TEXTILE RESEARCH, 2015, 36(09): 125-128.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
京ICP备14006648号
Copyright 2021 © Editorial office of Journal of Textile Research
Supported by Beijing Magtech Co.Ltd