Journal of Textile Research ›› 2023, Vol. 44 ›› Issue (10): 134-142.doi: 10.13475/j.fzxb.20220707701

• Apparel Engineering • Previous Articles     Next Articles

Similarity pattern matching technology based on garment structural feature recognition

LIU Rong, XIE Hong()   

  1. School of Textiles and Fashion, Shanghai University of Engineering Science, Shanghai 201620, China
  • Received:2022-07-21 Revised:2023-06-09 Online:2023-10-15 Published:2023-12-07

Abstract:

Objective From the perspective of intelligent pattern making, the closest pattern in the pattern library is matched by the identification of the garment style drawings and new patterns can be developed based on that pattern. This method of pattern making makes maximum use of existing pattern information and simplifies the structure drawing process of the pattern. In order to achieve similarity matching from garment style drawings to patterns, a pattern matching technique based on garment structural feature recognition is proposed.

Method The implementation of this technique consists of two main parts. The first is category label design, where certain structural features in the flat style drawing are defined and multi-label categories are set according to the definition according to the knowledge of women's trouser structural drawing. Then the multi-label categories were transformed into single-label multi-categories, and the link between the flat style diagram, structural features and the pattern was established. Finally, examining the correlation between the labels, the final labels for the experiment were designed. The second part is the model validation. In this part of work, the apparel dataset was established, which took the women's trousers flat style drawing as the sample. Then the AlexNet network was improved in the experiment. These changes mainly include simplifying the network structure and adding batch normalization operations after each convolutional layer.

Results In the process of label design, 18 categories of women's trousers were set through data visualization analysis and the study of correlations between labels. One of the results of the model testing shows the model converges faster after adding the batch normalization after the convolution layer (Fig. 10 and Tab. 4). The recognition accuracy is higher, with the highest recognition accuracy achieved by adding four layers of batch normalization. Second, it can be seen that the final training accuracy of the model tends to be stable around 99% (Fig. 8). The accuracy of the improved model on the validation set is 83.4%, and the recall and F1 values are 0.834 and 0.835, respectively. Third, the accuracy of the improved model is 6.7% higher than that of the original AlexNet model and 6% and 3.6% higher than that of the ResNet18 and VGG11 models, respectively (Fig. 11, Tab. 5). The number of model parameters is also less than that of the original model.

Conclusion In this paper, the identification of structural features and matching of similar patterns is achieved by defining 18 structural features in the silhouette, waist position, waist shape, waist process and hip circumference, and using them as similarity representations of the pattern, constructing a model using the garment style drawings as input. The experimental research has certain value and significance to the intelligent pattern making of garments. In the process of label design, through the visual analysis of data and the study of the correlation between labels, invalid labels can be eliminated and label categories can be set reasonably, which can improve the problem of uneven data distribution in label categories and improve the utilization rate of data; In the process of model validation, by improving the structure of the original AlexNet model and introducing batch normalization operation in the convolution layer, the convergence speed of the model can be speed up and the recognition accuracy of the model be increased.

Key words: garment structure characteristic, pattern matching, multi-label classification, garment dataset, AlexNet neural network, garment pattern making

CLC Number: 

  • TS941.2

Fig. 1

Diagrammatic representation of relationship between style drawings, structural features and samples"

Fig. 2

Flowchart for categorizing stuctural characteristic of women's pants"

Tab. 1

Classification of structural characteristics of women's pants"

标签名 标签属性 类别 代号
廓形 全局 紧身裤、直筒裤、喇叭裤、
锥形裤、萝卜裤、阔腿裤
Kn
腰位 全局 高腰、中腰、低腰 Wm
腰部工艺 局部 拉链、松紧 Mp
腰部造型 局部 有省道、有褶裥、较多褶裥、无 Dq
臀围 全局 合体臀、较宽松臀、宽松臀 Hk

Fig. 3

Distribution of other structural labels in silhouette labels"

Tab. 2

Structural similarity calculation for different profile features"

代号 欧氏距离
K1 K2 K3 K4 K5 K6
K1 0 83.7 20.4 72.0 155.0 118.9
K2 83.9 0 70.8 36.2 98.8 58.8
K3 20.4 70.8 0 56.9 141.8 103.0
K4 72.0 36.2 56.9 0 114.1 64.2
K5 155.0 98.8 141.8 114.1 0 59.2
K6 118.9 58.8 103.0 64.2 59.2 0

Fig. 4

Results of experimental label design"

Tab. 3

Parameters of improved model"

网络层 卷积核
大小
步长 边界填
充值
输出图
像大小
参数
总量
Input 256×512×3
Conv-1 11×11 4 2 63×127×64 23 296
BatchNorm1 63×127×64 128
Maxpool1 3×3 2 0 31×63×64
Conv-2 5×5 1 2 31×63×192 307 392
BatchNorm2 31×63×192 384
Maxpool2 3×3 2 0 15×31×192
Conv-3 3×3 1 1 15×31×384 663 936
BatchNorm3 15×31×384 768
Maxpool3 3×3 2 0 7×15×384
Conv-4 3×3 1 1 7×15×256 884 992
BatchNorm4 7×15×256 512
Maxpool4 3×3 2 0 3×7×256
FC-1 输出概率Dropout rate 0.5
输出概率Dropout rate 0.5
1 024 5 506 048
FC-2 1 024 1 049 600
Softmax 18 18 450

Fig. 5

Improved network model"

Fig. 6

Flowchart for structural feature identification of women's trousers"

Fig. 7

Data augmentation. (a) Original image; (b) Horizontal flip;(c) Contrast enhancement; (d) Darker;(e) Brighter enhancement; (f) Salt and pepper noise"

Fig. 8

Training validation accuracy graph of improved model"

Fig. 9

Accuracy of different categories"

Fig. 10

Loss function diagram for different layers of BN"

Tab. 4

Accuracy of model after different BN operations"

BN层数 方法 准确率/%
0 80.7
1 Covn-4 83.3
2 Covn-1、Covn-4 82.8
3 Covn-1、Covn-3、Covn-4 83.0
4 Covn-1、Covn-2、Covn-3、Covn-4 83.4

Fig. 11

Accuracy of different models in different categories"

Tab. 5

Accuracy of different models"

模型 准确率/% 模型参数量/MB
ResNet18 77.4 42.7
VGG11 79.8 492
原AlexNet 76.7 217
本文模型 83.4 96.8

Fig. 12

Analysis of error-prone categories"

[1] 刘丹. 女式衬衣款式图到结构图的智能转换研究[D]. 西安: 西安工程大学, 2015: 2-5.
LIU Dan. Study on the intelligent conversion of blouse technical drawing to structure drawing[D]. Xi'an: Xi'an Polytechnic University, 2015: 2-5.
[2] 周幸子. 连衣裙款式图的识别和样板的自动生成研究[D]. 上海: 东华大学, 2021: 5-9.
ZHOU Xingzi. Study of recognition of dress design sketch and automatic pattern generation[D]. Shanghai: Donghua University, 2021: 5-9.
[3] 李涛, 杜磊, 黄振华, 等. 服装款式图识别与样板转换技术研究进展[J]. 纺织学报, 2020, 41(8): 145-151.
LI Tao, DU Lei, HUANG Zhenhua, et al. Review on pattern conversion technology based on garment flat recognition[J]. Journal of Texitile Research, 2020, 41(8): 145-151.
[4] 徐增波, 张玲, 张艳红, 等. 基于复杂网络提取和支持向量机模型分类的服装领型研究[J]. 纺织学报, 2021, 42(6): 146-152.
XU Zengbo, ZHANG Ling, ZHANG Yanhong, et al. Research on clothing collar types based on complex network extraction and support vector machine classification[J]. Journal of Texitile Research, 2021, 42(6): 146-152.
[5] LECUN Y, BOTTOU L, BENGIO Y, et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 1998, 86(11): 2278-2324.
doi: 10.1109/5.726791
[6] 江慧, 马彪. 基于服装风格的款式相似度算法[J]. 纺织学报, 2021, 42(11): 129-136.
JIANG Hui, MA Biao. Style similarity algorithm based on clothing style[J]. Journal of Textile Research, 2021, 42(11): 129-136.
[7] MA J, ZHANG H, CHOW T W S. Multilabel classification with label-specific features and classifiers: a coarse and fine tuned framework[J]. IEEE Transactions on Cybernetics, 2021, 51(2): 1028-1042.
doi: 10.1109/TCYB.6221036
[8] 夏明, 宋婧, 姜朝阳, 等. 基于连衣裙结构特征匹配的款式识别技术[J]. 纺织学报, 2020, 41(7): 141-146.
XIA Ming, SONG Jing, JIANG Zhaoyang, et al. Style recognition technique based on feature matching in dress construction[J]. Journal of Texitile Research, 2020, 41(7): 141-146.
[9] 周慧颖, 汪廷华, 张代俐. 多标签特征选择研究进展[J]. 计算机工程与应用, 2022(6): 1-22.
ZHOU Huiying, WANG Tinghua, ZHANG Daili. Research progress of multi-label feature selection[J]. Computer Engineering and Applications, 2022(6): 1-22.
[10] SUN Z, LIU X, HU K, et al. An efficient multi-label SVM classification algorithm by combining approximate extreme points method and divide-and-conquer stra-tegy[J]. IEEE Access, 2020, 8: 170967-170975.
doi: 10.1109/Access.6287639
[11] 武红鑫, 韩萌, 陈志强, 等. 监督和半监督学习下的多标签分类综述[J]. 计算机科学, 2022, 49(8): 12-25.
doi: 10.11896/jsjkx.210700111
WU Hongxin, HAN Meng, CHEN Zhiqiang, et al. Survey of multi-label classification based on supervised and semi-supervised learning[J]. Computer Science, 2022, 49(8): 12-25.
doi: 10.11896/jsjkx.210700111
[12] SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognit-ion[J]. Proceedings of the IEEE, 2014, 66(11): 1556-1568.
[13] SZEGEDY C, LIU W, JIA Y, et al. Going deeper with convolutions[C]// Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. Boston: IEEE, 2015: 1-9.
[14] IOFFE S, SZEGEDY C. Batch normalization: accelerating deep network training by reducing internal covariate shift[C]// Proceedings of International Conference on Machine Learning. France:[s.n.], 2015: 1-20.
[15] 吴晨芳, 杨世锡, 黄海舟, 等. 一种基于改进的LeNet-5模型滚动轴承故障诊断方法研究[J]. 振动与冲击, 2021, 40(12): 55-61.
WU Chenfang, YANG Shixi, HUANG Haizhou, et al. An improved fault diagnosis method of rolling bearings based on LeNet-5[J]. Journal of Vibration and Shock, 2021, 40(12): 55-61.
[1] SUN Yue, ZHOU Lingfang, ZHOU Qixuan, ZHANG Shichen, YICK Kit-lun. Finite element analysis of supportive performance and dynamic comfort of sports bra [J]. Journal of Textile Research, 2023, 44(09): 180-187.
[2] ZHANG Aidan, GUO Zhenni. Jacquard fabric design of special-structure dot patterns and its grayscale simulation characteristics [J]. Journal of Textile Research, 2023, 44(09): 68-74.
[3] ZHAO Wenhao, XIANG Jun, ZHANG Ning, PAN Ruru. Research on fabric pattern retrieval based on SURF and VLAD feature coding [J]. Journal of Textile Research, 2023, 44(08): 110-117.
[4] REN Ze, ZHONG Anhua. Digital pattern making of underwear based on NURBS surface model of male waist, hip and crotch [J]. Journal of Textile Research, 2023, 44(08): 167-173.
[5] LIU Yongmei, LIU Siyi, YU Xiaokun, XUE Huixin, ZHANG Xianghui. Body shape characteristics and classification of middle-aged and elderly women in eastern China [J]. Journal of Textile Research, 2023, 44(07): 184-191.
[6] YAN Benchao, PAN Ruru, ZHOU Jian, WANG Lei, WANG Xiaohu. Real-time detection of fabric defects based on use of improved Itti salient model [J]. Journal of Textile Research, 2023, 44(07): 95-102.
[7] YE Qinwen, WANG Zhaohui, HUANG Rong, LIU Huanhuan, WAN Sibang. Application of virtual garment transfer in garment customization [J]. Journal of Textile Research, 2023, 44(06): 183-190.
[8] XU Han, SHEN Lei, CHEN Han. Application of Julia fractal set on design of Adras dress pattern [J]. Journal of Textile Research, 2023, 44(06): 191-199.
[9] ZHOU Jiu, HU Yili. Design and application of equal float length on full-color weave in triple-weft jacquard fabric structures [J]. Journal of Textile Research, 2023, 44(06): 78-84.
[10] GU Liwen, RUAN Yanwen, LI Hao. Clothing development based on flexible selective laser sintering 3D printing technology [J]. Journal of Textile Research, 2023, 44(04): 154-164.
[11] DENG Kehui, WEI Yilin. Virtual restoration of ancient costumes based on 3-D costume modeling technology [J]. Journal of Textile Research, 2023, 44(04): 179-186.
[12] HU Yili, ZHOU Jiu. Influence of starting point setting of triple-weft compound structure on woven fabric color display [J]. Journal of Textile Research, 2023, 44(04): 78-85.
[13] LIU Junping, ZHANG Fuhong, HU Xinrong, PENG Tao, LI Li, ZHU Qiang, ZHANG Junjie. Personalized clothing matching recommendation based on multi-modal fusion [J]. Journal of Textile Research, 2023, 44(03): 176-186.
[14] XIAO Boxiang, LIU Zhengdong, GUO Yucheng, WANG Yuanxia. Shirt pattern generating method based on 3-D human scanning model [J]. Journal of Textile Research, 2022, 43(12): 151-159.
[15] JIA Jing, CAO Jingwen, XU Pinghua, LIN Ruibing, SUN Xiaowan. Automatic coloration of clothing pattern based on color parsing of Peking Opera masks [J]. Journal of Textile Research, 2022, 43(12): 160-166.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!