Journal of Textile Research ›› 2019, Vol. 40 ›› Issue (04): 158-164.doi: 10.13475/j.fzxb.20180504707

• Management & Information • Previous Articles     Next Articles

Depth learning method for suit detection in images

LIU Zhengdong1(), LIU Yihan2, WANG Shouren3   

  1. 1. Fashion Accessory Art and Engineering College, Beijing Institute of Fashion Technology, Beijing 100029, China
    2. Information Department, Beijing University of Technology, Beijing 100124, China
    3. College of Computer Scienceand Electronic Engineering, Hunan University, Changsha, Hunan 410082, China
  • Received:2018-05-21 Revised:2019-01-08 Online:2019-04-15 Published:2019-04-16

Abstract:

In order to classify and detect the suit target in images of e-commerce platform accurately and quickly, an enhanced deep convolution network (DN-SSD) was proposed. First, three main frameworks faster region-convolutional networks (faster R-CNN), region-based fully convolution network(R-FCN) and single shot muti-box detection(SSD) were evaluated. An image was segmented into multiscale sub-images to highlight the suit target based on the SSD. Secondly, the problem of small target recognition was solved by the fusion of classification. The scene adaptability was enhanced by increasing number of negative samples. The experimental result shows that the algorithm can recognize various shapes and size of suit targets and achieves the accuracy over 90%. The method can also be generalized to other style of dress detection and location.

Key words: clothing recognition, target detection, deep convolution neural network, deep learning, single shot muti-box detection

CLC Number: 

  • TP391.9

Tab.1

Comparison of suit recognition by three methods"

学习
架构
特征抽
取器
训练时
间/h
召回
率/%
精确
率/%
识别时
间/ms
Faster R-CNN ResNet-101 102 68.80 88.12 565
R-FCN ResNet-101 96 73.76 82.22 667
SSD Inception V3 71 72.22 87.64 327

Fig.1

SSD framework"

Fig.2

Pyramid feature extraction"

Fig.3

Inter section over union"

Fig.4

Failure cases. (a)Target failure; (b)Target loss; (c)Target overlap"

Fig.5

Usual dress forms to suit. (a)With a tie;(b)With a bow tie; (c)No tie; (d)Not fasten"

Fig.6

Labeling target box. (a)Box of tie; (b)Box of bow tie"

Fig.7

Recognition process of DN-SSD"

Fig.9

Detection results. (a)Single target detection 1; (b)Single target detection 2; (c)Multi target detection; (d)Small target detection"

Fig.8

Curve of loss function value in training process"

[1] 纪娟, 秦珂, 杨若瑜. 基于HOG和几何特征的服装细节要素识别与分类[J]. 图学学报, 2016,37(1):84-90.
JI Juan, QIN Ke, YANG Ruoyu. Classification of the detail features for clothes based on HOG and geometric features[J]. Journal of Graphics, 2016,37(1):84-90.
[2] 魏芬, 刘建平, 徐松松, 等. 基于多特征值的服装检测与识别算法[J]. 实验室研究与探索, 2016,35(5):118-122.
WEI Fen, LIU Jianping, XU Songsong, et al. Research on clothing detection and recognition algorithm based on characteristic values[J]. Research and Exploration in Laboratory, 2016,35(5):118-122.
[3] 李东, 万贤福, 汪军. 采用傅里叶描述子和支持向量机的服装款式识别方法[J]. 纺织学报, 2017,38(5):122-127.
LI Dong, WAN Xianfu, WANG Jun. Clothing style recognition approach using Fourier descriptors and support vector machines[J]. Journal of Textile Research, 2017,38(5):122-127.
[4] 李东, 万贤福, 汪军, 等. 基于轮廓曲率特征点的服装款式识别方法[J]. 东华大学学报(自然科学版), 2018(1):1-6.
LI Dong, WAN Xianfu, WANG Jun, et al. Clothing style recognition approach based on the curvature feature points on the contour[J]. Journal of Donghua Univer-sity (Natural Science Edition)>, 2018(1):1-6.
[5] 彭刚, 杨诗琪, 黄心汉, 等. 改进的基于区域卷积神经网络的微操作系统目标检测方法[J]. 模式识别与人工智能, 2018,31(2):142-149.
PENG Gang, YANG Shiqi, HUANG Xinhan, et al. Improved object detection method of micro-operating system based on region convolutional neural network[J]. Pattern Recognition and Artificial Intelligence, 2018,31(2):142-149.
[6] KRIZHENVSHKY A, SUTSKEVER I, HINTON G. Imagenet classification with deep convolutional net-works[C]// Proceedings of the Conference Neural Information Processing Systems (NIPS).[S.l.]: Curran Associates Int, 2012: 1097-1105.
[7] PANG Y, SUN M, JIANG X, et al. Convolution in convolution for network in network[J]. IEEE Transactions on Neural Networks & Learning Systems, 2018,29(5):1587-1597.
doi: 10.1109/TNNLS.2017.2676130 pmid: 28328517
[8] NODA K, YAMAGUCHI Y, NAKADAI K, et al. Audio-visual speech recognition using deep learning[J]. Applied Intelligence, 2015,42(4):722-737.
doi: 10.1007/s10489-014-0629-7
[9] ZHANG K, SUN M, HAN T X, et al. Residual networks of residual networks: multilevel residual networks[J]. IEEE Transactions on Circuits & Systems for Video Technology, 2016(99):1.
[10] 范荣. 基于卷积神经网络的服装种类识别[J]. 现代计算机, 2016(9):29-32.
FAN Rong. Classification of clothing type based on convolutional neural network[J]. Modern Computer, 2016 (9):29-32.
[11] REN S, HE K, GIRSHICK R, et al. Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Mach Intell, 2016,39(6):1137-1149.
[12] HE K M, GKIOXARI G, DOLLAR P, et al. Mask R-CNN[C]// Proceedings of the IEEE International Conference on Computer Vision (ICCV). Venice: IEEE, 2017: 2980-2988.
[13] LIU W, ANGUELOV D, ERHAN D, et al. SSD: single shot multibox detector[C]// Proceedings of European Conference on Computer Vision. Amsterdam: ECCV, 2016: 21-37.
[14] 唐聪, 凌永顺, 郑科栋, 等. 基于深度学习的多视窗SSD目标检测方法[J]. 红外与激光工程, 2018,47(1):290-298.
TANG Cong, LING Yongshun, ZHENG Kedong, et al. Object detection method of multi-view SSD based on deep learning[J]. Infrared and Laser Engineering, 2018,47(1):290-298.
[1] WANG Xiaohua, YAO Weiming, WANG Wenjie, ZHANG Lei, LI Pengfei. Sewing gesture recognition based on improved YOLO deep convolutional neural network [J]. Journal of Textile Research, 2020, 41(04): 142-149.
[2] XU Qian, CHEN Minzhi. Garment grain balance evaluation system based on deep learning [J]. Journal of Textile Research, 2019, 40(10): 191-195.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!