Abstract: Aiming at the present situation of lacking of mature model for fabric feature and not better recognition effect, this paper proposes a new feature model of fabric image, called as “enhanced matrix feature model”. Firstly, this model introduces a new enhanced matrix based on image gray. Secondly, this matrix is made of matrix operators generated by gradient variation of fabric image, which can do transform calculation for pixel value to amply or reduce local characteristic of image to make image feature obvious. Finally, we compile some program to verify this model using MATLAB7.0, and we find this model is suitable for defect feature recognition of fabric and recognition effect is better. With this model, feature change in defect regions is enhanced obviously. Therefore, a new theoretical basis of defect recognition of fabric is provided in this paper.