<p>Traditional Partial Least Squares Regression (PLSR) aims to establish a linear relationship between independent and dependent variables. It will convert the original data into one-dimensional vectors, thus destroying the structural information of the data and generating dimensional catastrophes. To address these limitations, this paper proposes a novel model CNNM2DPLSR called Two-Dimensional Partial Least Squares Regression (2DPLSR) with Manifold Optimization based Convolutional Neural Network (CNN). Firstly, deep features are extracted from the original data using CNN, which are taken as the new independent variables. To retain the structural information of the data, after performing bilateral dimensionality reduction on the independent variables, the resulting low-dimensional features are multiplied by the dependent variable to maximize the inner product, thereby obtaining the bilateral dimensionality reduction matrix. Finally, an objective function for the model is constructed and undergoes a detailed derivation process. Given that the dimensionality reduction matrix satisfies the column orthogonality constraints, the manifold optimization approach is operated in this model to obtain more accurate numerical solutions. Experimental results on various datasets show that the proposed method has lower classification error rates and better adaptability than other representative methods.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Two-dimensional PLSR with manifold optimization based CNN for image classification

  • Haoran Chen,
  • Kai Wu,
  • Wenjun Song,
  • Hongwei Tao,
  • Zuhe Li,
  • Xiao Li,
  • Yanan Du

摘要

Traditional Partial Least Squares Regression (PLSR) aims to establish a linear relationship between independent and dependent variables. It will convert the original data into one-dimensional vectors, thus destroying the structural information of the data and generating dimensional catastrophes. To address these limitations, this paper proposes a novel model CNNM2DPLSR called Two-Dimensional Partial Least Squares Regression (2DPLSR) with Manifold Optimization based Convolutional Neural Network (CNN). Firstly, deep features are extracted from the original data using CNN, which are taken as the new independent variables. To retain the structural information of the data, after performing bilateral dimensionality reduction on the independent variables, the resulting low-dimensional features are multiplied by the dependent variable to maximize the inner product, thereby obtaining the bilateral dimensionality reduction matrix. Finally, an objective function for the model is constructed and undergoes a detailed derivation process. Given that the dimensionality reduction matrix satisfies the column orthogonality constraints, the manifold optimization approach is operated in this model to obtain more accurate numerical solutions. Experimental results on various datasets show that the proposed method has lower classification error rates and better adaptability than other representative methods.