Investigation of feature dimension reduction schemes for classification applications
Fargues, Monique P.
MetadataShow full item record
Extracting relevant features that allow for class discrimination is the first critical step in classification applications. However, this step often leads to high-dimensional feature spaces, which requires large datasets to create viable classification schemes. As a result, there is a strong incentive to reduce the feature space dimension. Two classical types of approaches to reduce feature dimension exist Principal Component Analysis (PCA)-based or discriminant-based approaches. The main difference between the two types lies in the criterion selected; PCA-based schemes seek a projection direction which bests represents the data in a norm sense, while discriminant-based schemes seek a projection that best separates the class data. This study presents a comparison of three discriminant-based feature dimension reduction schemes: the Mean Separator Neural Network (MSNN), the Mahalanobis-based Dimension Reduction scheme (MBDR), and the kernel-based Generalized Discriminant Analysis (GDA) approach. PCA is included for comparison purposes as it is also widely used in classification applications. All four feature dimension reduction schemes are implemented and evaluated by applying the transformed features to a basic minimum distance classifier. Three classification datasets commonly used in statistics for benchmarking purposes are selected to compare the schemes and results discussed Results show the kernel-based generalized discriminant analysis approach to lead to consistently higher classification performances than the other schemes considered in the study for the data investigated.
NPS Report NumberNPS-EC-01-005
Showing items related by title, author, creator and subject.
Duzenli, Ozhan (Monterey, California. Naval Postgraduate School, 1998-06);This thesis investigates the application of wavelet decompositions to classification applications. Two feature extraction tools are considered: Local Discriminant Bases scheme (LDB) and Power method. Several dimension ...
Lee, Colin K. (Monterey, California. Naval Postgraduate School, 2004);This study continues a previous face recognition investigation using uncooled infrared technology. The database developed in an earlier study is further expanded to include 50 volunteers with 30 facial images from each ...
Benveniste, Steven M. (Monterey, California. Naval Postgraduate School, 2010);The development of the Internet has resulted in a rapid explosion of information available on the Web. In addition, the speed and anonymity of internet media "publishing" make this medium ideal for rapid dissemination of ...