Cross-Modality Feature Learning Through Generic Hierarchical Hyperlingual-Words
Abstract
Recognizing facial images captured under visible light has long been discussed in the past decades. However, there are many impact factors that hinder its successful application in real-world, e.g., illumination, pose variations. Recent work has concentrated on different spectrals, i.e., near infrared, that can only be perceived by specifically designed device to avoid the illumination problem. However, this inevitably introduces a new problem, namely, cross-modality classification. In brief, images registered in the system are in one modality, while images that captured momentarily used as the tests are in another modality. In addition, there could be many within-modality variations— pose and expression—leading to a more complicated problem for the researchers. To address this problem, we propose a novel framework called hierarchical hyperlingual-words (Hwords) in this paper. First, we design a novel structure, called generic Hwords, to capture the high-level semantics across different modalities and within each modality in weakly supervised fash- ion, meaning only modality pair and variations information are needed in the training. Second, to improve the discriminative power of Hwords, we propose a novel distance metric through the hierarchical structure of Hwords. Extensive experiments on multimodality face databases demonstrate the superiority of our method compared with the state-of-the-art works on face recognition tasks subject to pose and expression variations.
Description
IEEE Transactions on Neural Networks and Learning Systems
The article of record as published may be found at http://dx.doi.org/10.1109/tnnls.2016.2517014
Rights
Copyright is reserved by the copyright owner.Collections
Related items
Showing items related by title, author, creator and subject.
-
A secure alert system
Chew, Heng Hui. (Monterey, California. Naval Postgraduate School, 2006-12);The integrated mobile alert system (IMAS) is a mobile device messaging system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. It was developed ... -
The design and implemtation of a prototype web-portal for the integrated mobile alerting system (IMAS).
Hsu, Michael. (Monterey, California. Naval Postgraduate School, 2006-06);The Integrated Mobile Alert System (IMAS) is a mobile device message alerting system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. The focus ... -
An analytic model of coordinated effort with application to the problem of surveillance C3
Moose, Paul H.; Harrison, Don Edward (Monterey, California. Naval Postgraduate School, 1979-05); NPS-61-79-008In this work, a two-level surveillance system is studied. A cybernetic model is developed from which an ergodic Markov process model and the characteristic entropy function are determined. Computer simulation results are ...