Cross-Modality Feature Learning Through Generic Hierarchical Hyperlingual-Words
MetadataShow full item record
Recognizing facial images captured under visible light has long been discussed in the past decades. However, there are many impact factors that hinder its successful application in real-world, e.g., illumination, pose variations. Recent work has concentrated on different spectrals, i.e., near infrared, that can only be perceived by specifically designed device to avoid the illumination problem. However, this inevitably introduces a new problem, namely, cross-modality classification. In brief, images registered in the system are in one modality, while images that captured momentarily used as the tests are in another modality. In addition, there could be many within-modality variations— pose and expression—leading to a more complicated problem for the researchers. To address this problem, we propose a novel framework called hierarchical hyperlingual-words (Hwords) in this paper. First, we design a novel structure, called generic Hwords, to capture the high-level semantics across different modalities and within each modality in weakly supervised fash- ion, meaning only modality pair and variations information are needed in the training. Second, to improve the discriminative power of Hwords, we propose a novel distance metric through the hierarchical structure of Hwords. Extensive experiments on multimodality face databases demonstrate the superiority of our method compared with the state-of-the-art works on face recognition tasks subject to pose and expression variations.
IEEE Transactions on Neural Networks and Learning SystemsThe article of record as published may be found at http://dx.doi.org/10.1109/tnnls.2016.2517014
RightsCopyright is reserved by the copyright owner.
Showing items related by title, author, creator and subject.
Chew, Heng Hui. (Monterey, California. Naval Postgraduate School, 2006-12);The integrated mobile alert system (IMAS) is a mobile device messaging system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. It was developed ...
McCarthy, Mitchell J. (Monterey, California. Naval Postgraduate School, 2021-09); NPS-DRMI-21-001In this digital age, the debate between the instructional efficacy of reading medium, digital versus print, continues. Regardless of the debate points, the print medium continues to reign as the superior of the two in ...
The design and implemtation of a prototype web-portal for the integrated mobile alerting system (IMAS). Hsu, Michael. (Monterey, California. Naval Postgraduate School, 2006-06);The Integrated Mobile Alert System (IMAS) is a mobile device message alerting system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. The focus ...