Cross-Modality Feature Learning Through Generic Hierarchical Hyperlingual-Words
MetadataShow full item record
Recognizing facial images captured under visible light has long been discussed in the past decades. However, there are many impact factors that hinder its successful application in real-world, e.g., illumination, pose variations. Recent work has concentrated on different spectrals, i.e., near infrared, that can only be perceived by specifically designed device to avoid the illumination problem. However, this inevitably introduces a new problem, namely, cross-modality classification. In brief, images registered in the system are in one modality, while images that captured momentarily used as the tests are in another modality. In addition, there could be many within-modality variations— pose and expression—leading to a more complicated problem for the researchers. To address this problem, we propose a novel framework called hierarchical hyperlingual-words (Hwords) in this paper. First, we design a novel structure, called generic Hwords, to capture the high-level semantics across different modalities and within each modality in weakly supervised fash- ion, meaning only modality pair and variations information are needed in the training. Second, to improve the discriminative power of Hwords, we propose a novel distance metric through the hierarchical structure of Hwords. Extensive experiments on multimodality face databases demonstrate the superiority of our method compared with the state-of-the-art works on face recognition tasks subject to pose and expression variations.
IEEE Transactions on Neural Networks and Learning SystemsThe article of record as published may be found at http://dx.doi.org/10.1109/tnnls.2016.2517014
Showing items related by title, author, creator and subject.
The design and implemtation of a prototype web-portal for the integrated mobile alerting system (IMAS). Hsu, Michael. (Monterey, California. Naval Postgraduate School, 2006-06);The Integrated Mobile Alert System (IMAS) is a mobile device message alerting system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. The focus ...
Chew, Heng Hui. (Monterey, California. Naval Postgraduate School, 2006-12);The integrated mobile alert system (IMAS) is a mobile device messaging system that provides a means for people to stay connected and receive information in a modality that is constantly available to them. It was developed ...
The effects of fatigue on position determination and cognitive workload using a visual and 3-dimensional auditory display Brown, Eric L. (Monterey, California. Naval Postgraduate School, 2004-06);This study compares the effects of a visual and a 3-dimensional auditory display on primary and secondary task performance, mood, and mental workload at incremental levels of sleep deprivation. It is based on a study ...