Retrieving Captioned Pictures Using Statistical Correlations and a Theory of Caption-Picture Co-reference
Loading...
Authors
Rowe, Neil C.
Subjects
Advisors
Date of Issue
1995-04
Date
April 1995
Publisher
Monterey, California. Naval Postgraduate School
Language
Abstract
The MARIE project is investigating new methods for efficient information retrieval of captioned multimedia
from multimedia libraries. Captions are essential to understanding multimedia and to finding relevant
examples quickly. Our approach, shared by (Srihari, 1994), is to analyze both the caption and the picture in
advance, then match user English queries to these semantic networks in a way that maximizes retrieval speed.
Our theory and algorithms are being tested on a particular example, 100,000 captions constituting the entire
unclassified portion of the photographic library at NAWC-WD, the U.S. Navy test facility in China Lake,
California, USA (Rowe and Guglielmo, 1993), plus some of the pictures. Our focus is thus on technical
captions and technical pictures that required specialized domain-dependent knowledge to interpret. (Rowe
and Guglielmo, 1993) shows experimental results that confirm that our approach to caption-only processing
gets higher precision for similar recall than a keyphrasematching system for the same application.
Type
Conference Paper
Description
Fourth Annual Symposium on Document Analysis and Retrieval, Las
Vegas, NV, April 1995.
Series/Report No
Department
Computer Science (CS)
Organization
Identifiers
NPS Report Number
Sponsors
This work was sponsored by DARPA as part of the I3 Project under AO 8939.
Funder
This work was sponsored by DARPA as part of the I3 Project under AO 8939.
Format
Citation
Distribution Statement
Approved for public release; distribution is unlimited.