Inferring depictions in natural-language captions for efficient access to picture data
Rowe, Neil C.
MetadataShow full item record
Multimedia data can require significant examination time to find desired features ("content analysis"). An alternative is using natural-language captions to describe the data, and matching captions to English queries. But it is hard to include everything in the caption of a complicated datum, so significant content analysis may still seem required. We discuss linguistic clues in captions, both syntactic and semantic, that can simplify or eliminate content analysis. We introduce the notion of concept depiction and rules for depiction inference. Our approach is implemented in an expert system which demonstrated significant increases in recall in experiments.
Approved for public release; distribution is unlimited.This paper appeared in: Information Processing and Management, 30, no. 3 (1994), 379-388.
NPS Report NumberNPS-CS-93-007
Showing items related by title, author, creator and subject.
Rowe, Neil C.; Guglielmo, Eugene J. (Monterey, California. Naval Postgraduate School, 1992-07); NPS-CS-92-011Descriptive natural-language captions can help organize multimedia data. We described our MARIE system that interprets English queries directing the fetch of media objects. it is novel in the extent to which it exploits ...
Rowe, Neil C. (Monterey, California. Naval Postgraduate School, 2004);We survey research on using captions in data mining from the Web. Captions are text that describes some other information (typically, multimedia). Since text is considerably easier to index and manipulate than non-text ...
Exploiting Captions for Multimedia Data Mining / Chapter in Encyclopedia of Multimedia Technology and Networking Rowe, Neil C. (Monterey, California. Naval Postgraduate School, 2005);Captions are essential accompaniments to multimedia data objects as a way to facilitate their data mining. This article describes the kinds of possible captions and the task of recognizing them. It then discusses the forms ...