Exploiting captions in retrieval of multimedia data
Abstract
Descriptive natural-language captions can help organize multimedia data. We described our MARIE system that interprets English queries directing the fetch of media objects. it is novel in the extent to which it exploits previously interpreted and indexed English captions for the media objects. Our routine filtering of queries through descriptively-complex captions (as opposed to keyword lists) before retrieving data can actually improve retrieval speed, as media data are often bulky and time consuming to retrieve, difficult upon which to perform content analysis, and even small improvements to query prevision can often pay off. Handling the English of captions and queries about them is not as difficult as it might seems, as the matching does not require deep understanding, just a comprehensive type hierarchy for caption concepts. An important innovation of MARIE is supercaptions describing sets of captions, which can minimize caption redundancy. Databases, Natural-language, Captions, Multimedia
NPS Report Number
NPS-CS-92-011Related items
Showing items related by title, author, creator and subject.
-
Exploiting Captions for Web Data Mining by Neil C. Rowe
Rowe, Neil C. (Monterey, California. Naval Postgraduate School, 2004);We survey research on using captions in data mining from the Web. Captions are text that describes some other information (typically, multimedia). Since text is considerably easier to index and manipulate than non-text ... -
Intelligent information retrieval for a multimedia database using captions.
Guglielmo, Eugene J. (Monterey, California. Naval Postgraduate School, 1992-09);This report describes an intelligent information retrieval system, MARIE, that employs natural language processing techniques for indexing and retrieving multimedia data. Captions describe photographs from the Naval Air ... -
Overview of Natural Language Processing of Captions for Retrieving Multimedia Data
Guglielmo, Eugene J.; Rowe, Neil C. (Monterey, California. Naval Postgraduate School, 1992);This paper briefly describes the current implementation status of an intelligent information retrieval system, MARIE, that employs natural language processing techniques. Descriptive captions are used to identify photographic ...