Intelligent information retrieval for a multimedia database using captions.
Guglielmo, Eugene J.
Rowe, Neil C.
MetadataShow full item record
This report describes an intelligent information retrieval system, MARIE, that employs natural language processing techniques for indexing and retrieving multimedia data. Captions describe photographs from the Naval Air Warfare Center Weapons Division, China Lake, California; the captions were written in English consisting mostly of noun phrases. For our work, an object-oriented type hierarchy represents semantic knowledge. Captions are parsed to produce a logical form, from which nouns and verbs are extracted to form keyword files. User queries are also specified in natural language. A two-phase match process is employed between the query and database. A coarse-grain match searches the keyword files and issues SQL queries to a relational database as necessary to find candidate captions for further analysis. A fine-grain match then compares the logical form of the query to the logical form for each caption. A list of caption IDs and accompanying match scores is then presented to the user, who can view the image and supporting data. A companion technical report contains the programs for the system discussed here.
Approved for public release; distribution unlimited.
Showing items related by title, author, creator and subject.
Guglielmo, Eugene J.; Rowe, Neil C. (Monterey, California. Naval Postgraduate School., 1996-07);We describe a prototype intelligent information retrieval system that uses natural-language understanding to efficiently locate captioned data. Multimedia data generally require captions to explain their features and ...
Guglielmo, Eugene J.; Rowe, Neil C. (Monterey, California. Naval Postgraduate School, 1992);This paper briefly describes the current implementation status of an intelligent information retrieval system, MARIE, that employs natural language processing techniques. Descriptive captions are used to identify photographic ...
Rowe, Neil C.; Guglielmo, Eugene J. (Monterey, California. Naval Postgraduate School, 1991-04); NPS-CS-91-012Descriptive captions help organize noncompetitive media. But automated use of captions in retrieval from computerized multimedia databases has not been much examined because it would seem to require significant natural ...