An Extensible, Kinematically-Based Gesture Annotation Scheme

Authors
Martell, Craig H.
Subjects
Gesture
annotation
corpora
corpus-based methods
multi-modal communication
Advisors
Date of Issue
2002
Date
Publisher
Language
Abstract
Annotated corpora have played a critical role in speech and natural language research; and, there is an increasing interest in corpora-based research in sign language and gesture as well. We present a non-semantic, geometrically-based annotation scheme, FORM, which allows an annotator to capture the kinematic information in a gesture just from videos of speakers. In addition, FORM stores this gestural information in Annotation Graph format—allowing for easy integration of gesture information with other types of communication information, e.g., discourse structure, parts of speech, intonation information, etc.
Type
Book Chapter
Description
Chapter 1 in the book: Advances in Natural Multimodal Dialogue Systems
Series/Report No
Department
Computer Science (CS)
Organization
Modeling, Virtual Environments, and Simulation Institute (MOVES)
Identifiers
NPS Report Number
Sponsors
Funder
Format
Citation
Distribution Statement
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.