Conversation thread extraction and topic detection in text-based chat
Adams, Paige Holland.
Martell, Craig H.
Irvine, Cynthia E.
MetadataShow full item record
Text-based chat systems are widely used within the Department of Defense, but the standard systems available do not provide robust capabilities for search, information retrieval, or information assurance. The objective of this research is to explore methods for the extraction of conversation threads from text-based chat systems in order to enable such tasks. As part of the research, we manually annotated over 20,000 Internet Relay Chat posts with conversation thread information and constructed a probabilistic model for automatically classifying posts according to conversation thread. We also provide an algorithm for extracting these conversation threads from the chat session in order to form discrete documents that may be used in a vector space model information retrieval system. We elaborate how this technique can be used to support search and data mining systems, as well as auditing tasks and guard functions in a security system. Using the developed probabilistic models, we have achieved classification results on par with those of human annotators.
Showing items related by title, author, creator and subject.
Durham, Jonathan S. (Monterey, California. Naval Postgraduate School, 2009-09);The ubiquity of Internet chat applications has benefited many different segments of society. It also creates opportunities for criminal enterprise, terrorism, and espionage. This thesis proposes statistical Natural Language ...
Forsyth, Eric N. (Monterey, California. Naval Postgraduate School, 2007-09);One of the goals of natural language processing (NLP) systems is determining the meaning of what is being transmitted. Although much work has been accomplished in traditional written and spoken language domains, little has ...
Morgan, Samuel A. (Monterey, California: Naval Postgraduate School, 2014-03);The June 2013 disclosure that the National Security Agency collects information on U.S. citizens revived the debate over the proper balance between national security and civil liberties. Central to the conversation is the ...