What friends are for: collaborative intelligence analysis and search

Download
Author
Wood, Christopher J.
Date
2014-06Advisor
Dimitrov, Nedialko B.
Kress, Moshe
Metadata
Show full item recordAbstract
Intelligence analysts face a glut of information and limited time to identify which information is relevant. Also, they are unaware of other analysts with similar intelligence problems, preventing collaboration and often causing intelligence failure. To identify relevant information, analysts use adopted commercial search engines designed for internet-sized databases containing hyperlinked web-pages that are not effective on intelligence databases consisting of non-hyperlinked documents. This thesis outlines a model to fundamentally increase search effectiveness and collaboration by using a social network of like-minded users based on user biographies and search behavior. After entering a query, the likelihood of returning a relevant document is increased by leveraging data from other, similar users. The model goes beyond standard search engine design by presenting similar analysts for collaboration and presenting relevant documents without queries. Our framework is mathematically grounded in a Markov random field information retrieval model and recent developments in recommender systems. We build and test a prototype system on datasets from the National Institute of Standards & Technology. The test results combine with computational sensitivity analyses to show significant improvements over existing search models. The improvements are shown to be robust to high levels of human error and low similarity between users.
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.Related items
Showing items related by title, author, creator and subject.
-
Homeland Security Affairs Journal, Volume VII - 2011, 10 Years After: The 9/11 Essays
Naval Postgraduate School Center for Homeland Defense and Security (CHDS) (Monterey, California. Naval Postgraduate SchoolCenter for Homeland Defense and Security, 2011);10 Years After: the 9/11 Essays. Homeland Security Affairs (HSA) is pleased to present this special collection of essays in remembrance of the ten-year anniversary of September 11, 2001. We chose to honor those who lost ... -
Intelligence reform and implications for North Korea's Weapons of Mass Destruction Program
Nash, Arnold W. (Monterey California. Naval Postgraduate School, 2005-09);This thesis analyzes the current intelligence reform initiatives in light of multiple recommendations from post-9/11 commissions tasked with studying intelligence shortcomings. Using North Korea as a case study, it examines ... -
FINE-TUNING A MULTILINGUAL LANGUAGE MODEL TO PRUNE AUTOMATED EVENT DATA
Kyler, Seth W. (Monterey, CA; Naval Postgraduate School, 2023-06);Every day, an enormous volume of written and transcribed media is produced, making it impossible for intelligence analysts to sift through it all without a large human workforce. However, multilingual language models can ...