Better Big Data via Data Farming Experiments
Loading...
Authors
Sanchez, Susan M.
Sánchez, Paul J.
Subjects
Advisors
Date of Issue
2017
Date
Publisher
Springer
Language
Abstract
The term ‘big data’ has become intertwined with ‘data mining’ in the minds of many people. Modern computing can generate massive amounts of data via simulation studies, but a key drawback to the data mining paradigm is that it relies on observational data and thus limits the types of insights that can be gained. We can do much better with ‘data farming,’ a metaphor that captures the notion of purposeful data generation from simulation models. Prospective designs of experiments can establish causal relationships, in contrast to data mining that can only find correlations. The use of large-scale designed experiments lets us grow simulation output efficiently and effectively, and is a game changer in terms of the power and flexibility it offers analysts and decision makers. When combined with modern simulation tools and cluster computing, it allows studies to focus on much broader questions and obtain much richer insights. In this chapter, we discuss the implications data farming has on model building, verification and validation, input modeling and data requirements, multi-criteria decision-making and tradeoff analysis, and a few ethical aspects of the decision process.
Type
Book Chapter
Description
The article of record as published may be found at http://dx.doi.org/10.1007/978-3-319-64182-9_9
Series/Report No
Department
Organization
Naval Postgraduate School (U.S.)
Identifiers
NPS Report Number
Sponsors
Office of Naval Research
Naval Research Program
Naval Research Program
Funder
Format
21 p.
Citation
Sanchez, Susan M., and Paul J. Sánchez. "Better big data via data farming experiments." Advances in Modeling and Simulation. Springer, Cham, 2017. 159-179.
Distribution Statement
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.