Experience in using MTurk for Network Measurement

Loading...
Thumbnail Image
Authors
Huz, Gokay
Bauer, Steven
Beverly, Robert
claffy, c.k.
Subjects
Crowdsourcing
Network measurement
Mechanical Turk
Advisors
Date of Issue
2015
Date
Publisher
Language
Abstract
Conducting sound measurement studies of the global Internet is inherently difficult. The collected data significantly depends on vantage point(s), sampling strategies, security policies, or measurement populations - and conclusions drawn from the data can be sensitive to these biases. Crowdsourcing is a promising approach to address these challenges, although the epistemological implications have not yet received substantial attention by the research community. We share our findings from leveraging Amazon's Mechanical Turk (MTurk) system for three distinct network measurement tasks. We describe our failure to outsource to MTurk an execution of a security measurement tool, our subsequent successful integration of a simple yet meaningful measurement within a HIT, and finally the successful use of MTurk to quickly provide focused small sample sets that could not be obtained easily via alternate means. Finally, we discuss the implications of our experiences for other crowdsourced measurement research.
Type
Article
Presentation
Description
The article of record as published may be located at http://dx.doi.org/ 10.1145/2787394.2787399
Includes article and presentation.
Series/Report No
Department
Computer Science (CS)
Organization
Identifiers
NPS Report Number
Sponsors
This work supported by National Science Foundation grants CNS-1213155 and CNS-1111445.
Funder
Format
Citation
G. Huz, S. Bauer, R. Beverly, ck claffy, "Experience in using Mechanical Turk for Network Measurement," C2B(1)D ’15, Proceedings of the 2015 ACM SIGGCOMM Workshop on Crowdsourcing and Crowdsharing of Big (Internet) Data, pages 27-32. doi:10.1145/2787394.2787399
Distribution Statement
Rights
This publication is a work of the U.S. Government as defined in Title 17, United States Code, Section 101. Copyright protection is not available for this work in the United States.
Collections