Abstract

Conducting an Internet measurement study in a sound fashion can be much more difficult than it might first appear. We present a number of strategies drawn from experiences for avoiding or overcoming some of the pitfalls. In particular, we discuss dealing with errors and inaccuracies; the importance of associating meta-data with measurements; the technique of calibrating measurements by examining outliers and testing for consistencies; difficulties that arise with large-scale measurements; the utility of developing a discipline for reliably reproducing analysis results; and issues with making datasets publicly available. We conclude with thoughts on the sorts of tools and community practices that can assist researchers with conducting sound measurement studies.

Citations

747	Core Team R: A language and environment for statistical computing R Foundation for Statistical Computing - Development - 2004
564	Bro: A system for detecting network intruders in real-time. Computer Networks - Paxson - 1999
377	Network Time Protocol (Version 3) Specification, Implementation and Analysis - Mills - 1992
329	Measurements and Analysis of End-to-End Internet Dynamics - Paxson - 1997
246	Insertion, evasion, and denial of service: eluding Network intrusion detection,” Secure Networks - Ptacek, Newsham - 1998
244	Difficulties in simulating the internet - Floyd, Paxson - 2001
242	Modern Applied Statistics with S-PLUS - Venables, Ripley - 1999
157	Automated packet trace analysis of TCP implementations - Paxson - 1997
144	Network Intrusion Detection: Evasion, Traffic Normalization, and End-to-End Protocol Semantics,” Proc. Ninth USENIX Security Symp., 2000. 7. AUTHORS PROFILE N. Kannaiya Raja received degree MCA from Alagappa University and ME from Anna University Chennai - Handley, Paxson, et al.
99	Estimation and removal of clock skew from network delay measurements - Moon, Skelly, et al. - 1999
99	On calibrating measurements of packet transit times - Paxson - 1998
73	Prefix-Preserving IP Address Anonymization: Measurement-Based Security Evaluation and a New Cryptography-Based Scheme - Xu, Fan, et al. - 2002
71	A high-level programming environment for packet trace anonymization and transformation - Paxson, Pang - 2003
34	Estimating loss rates with TCP - ALLMAN, EDDY, et al. - 2003
33	Expanding Confidence in Network Simulation - Heidemann, Mills, et al. - 2001
30	et al., “Packet-level traffic measurements from the Sprint IP backbone - Fraleigh - 2003
29	Modelling and analysis of computer network clocks. Electrical Engineering Department Report - Mills - 1992
27	Clock synchronization algorithms for network measurements - Zhang, Liu, et al.
21	A scalable system for sharing internet measurements - Allman, Blanton, et al. - 2002
9	MATLAB: An Introduction with Applications - Gilat - 2004
7	Trace anonymization misses the point - Mogul
6	et al. Measurement and Classification of Out-of-Sequence Packets - Jaiswal - 2002
5	et al., “Observation and analysis of BGP behavior under stress - Wang, Zhao, et al. - 2002
4	private communication - Allman - 1999
4	Design and Implementation of Netdude, a Framework for Packet Trace Manipulation - Kreibich - 2004
4	The Notion of Redundancy and Its Use as a Quantitative Measure of the Discrepancy between a Statistical Hypothesis and a Set of Observational Data - Martin-Löf - 1974
2	Private communication - Barford - 2000
2	TCPdpriv manual. http://www.acm.org/ sigcomm/ITA - Minshall - 1996