Abstract

Information Technology is creating an exciting time for statistics. In this article, we review the diverse sources of IT data in three clusters: IT core, IT systems, and IT fringe. The new data forms, huge data volumes, and high data speeds of IT are contrasted against the constraints on storage, transmission and computation to point to the challenges and opportunities. In particular, we describe the impacts of IT on a typical statistical investigation of data collection, data visualization, and model fitting, with an emphasis on computation and feature selection.

Citations

3645	Convex Optimization - Boyd, Vandenberghe - 2004
3229	The anatomy of a large-scale hypertextual Web search engine - Brin, Page - 1998
2583	Normalized cuts and image segmentation - Shi, Malik - 1997
2307	A decision-theoretic generalization of on-line learning and an application to boosting - Freund, Schapire - 1995
2028	Learning with kernels - Schölkopf, Smola - 2002
1821	Regression shrinkage and selection via the lasso - Tibshirani - 1996
1686	An Introduction to Kolmogorov Complexity and its Applications - Li, Vitányi - 1993
1684	A global geometric framework for nonlinear dimensionality reduction - Tenenbaum, Silva, et al. - 2000
1610	Nonlinear dimensionality reduction by locally linear embedding - Roweis, Saul - 2000
1123	Graphical Models - Lauritzen - 1996
1094	On spectral clustering: Analysis and an algorithm - Ng, Jordan, et al. - 2002
1047	Nonlinear component analysis as a kernel eigenvalue problem - Schölkopf, Smola, et al. - 1998
864	Exploratory Data Analysis - Tukey - 1977
853	The Elements of - Hastie, Tibshirani, et al. - 2001
756	Least angle regression - Efron, Hastie, et al. - 2004
731	Laplacian eigenmaps for dimensionality reduction and data representation - Belkin, Niyogi - 2003
593	Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond - Schölkopf, Smola - 2002
502	Model selection and estimation in regression with grouped variables - Yuan, Lin
423	The Dantzig selector: Statistical estimation when p is much larger than n - Candes, Tao
390	High-dimensional graphs and variable selection with the Lasso - Meinshausen, Bühlmann
358	Regularization and variable selection via the elastic net - Zou, Hastie - 2005
348	Complexity and Real Computation - Blum, Cucker, et al. - 1998
344	Variable Selection Via Nonconcave Penalized Likelihood and Its Oracle Properties - Fan, Li - 2001
342	For most large underdetermined systems of linear equations, the minimal ℓ1 norm near-solution approximates the sparsest near-solution - Donoho - 2006
247	The adaptive lasso and its oracle properties - Zou - 2006
238	On the mathematical foundations of theoretical statistics - Fisher - 1922
225	On model selection consistency of Lasso - Zhao, Yu
208	Network tomography: Estimating source-destination traffic intensities - Vardi - 1996
181	Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data - Donoho, Grimes
174	J.Wiener: A largescale study of the evolution of Web pages - Fetterly, Manasse, et al. - 2003
171	Monte Carlo Strategies - Liu - 2001
163	A new approach to variable selection in least squares problems - Osborne, Presnell, et al. - 2000
155	Probability Approximations via the Poisson Clumping Heuristic - Aldous - 1989
155	Hyperdimensional Data Analysis using Parallel Coordinates - Wegman - 1990
146	On the lasso and its dual - Osborne, Presnell, et al. - 2000
125	Revolutionizing Science and Engineering Through Cyberinfrastructure: Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure. NSF, Download: http://www.nsf.gov/od/oci/reports/CH1.pdf Bellini, F. et al. (2008): ERINA Dis - Atkins, Droegemeier, et al. - 2003
119	An information-theoretic approach to traffic matrix estimation - Zhang, Roughan, et al. - 2003
118	Lasso-type recovery of sparse representations for high-dimensional data - Meinshausen, Yu - 2009
117	Structural analysis of network traffic flows - Lakhina
112	Large-scale Bayesian logistic regression for text categorization - Genkin, Lewis, et al. - 2007
109	A kernel view of the dimensionality reduction of manifolds (Tech - Ham, Lee, et al. - 2003
97	Challenges in web search engines - Henzinger, Motwani, et al.
95	Sampling and Bayes’ inference in scientific modelling and robustness - Box - 1980
93	Statistical modeling: the two cultures - Breiman - 2001
92	Time-varying network tomography: Router link data - Cao, Davis, et al. - 2000
91	Just relax: Convex programming methods for subset selection and sparse approximation - Tropp - 2006
89	Grouped and hierarchical model selection through composite absolute penalties. Annals of Statistics, 37(6A):3468–3497, 2009. Alekh Agarwal - Zhao, Rocha, et al. - 2012
85	Network tomography: Recent developments - Castro, Coates, et al.
84	The grammar of graphics - Wilkinson - 1999
68	Boosting as a regularized path to a maximum margin classifier - Rosset, Zhu, et al. - 2003