Abstract

Information Technology is creating an exciting time for statistics. In this article, we review the diverse sources of IT data in three clusters: IT core, IT systems, and IT fringe. The new data forms, huge data volumes, and high data speeds of IT are contrasted against the constraints on storage, transmission and computation to point to the challenges and opportunities. In particular, we describe the impacts of IT on a typical statistical investigation of data collection, data visualization, and model fitting, with an emphasis on computation and feature selection.

Citations

3642	Convex Optimization - Boyd, Vandenberghe - 2004
3229	The Anatomy of a Large-Scale Hypertextual Web Search Engine - Brin, Page - 1998
2581	Normalized cuts and image segmentation - Shi, Malik
2304	A decision-theoretic generalization of on-line learning and an application to boosting - Freund, Schapire - 1997
2027	Learning with Kernels - Schölkopf, Smola - 2001
1816	Regression shrinkage and selection via the lasso - Tibshirani - 1996
1683	A global geometric framework for nonlinear dimensionality reduction - Tenenbaum, Silva, et al. - 2000
1682	An Introduction to Kolmogorov Complexity and Its Applications - Li, Vitányi - 1997
1608	Nonlinear Dimensionality Reduction by Locally Linear Embedding - Roweis, Saul
1116	Graphical models - Lauritzen - 1996
1092	On spectral clustering: Analysis and an algorithm - Ng, Jordan, et al. - 2002
1046	Nonlinear component analysis as a kernel eigenvalue problem - Schölkopf, Smola, et al. - 1998
864	Exploratory Data Analysis - Tukey - 1971
853	The Elements of - Hastie, Tibshirani, et al. - 2001
752	Least angle regression - Efron, Hastie, et al. - 2004
730	Laplacian eigenmaps for dimensionality reduction and data representation - Belkin, Niyogi - 2003
593	Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond - Schölkopf, Smola - 2001
499	Model selection and estimation in regression with grouped variables - Yuan, Lin
420	The dantzig selector: statistical estimation when p is larger than n,” Annals of Statistics - Candès, Tao - 2005
382	High-dimensional graphs and variable selection with the Lasso - Meinshausen, Bühlmann - 2006
357	Regularization and variable selection via the elastic net - Zou, Hastie - 2005
347	Complexity and Real Computation - Blum, Cucker, et al. - 1998
342	Variable selection via nonconcave penalized likelihood and its oracle properties - Fan, Li - 2001
340	For most large underdetermined systems of linear equations the minimal 1-norm solution is also the sparsest solution - Donoho - 2006
246	The adaptive lasso and its oracle properties - Zou - 2006
238	On the mathematical foundations of theoretical statistics - Fisher - 1922
222	On model selection consistency of Lasso - Zhao, Yu - 2007
208	Network tomography: Estimating source-destination traffic intensities - Vardi - 1996
181	Hessian eigenmaps: Locally linear embedding techniques for high-dimensional data - Donoho, Grimes
174	J.Wiener: A largescale study of the evolution of Web pages - Fetterly, Manasse, et al. - 2003
170	Monte Carlo Strategies - Liu - 2001
163	A new approach to variable selection in least squares problems - Osborne, Presnell, et al. - 2000
155	Probability Approximations via the Poisson Clumping Heuristic - Aldous - 1989
155	Hyperdimensional Data Analysis using Parallel Coordinates - Wegman - 1990
145	On the lasso and its dual - Osborne, Presnell, et al. - 2000
125	Revolutionizing Science and Engineering Through Cyberinfrastructure: Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure. NSF, Download: http://www.nsf.gov/od/oci/reports/CH1.pdf Bellini, F. et al. (2008): ERINA Dis - Atkins, Droegemeier, et al. - 2003
119	An information-theoretic approach to traffic matrix estimation - Zhang, Roughan, et al. - 2003
117	Structural analysis of network traffic flows - Lakhina
117	Lasso-type recovery of sparse representations for high dimensional data - Meinshausen, Yu - 2007
112	Large-scale Bayesian logistic regression for text categorization - Genkin, Lewis, et al. - 2007
109	A kernel view of the dimensionality reduction of manifolds - Ham, Lee, et al. - 2004
97	Challenges in web search engines - Henzinger, Motwani, et al.
95	Sampling and Bayes’ inference in scientific modelling and robustness - Box - 1980
93	Statistical modeling: the two cultures - Breiman - 2001
92	Time-varying network tomography: Router link data - Cao, Davis, et al. - 2000
90	Just relax: Convex programming methods for subset selection and sparse approximation - Tropp - 2004
89	Grouped and hierarchical model selection through composite absolute penalties - Zhao, Rocha, et al. - 2006
85	Network tomography: Recent developments - Castro, Coates, et al.
84	The grammar of graphics - Wilkinson - 1999
68	Boosting as a regularized path to a maximum margin classifier - Rosset, Zhu, et al. - 2003