Abstract

Information Technology is creating an exciting time for statistics. In this article, we review the diverse sources of IT data in three clusters: IT core, IT systems, and IT fringe. The new data forms, huge data volumes, and high data speeds of IT are contrasted against the constraints on storage, transmission and computation to point to the challenges and opportunities. In particular, we describe the impacts of IT on a typical statistical investigation of data collection, data visualization, and model fitting, with an emphasis on computation and feature selection.

Citations

3085	Convex Optimization - Boyd, Vandenberghe - 2004
3019	The anatomy of a large-scale hypertextual web search engine - Brin, Page - 1998
2324	Normalized cuts and image segmentation - Shi, Malik - 1997
2102	A decision-theoretic generalization of on-line learning and an application to boosting - Freund, Schapire - 1997
1826	Learning with Kernels - Schölkopf, Smola - 2002
1619	An Introduction to Kolmogorov Complexity and its Applications, second edition - Li, Vitányi - 1997
1540	A global geometric framework for nonlinear dimensionality reduction - Tenenbaum, Silva, et al.
1528	Regression shrinkage and selection via the LASSO - Tibshirani - 1996
1451	Nonlinear dimensionality reduction by locally linear embedding, Science - Roweis, Saul - 2000
1036	Graphical Models - Lauritzen, L - 1996
968	On spectral clustering: Analysis and an algorithm - Ng, Jordan, et al. - 2001
935	Nonlinear component analysis as a kernel eigenvalue problem - Schölkopf, Smola, et al. - 1998
786	Exploratory Data Analysis - Tukey - 1977
754	The Elements of - Hastie, Tibshirani, et al. - 2009
659	Laplacian eigenmaps for dimensionality reduction and data representation - Belkin, Niyogi
656	R.: Least Angle Regression - Efron, Hastie, et al. - 2004
521	Learning with Kernels - Support Vector Machines, Regularization, Optimization, and Beyond - Scholkopf, Smola - 2002
408	Model selection and estimation in regression with grouped variables - Yuan, Lin
371	The dantzig selector: statistical estimation when p is much larger than n. The Annals of Statistics 35 - Candes, Tao - 2007
346	High-Dimensional Graphs and Variable Selection with the Lasso - Meinshausen, Bühlmann
323	Complexity and Real Computation - Blum, Cucker, et al. - 1997
300	most large underdetermined systems of linear equations the minimal l1-norm solution is also the sparsest solution - Donoho - 2006
298	Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties - Fan, Li - 2001
293	T.: Regularization and Variable Selection via the Elastic Net - Zou, Hastie - 2005
218	On the mathematical foundations of theoretical statistics - Fisher - 1922
208	The adaptive Lasso and its oracle properties - Zou - 2006
196	On model selection consistency of lasso - Zhao, Yu
195	Network Tomography: Estimating Source-Destination Traffic Intensities from Link Data - Vardi - 1996
164	A large-scale study of the evolution of web pages - FETTERLY, MANASSE, et al.
164	Hessian Eigenmaps: Locally Linear Embedding Techniques for High-dimensional Data - Donoho, Grimes
164	Monte Carlo Strategies - Liu - 2008
153	A new approach to variable selection in least squares problems - Osborne, Presnell, et al. - 2000
151	Probability approximations via the Poisson clumping heuristic - Aldous - 1989
150	Hyperdimensional data analysis using parallel coordinates”. In: Journal of the American Statistical Association 85.411 - Wegman - 1990
119	On the lasso and its dual - Osborne, Presnell, et al.
112	An Information-Theoretic Approach to Traffic Matrix Estimation - Zhang, Roughan, et al. - 2003
112	Revolutionizing science and engineering through cyberinfrastructure: Report of the national science foundation blue-ribbon advisory panel on cyberinfrastructure - Atkins - 2003
104	Structural analysis of network traffic flows - Lakhina, Papagiannaki, et al. - 2004
103	Large-scale Bayesian logistic regression for text categorization - Genkin, Madigan - 2006
101	A kernel view of the dimensionality reduction of manifolds - Ham, Lee, et al. - 2004
98	Lasso-type recovery of sparse representations for highdimensional data - Meinshausen, Yu
94	Algorithmic challenges in Web Search Engines - Henzinger - 2003
88	Grouped and hierarchical model selection through composite absolute penalties - FOSTER, Zhao, et al.
87	Sampling and Bayes’ inference in scientific modelling and robustness - Box - 1980
87	Time varying network tomography: Router link data - Cao, Davis, et al. - 2000
83	relax: Convex programming methods for subset selection and sparse approximation - Tropp, Just
81	Multivariate graphics - Carr - 1998
78	Statistical modeling: the two cultures - Breiman - 2001
73	Network tomography: recent developments - Castro, Coates, et al. - 2004
65	Boosting as a regularized path to a maximum margin classifier - Rosset, Zhu, et al. - 2004