MetaCart Sign in to MyCiteSeerX

Include Citations | Advanced Search | Help

Disambiguated Search | Include Citations | Advanced Search | Help

Inferring the Eigenvalues of Covariance Matrices From Limited, Noisy Data (1998) [12 citations — 1 self]

by Richard Everson ,  Stephen Roberts
Add To MetaCart

Abstract:

The eigenvalue spectrum of covariance matrices is of central importance to a number of data analysis techniques. Usually the sample covariance matrix is constructed from a limited number of noisy samples. We describe a method of inferring the true eigenvalue spectrum from the sample spectrum. Results of Silverstein which characterise the eigenvalue spectrum of the noise covariance matrix and inequalities between the eigenvalues of Hermitian matrices are used to infer probability densities for the eigenvalues of the noise-free covariance matrix, using Bayesian inference. Posterior densities for each eigenvalue are obtained, which yield error estimates. The evidence framework gives estimates of the noise variance and permits model order selection by estimating the rank of the covariance matrix. The method is illustrated with numerical examples. Keywords: sample covariance, eigenvalue spectrum, Bayesian evidence, model order selection. EDICS: SP 4.1.4 Corresponding author: Richard Everso...

Citations

2102 Topics in Matrix Analysis – Horn, Johnson - 1991
740 Modeling by shortest data description – Rissanen - 1978
556 The symmetric eigenvalue problem – Parlett - 1998
248 C.M.: Probabilistic principal component analysis – Tipping, Bishop - 1999
239 Analysis of a Complex of Statistical Variables into Principal Components – Hotelling - 1993
228 D.M.: An information measure for classification – Wallace, Boulton - 1968
216 An information maximization approach to blind separation and blind deconvolution – Bell, Sejnowski - 1995
168 Probability Theory D – Lo`eve - 1963
155 A Unifying Review of Linear Gaussian Models – Roweis, Ghahramani - 1999
66 Principal Component Analysis – JOLIFFE - 1986
65 T.J.: A unifying informationtheoretic framework for independent component analysis – Lee, Girolami, et al. - 1998
59 Turbulence and the dynamics of coherent structures – Sirovich - 1987
57 PM: Bayesian Statistics: an introduction – Lee - 1997
18 Eigenvalues and eigenvectors of large dimensional sample covariance matrices – Silverstein - 1986
15 Zur Spektraltheorie Stochasticher Prozesse – Karhunen - 1947
9 Analysis and management of large scientific databases – Sirovich, Everson - 1992
8 Model order selection for the singular value decomposition and the discrete Karhunen-Loeve transform using a Bayesian approach – Rajan, Rayner - 1997
7 algorithms for independent component analysis – EM - 1998
4 The MDL criterion for rank determination via effective singular values – Zarowski - 1998
3 ICA: A flexible non-linearity and decorrelating manifold approach – Everson, Roberts - 1998