Abstract:
The eigenvalue spectrum of covariance matrices is of central importance to a number of data analysis techniques. Usually the sample covariance matrix is constructed from a limited number of noisy samples. We describe a method of inferring the true eigenvalue spectrum from the sample spectrum. Results of Silverstein which characterise the eigenvalue spectrum of the noise covariance matrix and inequalities between the eigenvalues of Hermitian matrices are used to infer probability densities for the eigenvalues of the noise-free covariance matrix, using Bayesian inference. Posterior densities for each eigenvalue are obtained, which yield error estimates. The evidence framework gives estimates of the noise variance and permits model order selection by estimating the rank of the covariance matrix. The method is illustrated with numerical examples. Keywords: sample covariance, eigenvalue spectrum, Bayesian evidence, model order selection. EDICS: SP 4.1.4 Corresponding author: Richard Everso...
Citations
|
2102
|
Topics in Matrix Analysis
– Horn, Johnson
- 1991
|
|
740
|
Modeling by shortest data description
– Rissanen
- 1978
|
|
556
|
The symmetric eigenvalue problem
– Parlett
- 1998
|
|
248
|
C.M.: Probabilistic principal component analysis
– Tipping, Bishop
- 1999
|
|
239
|
Analysis of a Complex of Statistical Variables into Principal Components
– Hotelling
- 1993
|
|
228
|
D.M.: An information measure for classification
– Wallace, Boulton
- 1968
|
|
216
|
An information maximization approach to blind separation and blind deconvolution
– Bell, Sejnowski
- 1995
|
|
168
|
Probability Theory D
– Lo`eve
- 1963
|
|
155
|
A Unifying Review of Linear Gaussian Models
– Roweis, Ghahramani
- 1999
|
|
66
|
Principal Component Analysis
– JOLIFFE
- 1986
|
|
65
|
T.J.: A unifying informationtheoretic framework for independent component analysis
– Lee, Girolami, et al.
- 1998
|
|
59
|
Turbulence and the dynamics of coherent structures
– Sirovich
- 1987
|
|
57
|
PM: Bayesian Statistics: an introduction
– Lee
- 1997
|
|
18
|
Eigenvalues and eigenvectors of large dimensional sample covariance matrices
– Silverstein
- 1986
|
|
15
|
Zur Spektraltheorie Stochasticher Prozesse
– Karhunen
- 1947
|
|
9
|
Analysis and management of large scientific databases
– Sirovich, Everson
- 1992
|
|
8
|
Model order selection for the singular value decomposition and the discrete Karhunen-Loeve transform using a Bayesian approach
– Rajan, Rayner
- 1997
|
|
7
|
algorithms for independent component analysis
– EM
- 1998
|
|
4
|
The MDL criterion for rank determination via effective singular values
– Zarowski
- 1998
|
|
3
|
ICA: A flexible non-linearity and decorrelating manifold approach
– Everson, Roberts
- 1998
|