Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources

Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources (1997)

Cached

Download Links

[www.cnl.salk.edu]

Other Repositories/Bibliography

DBLP

by Te-won Lee , Mark Girolami , Terrence J. Sejnowski , Howard Hughes

Citations:

155 - 20 self

BibTeX

@MISC{Lee97independentcomponent,
    author = {Te-won Lee and Mark Girolami and Terrence J. Sejnowski and Howard Hughes},
    title = {Independent Component Analysis Using an Extended Infomax Algorithm for Mixed Sub-Gaussian and Super-Gaussian Sources},
    year = {1997}
}

Years of Citing Articles

Bookmark

OpenURL

Abstract

An extension of the infomax algorithm of Bell and Sejnowski (1995) is presented that is able to blindly separate mixed signals with sub- and super-Gaussian source distributions. This was achieved by using a simple type of learning rule first derived by Girolami (1997) by choosing negentropy as a projection pursuit index. Parameterized probability distributions that have suband super-Gaussian regimes were used to derive a general learning rule that preserves the simple architecture proposed by Bell and Sejnowski (1995), is optimized using the natural gradient by Amari (1998), and uses the stability analysis of Cardoso and Laheld (1996) to switch between sub- and super-Gaussian regimes. We demonstrate that the extended infomax algorithm is able to easily separate 20 sources with a variety of source distributions. Applied to high-dimensional data from electroencephalographic (EEG) recordings, it is effective at separating artifacts such as eye blinks and line noise from weaker electrical ...

Citations

6515	Elements of Information Theory - Cover, Thomas - 1991
1034	Independent component analysis, a new concept - Comon - 1994
830	An information-maximization approach to blind separation and blind deconvolution - Bell, Sejnowski - 1995
429	A new learning algorithm for blind signal separation - SI, Cichoki, et al. - 1996
368	Blind separation of sources, part i: An adaptive algorithm based on neuromimetic architecture - Jutten, Herault - 1991
332	Blind beamforming for nonGaussian signals - Cardoso, Souloumiac - 1994
325	Equivariant adaptative source separation - Cardoso, Labeld - 1996
270	signal separation: statistical principles - Cardoso, “Blind - 1998
215	Natural gradient works efficiently in learning - Amari - 1998
150	Independent component analysis of electroencephalographic data - Makeig, Bell, et al. - 1996
130	Non-linear neurons in the low noise limit: a factorial code maximizes information transfer - Nadal, Parga - 1994
108	A class of neural networks for independent component analysis - Karhunan, Oja, et al. - 1997
106	Infomax and maximum likelihood for blind source separation - Cardoso - 1997
105	Independant Component Analysis "Theory and Applications - Lee - 1998
99	Source separation in post-nonlinear mixtures - Taleb, Jutten - 1999
90	Independent component analysis—a new concept - Comon - 1994
86	A context-sensitive generalization of ICA - Pearlmutter, Parra - 1996
78	Blind separation of mixture of independent sources through a quasimaximum likelihood approach - Pham, Garrat - 1997
71	An Information–Theoretic Approach to Neural Computing - Deco, Obradovic - 1996
71	Blind source separation of more sources than mixtures using overcomplete representation - Lee, Lewicki, et al. - 1999
70	Robust learning algorithm for blind separation of signals - Cichocki, Unbehauen, et al. - 1994
53	J.:\Neural Approaches to Independent Component Analysis and Source Separation - Karhunen - 1996
53	Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models - Moulines, Cardoso, et al. - 1997
50	Spatially independent activity patterns in functional MRI data during the stroop color-naming task - McKeown, Jung, et al. - 1998
47	Blind source separation --- Semi-parametric statistical approach - Amari, Cardoso - 1997
47	The nonlinear PCA learning rule in independent component analysis - Oja - 1997
36	Stability analysis of adaptive blind source separation - Amari, Chen, et al. - 1997
36	Learning non-linear overcomplete representations for efficient coding - LEWICKI, SEJNOWSKI - 1998
35	An Alternative Perspective on Adaptive Independent Component Analysis Algorithm - Girolami - 1998
32	Extended ICA removes artifacts from electroencephalographic recordings - Jung, Humphries, et al. - 1998
31	Redundancy reduction and independent component analysis: Conditions on cumulants and adaptive approaches", submitted to Neural Computation - Nadal, Parga - 1996
28	Multi-dimensional density shaping by sigmoidal networks with application to classi cation, estimation and forecasting - Baram, Roth - 1994
24	A maximum likelihood approach to nonlinear blind separation - Pajunen, Karhunen - 1997
24	Information back-propagation for blind separation of sources from nonlinear mixtures - Amari, Cichocki - 1996
23	Blind Separation of EventRelated Brain Responses into Independent Components - Makeig, Jung, et al. - 1997
22	Extraction of independent signals sources using a de ationary exploratory projection pursuit network with lateral inhibition - Girolami, Fyfe - 1997
20	Feature extraction through lococode - Hochreiter, Schmidhuber - 1999
16	A unifying framework for independent component analysis - Lee, Girolami, et al. - 2000
16	Unsupervised Classification with non-Gaussian Mixture Models using ICA, Advances in Neural Information Processing Systems 11 - Lee, Lewicki, et al. - 1999
12	Source separation without prior knowledge: the maximum likelihood solution - Gaeta, Lacoume - 1990
12	Generalised independent component analysis through unsupervised learning with emergent bussgang properties - Girolami, Fyfe - 1997
10	Blind separation of noisy mixtures: An EM algorithm for factor analysis. Neural Computation, 11, to appear in 11-4. Extended Infomax Algorithm 439 - Attias - 1999
8	Self-organizing artificial neural networks for signal separation - Girolami - 1997
8	Blind separation of nonlinear mixing models - Lee, Koehler, et al. - 1997
8	Faithful representation of separable input distributions - Lin, Cowan - 1997
8	Blind source separation—semiparametric statistical approach - Amari, Cardoso - 1997
8	Dipole models of eye movements and blinks - Berg, Scherg - 1991
7	Maximum equalization by entropy maximization and mixture of cumulative distribution functions - Xu, Cheung, et al. - 1997
6	Ica fixed-point algorithm in extraction of artifacts from eeg - Vigario, Hyvarinen, et al. - 1996
5	Kendall's Advanced Theory of Statistic, 1, Distribution Theory - Stuart, Ord - 1987