## Multidimensional Quasi-Eigenfunction Approximations and Multicomponent AM-FM Models (2000)

Venue: | IEEE TRANS. IMAGE PROC |

Citations: | 33 - 12 self |

### BibTeX

@ARTICLE{Havlicek00multidimensionalquasi-eigenfunction,

author = {Joseph P. Havlicek and David S. Harding and Alan Conrad Bovik},

title = {Multidimensional Quasi-Eigenfunction Approximations and Multicomponent AM-FM Models},

journal = {IEEE TRANS. IMAGE PROC},

year = {2000},

volume = {9},

pages = {227--242}

}

### Years of Citing Articles

### OpenURL

### Abstract

We develop multicomponent AM-FM models for multidimensional signals. The analysis is cast in a general-dimensional framework where the component modulating functions are assumed to lie in certain Sobolev spaces. For both continuous and discrete LSI systems with AM--FM inputs, powerful new approximations are introduced that provide closed form expressions for the responses in terms of the input modulations. The approximation errors are bounded by generalized energy variances quantifying the localization of the filter impulse response and by Sobolev norms quantifying the smoothness of the modulations. The approximations are then used to develop novel spatially localized demodulation algorithms that estimate the AM and FM functions for multiple signal components simultaneously from the channel responses of a multiband linear filterbank used to isolate components. Two discrete computational paradigms are presented. Dominant component analysis estimates the locally dominant modulations in a signal, which are useful in a variety of machine vision applications, while channelized components analysis delivers a true multidimensional multicomponent signal representation. We demonstrate the techniques on several images of general interest in practical applications, and obtain reconstructions that establish the validity of characterizing images of this type as sums of locally narrowband modulated components.

### Citations

1476 |
Singular Integrals and Differentiability Properties of Functions
- Stein
- 1970
(Show Context)
Citation Context ...vector in an arbitrarily chosen direction . The method we favor for generating the complex extension is to add an imaginary part equal to times the directional multidimensional Hilbert transform [21]�=-=��[23]-=- where p.v. indicates the Cauchy principal value. It is trivial to verify that the singular operator is linear. The complex signal admits many of the attractive properties of the 1-D analytic signal. ... |

1018 |
Theory of Communication
- Gabor
- 1946
(Show Context)
Citation Context ...the 1-D analytic signal. 1 Thus, by abus de langage, we call the analytic image associated with the real signal . Over the Hilbert space , satisfies the frequency moment properties of Gabor and Ville =-=[24]-=-, [25], the amplitude continuity, homogeneity, and harmonic correspondence conditions of Vakman [26] (up to a set of Lebesgue measure zero), and admits a Fourier spectrum that is supported only on fre... |

430 |
Multichannel texture analysis using localized spatial lter
- Bovik
- 1990
(Show Context)
Citation Context ...and are thus significant. DCA is primarily of interest in machine vision applications, where the dominant modulations are useful for solving a variety of problems including texture segmentation [11], =-=[32], -=-three-dimensional (3-D) surface reconstruction [11], [33], [34], and computational stereopsis [35]–[37]. B. CCA CCA is depicted in the block diagram of Fig. 2. As in DCA, the filterbank channel resp... |

87 |
Time-Frequency Analysis. Englewood Cliffs, NJ: PrenticeHall
- Cohen
- 1995
(Show Context)
Citation Context ...int amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local basis [2], [3], [8], [11], [13]�=-=��[15]-=-. Furthermore, such locally narrowband signals are precisely the ones for which instantaneous amplitude and frequency are the most physically meaningful. Since the complicated nonstationary signals fr... |

71 |
Localized measurement of emergent image frequencies by gabor wavelets
- Bovik, Gopal, et al.
- 1992
(Show Context)
Citation Context ...own that joint amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local basis [2], [3], [8], =-=[11], -=-[13]–[15]. Furthermore, such locally narrowband signals are precisely the ones for which instantaneous amplitude and frequency are the most physically meaningful. Since the complicated nonstationary... |

65 |
On amplitude and frequency demodulation using energy operators
- Maragos, Kaiser, et al.
- 1993
(Show Context)
Citation Context ...ions which admit nonstationary amplitude and frequency modulations. Such AM–FM functions have been used successfully in the study of nonstationary one-dimensional (1-D) signals including human speec=-=h [1]–[-=-5], as well as in the study of images and other multidimensional signals [6]–[12]. It is well known that joint amplitude and frequency modulations can be computed most accurately for signals having ... |

38 | AM-FM energy detection and separation in noise using multiband energy operators
- Bovik, Maragos, et al.
- 1993
(Show Context)
Citation Context ...is well known that joint amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local basis [2], =-=[3], -=-[8], [11], [13]–[15]. Furthermore, such locally narrowband signals are precisely the ones for which instantaneous amplitude and frequency are the most physically meaningful. Since the complicated no... |

31 | Image demodulation using multidimensional energy separation
- Maragos, Bovik
- 1995
(Show Context)
Citation Context ...ll known that joint amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local basis [2], [3], =-=[8], -=-[11], [13]–[15]. Furthermore, such locally narrowband signals are precisely the ones for which instantaneous amplitude and frequency are the most physically meaningful. Since the complicated nonstat... |

31 | Bovik, Planar surface orientation from texture spatial frequencies
- Super, C
- 1995
(Show Context)
Citation Context ...achine vision applications, where the dominant modulations are useful for solving a variety of problems including texture segmentation [11], [32], three-dimensional (3-D) surface reconstruction [11], =-=[33], [3-=-4], and computational stereopsis [35]–[37]. B. CCA CCA is depicted in the block diagram of Fig. 2. As in DCA, the filterbank channel responses are demodulated using (25) and (27) or (41)–(43). The... |

24 |
Bovik, Analysis of multichannel narrow-band filters for image texture segmentation
- C
- 1991
(Show Context)
Citation Context ...e use a bank of isotropic unity -norm Gabor filters with half-peak radial bandwidths of one octave. The efficacy of such a filterbank for AM–FM demodulation has been well established [3], [11], [32]=-=, [38]-=-. A 2-D Gabor filterbank of the type described in [11] is depicted in the frequency domain in Fig. 3, augmented by two high-frequency Gabor filters to cover the outermost corners of the right frequenc... |

23 |
Francos, Estimation of Amplitude and Phase Parameters of Multicomponent Signals
- Friedlander, Joseph
- 1995
(Show Context)
Citation Context ...alman filter, was used to demodulate multiple formants in human speech [5], while a multicomponent maximum likelihood estimation technique was demonstrated on synthetic two-component chirp signals in =-=[17]. -=-For multidimensional signals, the tracked multicomponent analysis (TMCA) approach reported in [6], [18] is the only previous multicomponent AM–FM technique of which we are aware.s228 IEEE TRANSACTIO... |

23 |
Multidimensional complex signals with single-orthant spectra
- Hahn
- 1992
(Show Context)
Citation Context ...s used for 2-D Wigner analysis by Zhu et al. [28], the 2-D discrete Hilbert transform used by Read and Treitel for stabilizing IIR filters [29], and Hahn’s complex signals with single-orthant spectr=-=a [30]. -=-Indeed, none of these admit all of the attractive properties mentioned above. Therefore, for computing multidimensional AM–FM models, we feel that the analytic image is the preferable complex extens... |

22 |
On the analytic signal, the teager-kaiser energy algorithm, and other met hods for defining amplitude and frequency
- Vakman
- 1996
(Show Context)
Citation Context ...real signal . Over the Hilbert space , satisfies the frequency moment properties of Gabor and Ville [24], [25], the amplitude continuity, homogeneity, and harmonic correspondence conditions of Vakman =-=[26]-=- (up to a set of Lebesgue measure zero), and admits a Fourier spectrum that is supported only on frequency orthants where it is equal to twice the spectrum of . Although it is not difficult to extend ... |

20 |
Bovik, “The multicomponent AM-FM image representation
- Havlicek, Harding, et al.
- 1996
(Show Context)
Citation Context ... functions have been used successfully in the study of nonstationary one-dimensional (1-D) signals including human speech [1]–[5], as well as in the study of images and other multidimensional signal=-=s [6]��-=-�[12]. It is well known that joint amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local b... |

20 | The analytic image
- Havlicek, Havlicek, et al.
- 1997
(Show Context)
Citation Context ...unit vector in an arbitrarily chosen direction . The method we favor for generating the complex extension is to add an imaginary part equal to times the directional multidimensional Hilbert transform =-=[21]��-=-�[23] where p.v. indicates the Cauchy principal value. It is trivial to verify that the singular operator is linear. The complex signal admits many of the attractive properties of the 1-D analytic sig... |

15 | A system for finding speech formants and modulations via energy separation - Hanson, Maragos, et al. - 1994 |

11 | Local multiscale frequency and bandwidth estimation
- Knutsson, Westin, et al.
- 1994
(Show Context)
Citation Context ...t, a standardized method for evaluating the performance of computed AM–FM modeling techniques does not exist. In many of the previous studies, analysis was limited to synthetic signals [1], [3], [7]=-=, [10], -=-[14], [16], [17], making it possible to compare the computed modulations with the analytical model used to generate the test signals. In other cases, AM–FM demodulation was applied to human speech o... |

10 |
Nonlinear modeling and processing of speech based on sums of AM–FM formant models
- Lu, Doerschuk
- 1996
(Show Context)
Citation Context ... which admit nonstationary amplitude and frequency modulations. Such AM–FM functions have been used successfully in the study of nonstationary one-dimensional (1-D) signals including human speech [1=-=]–[5], -=-as well as in the study of images and other multidimensional signals [6]–[12]. It is well known that joint amplitude and frequency modulations can be computed most accurately for signals having inst... |

9 | Francos, \An Estimation Algorithm for 2-D Polynomial Phase Signals - Friedlander, M - 1996 |

9 |
The use of a twodimensional Hilbert transform for Wigner analysis of 2-dimensional real signals,’’ Signal Process
- Zhu, Peyrin, et al.
- 1990
(Show Context)
Citation Context ... dimensions to discretize (7), the details are beyond the scope of this paper. The complex extension and associated transform (7) are distinct from the ones used for 2-D Wigner analysis by Zhu et al. =-=[28], -=-the 2-D discrete Hilbert transform used by Read and Treitel for stabilizing IIR filters [29], and Hahn’s complex signals with single-orthant spectra [30]. Indeed, none of these admit all of the attr... |

8 | On the instantaneous frequencies of multicomponent AM-FM signals
- Wei, Bovik
- 1998
(Show Context)
Citation Context ...at joint amplitude and frequency modulations can be computed most accurately for signals having instantaneous frequency content that is highly coherent on a spatially local basis [2], [3], [8], [11], =-=[13]��-=-�[15]. Furthermore, such locally narrowband signals are precisely the ones for which instantaneous amplitude and frequency are the most physically meaningful. Since the complicated nonstationary signa... |

8 | Limits on discrete modulated signals
- Bovik, Havlicek, et al.
- 1997
(Show Context)
Citation Context ...nt (LSI) systems to D AM–FM inputs and develop tight bounds on the approximation errors. Analogous approximations have been studied previously for the case of 1-D continuous and discrete signals [3]=-=, [14]-=- and 2-D continuous signals [11]. The D discrete theory presented here is both new and distinctive. For the continuous case, a new D error bound is presented that contains an interesting dimensionally... |

8 |
Stereoscopic ranging by matching image modulations
- Chen, AC, et al.
- 1999
(Show Context)
Citation Context ... modulations are useful for solving a variety of problems including texture segmentation [11], [32], three-dimensional (3-D) surface reconstruction [11], [33], [34], and computational stereopsis [35]�=-=��[37]. -=-B. CCA CCA is depicted in the block diagram of Fig. 2. As in DCA, the filterbank channel responses are demodulated using (25) and (27) or (41)–(43). The component-wise decomposition of the signal is... |

7 | Two-dimensional Teager operators and their image processing applications - Mitra, Thurnhofer, et al. - 1995 |

5 |
Théorie et applications de la notation de signal analytique,” Cables et Transmission 2A
- Ville
(Show Context)
Citation Context ...D analytic signal. 1 Thus, by abus de langage, we call the analytic image associated with the real signal . Over the Hilbert space , satisfies the frequency moment properties of Gabor and Ville [24], =-=[25]-=-, the amplitude continuity, homogeneity, and harmonic correspondence conditions of Vakman [26] (up to a set of Lebesgue measure zero), and admits a Fourier spectrum that is supported only on frequency... |

5 |
The stabilization of twodimensional recursive filters via the discrete Hilbert transform
- Read, Treitel
- 1973
(Show Context)
Citation Context ...ension and associated transform (7) are distinct from the ones used for 2-D Wigner analysis by Zhu et al. [28], the 2-D discrete Hilbert transform used by Read and Treitel for stabilizing IIR filters =-=[29], an-=-d Hahn’s complex signals with single-orthant spectra [30]. Indeed, none of these admit all of the attractive properties mentioned above. Therefore, for computing multidimensional AM–FM models, we ... |

5 |
Vector calculus
- Marsden, Tromba
- 1981
(Show Context)
Citation Context ...obtain (A.4) The result (18) follows immediately upon applying Theorem 1 to , , and in (A.4) and collecting terms. Proof of Theorem 2: Expanding in a first-order Taylor series with explicit remainder =-=[41]-=-, we obtain where (A.5) (A.6) Substitution of and (A.5) into (28) then yields (A.7) Upon replacing in (29) with the definition of the Fourier transform of a sequence [42], we have (A.8) Now, we write ... |

4 |
Discrete Hilbert transform
- Číˇzek
- 1970
(Show Context)
Citation Context ... and admits a Fourier spectrum that is supported only on frequency orthants where it is equal to twice the spectrum of . Although it is not difficult to extend the discrete Hilbert transform given in =-=[27]-=- into multiple dimensions to discretize (7), the details are beyond the scope of this paper. The complex extension and associated transform (7) are distinct from the ones used for 2-D Wigner analysis ... |

3 |
Energy demodulation of two-component AM–FM signal mixtures
- Santhanam, Maragos
- 1996
(Show Context)
Citation Context ...oblem and relatively few multicomponent AM–FM techniques have been reported. In 1-D, the energy demodulation of mixtures (EDM) algorithm has been applied to demodulate synthetic two-component signal=-=s [16], -=-and an iterative method involving the Teager–Kaiser energy operator (TKEO) has been used to track and demodulate multiple narrowband formants in human speech [4]. Two interesting multicomponent para... |

3 |
Bovik, \AM-FM models, the analytic image, and nonlinear demodulation techniques
- Havlicek, C
- 1995
(Show Context)
Citation Context ...ined after the theorem Theorem 1: Let be finite and let and be any pair of conjugate exponents, , such that . Then (8) (9) (10) Proof: The lengthy proof, which is omitted for brevity, may be found in =-=[31]-=- and proceeds along arguments similar to those used to prove [11, Theorem 1]. The dimensionally dependent terms and emerge as natural conditions for convergence of the involved integrals. The bound (1... |

2 | A Bovik, Extracting essential modulated image structure
- Havlicek, Harding
- 1996
(Show Context)
Citation Context ...m likelihood estimation technique was demonstrated on synthetic two-component chirp signals in [17]. For multidimensional signals, the tracked multicomponent analysis (TMCA) approach reported in [6], =-=[18] i-=-s the only previous multicomponent AM–FM technique of which we are aware.s228 IEEE TRANSACTIONS ON IMAGE PROCESSING, VOL. 9, NO. 2, FEBRUARY 2000 This paper studies the problem of analyzing a comple... |

2 |
Demodulators for AM–FM models of speech signals: A comparison
- Lu, Doerschuk
- 1996
(Show Context)
Citation Context ...o, e.g., (1), and subsequently check for perceptual or quantitative agreement between the reconstruction and the original signal. This approach was used to evaluate the performance of MBDA in [5] and =-=[19]-=- and the performance of TMCA in [6], [18], and [20]. The question of whether quantitative or perceptual criteria are more appropriate for characterizing the extent to which the reconstructions and ori... |

2 |
Bovik, “Multi-component signal demodulation and reconstruction using AM–FM modulation models
- Havlicek, Harding, et al.
- 1995
(Show Context)
Citation Context ... or quantitative agreement between the reconstruction and the original signal. This approach was used to evaluate the performance of MBDA in [5] and [19] and the performance of TMCA in [6], [18], and =-=[20]-=-. The question of whether quantitative or perceptual criteria are more appropriate for characterizing the extent to which the reconstructions and originals agree is application dependent and remains u... |

2 |
Bovik, Stereo Disparity from multiscale processing of local image phase
- Tieh-Yuh, C
- 1995
(Show Context)
Citation Context ...inant modulations are useful for solving a variety of problems including texture segmentation [11], [32], three-dimensional (3-D) surface reconstruction [11], [33], [34], and computational stereopsis =-=[35]–[-=-37]. B. CCA CCA is depicted in the block diagram of Fig. 2. As in DCA, the filterbank channel responses are demodulated using (25) and (27) or (41)–(43). The component-wise decomposition of the sign... |

2 | Multiscale stereopsis via Gabor filter phase response - Chen, Bovik, et al. - 1994 |

2 | Theory and applications of the notion of complex signal - Selin - 1958 |

1 | Novel algorithm for image enhancement - Yu, Mitra, et al. - 1991 |

1 | et al., “Extension of the notion of analytic signal for multidimensional signals. Application to images - Peyrin, Zhu, et al. - 1986 |

1 |
from texture using local spectral moments
- “Shape
- 1995
(Show Context)
Citation Context ... vision applications, where the dominant modulations are useful for solving a variety of problems including texture segmentation [11], [32], three-dimensional (3-D) surface reconstruction [11], [33], =-=[34], an-=-d computational stereopsis [35]–[37]. B. CCA CCA is depicted in the block diagram of Fig. 2. As in DCA, the filterbank channel responses are demodulated using (25) and (27) or (41)–(43). The compo... |

1 |
Bovik, “Wideband frequency excursions in computed AM–FM image models
- Havlicek, Harding, et al.
(Show Context)
Citation Context ...andpass Gabor filtering was used to compensate for approximation errors in the TKEO. Large spikes in the TKEO amplitude estimates were also smoothed by median filtering in [2]. It was demonstrated in =-=[39]-=- that input phase discontinuities can lead to unbounded excursions in the channel response instantaneous frequencies. Furthermore, natural images andsHAVLICEK et al.: MULTIDIMENSIONAL QUASI-EIGENFUNCT... |