Abstract

October, 2007“I certify that this thesis and the research to which it refers are the product of my own work, and that any ideas or quotations from the work of other people, published or otherwise, are fully acknowledged in accordance with the standard referencing practices of the discipline. This thesis presents the theory, implementation and applications of the harmonic sinusoid modeling of pitched audio events. Harmonic sinusoid modeling is a parametric model that expresses an audio signal, or part of an audio signal, as the linear combination of concurrent slow-varying sinusoids, grouped together under harmonic frequency constraints. The harmonic sinusoid modeling is an extension of the sinusoid modeling, with the additional frequency constraints so that it is capable to directly model tonal sounds. This enables applications such as object-oriented audio manipulations, polyphonic transcription, instrument/singer recognition with background music, etc. The modeling system consists of an analyzer and a synthesizer. The analyzer

Citations

268	Speech analysis/synthesis based on a sinusoidal representation - McAulay, Quatieri - 1986
230	An Introduction to the Psychology of Hearing - Moore - 2003
222	Discrete-time signal processing - Oppenheim, Schafer - 1989
196	Modern Spectral Estimation: Theory and Application - Kay - 1988
179	Linear Prediction of Speech - MARKEL, GRAY - 1976
160	Mel frequency cepstral coefficients for music modeling - Logan - 2000
124	Fundamentals of computational auditory scene analysis - Wang, Brown - 2006
124	Prediction-driven computational auditory scene analysis - Ellis - 1996
114	Musical Sound Modeling with Sinusoids plus Noise - Serra
78	A real-time music scene description system: Predominant-F0 estimation for detecting melody and bass lines in real-world audio signals - Goto
75	A system for sound analysis/transformation/synthesis based on a deterministic plus stochastic decomposition - Serra - 1989
72	A Wavelet Tour of Signal Processing, 2nd ed - Mallat - 1999
65	RWC Music Database: Popular, classical, and jazz music databases - Goto, Hashiguchi, et al. - 2002
58	A unified approach to short-time fourier analysis and synthesis - Allen, Rabiner - 1977
57	A tutorial on onset detection in music signals - Bello, Daudet, et al. - 2005
52	Musical instrument recognition using cepstral coefficients and temporal features - Klapuri - 2000
50	Locating singing voice segments within music signals - Berenzweig, Ellis - 2001
48	Musical Sound Signal Analysis/Synthesis: Sinusoidal+Residual and Elementary Waveform Models - Rodet - 1997
42	Harmonic decomposition of audio signals with matching pursuit - Gribonval, Bacry - 2003
37	Rodet X, Tracking of Partials for Additive Sound Synthesis using Hidden Markov Models - Depalle, Garcia - 1993
36	Bayesian Harmonic Models for Musical Signal Analysis - Davy, Godsill - 2003
34	generalized wavelet transform for Fourier analysis: the multiresolution Fourier transform and its application to image and audio signal analysis",IEEE Trans - Wilson, Calway, et al. - 1992
32	Instrument recognition in polyphonic music based on automatic taxonomies - Essid, Richard, et al. - 2006
31	A high resolution fundamental frequency determination based on phase changes of the furier transform - Brown, Puckette - 1993
31	Robust Multipitch Estimation for the Analysis and Manipulation of Polyphonic Musical Signals - Klapuri, Virtanen, et al. - 2000
28	Musical fundamental frequency tracking using a pattern recognition method - Brown - 1992
28	Onset Detection Revisited - Dixon - 2006
27	Polyphonic pitch tracking using joint Bayesian estimation of multiple frame parameters - Walmsley, Godsill, et al. - 1999
26	Multipitch estimation and sound separation by the spectral smoothness principle - Klapuri - 2001
24	Spectral envelopes and inverse fft synthesis - Rodet, Depalle - 1992
23	Time-scale modification of speech based on short-time fourier analysis - Portnoff - 1981
23	Frequency line tracking using hidden Markov models - Streit, Barret - 1990
22	Survey on extraction of sinusoids in stationary sounds - Keiler, Marchand - 2002
22	New phase vocoder techniques for pitch-shifting, harmonizing and other exotic effects - Laroche, Dolson - 1999
21	The forward-backward search algorithm - Austin, Schwartz, et al. - 1991
18	Bayesian harmonic models for musical pitch estimation and analysis - Davy, Godsill - 2002
18	auditory organization - Pitch - 1996
16	Highprecision Fourier analysis of sounds using signal derivatives - Desainte-Catherine, Marchand - 2000
16	HILN - the MPEG-4 parametric audio coding tools - Purnhagen, Meine - 2000
15	Object-based analysis/synthesis audio coder for very low bit rates - Purnhagen, Edler, et al. - 1998
14	Singer identification based on accompaniment sound reduction and reliable frame selection - Fujihara, Kitahara, et al. - 2005
14	A Sines+Transients+Noise Audio Representation for Data Conpression and Time/Pitch Scale Modifications - Levine, Smith - 1998
14	Magnitude-Only Reconstruction Using a Sinusoidal Speech - McAulay, Quartieri - 1984
13	Generation of partials due to nonlinear mixing in a stringed instrument - Conklin - 1999
13	Methods for Separation of Harmonic Sound Sources using Sinusoidal Modeling - Tolonen - 1999
12	Audio signal modeling with sinusoids plus noise - Virtanen - 2000
10	Enhanced partial tracking using linear prediction - Lagrange, Marchand, et al. - 2003
7	Wide-band pitch estimation for natural sound sources with inharmonicities - Klapuri - 1999
6	Notes on the theory of modulation - Carson - 1922
5	Improving the Readibility of Time-Frequency and Time-Scale Representations by the Reassignment Method - Auger, Flandrin - 1995