Abstract

The aim of this overview is to describe methods for the automatic transcription of Western polyphonic music. The transcription task is here understood as transforming an acoustic musical signal into a MIDI-like symbolic representation. Only pitched musical instruments are considered: recognizing the sounds of drum instruments is not discussed. The main emphasis is laid on estimating the multiple fundamental frequencies of several concurrent sounds. Various approaches to solve this problem are discussed, including methods that are based on modelling the human auditory periphery, methods that mimic the human auditory scene analysis function, signal model-based Bayesian inference methods, and data-adaptive methods. Another subproblem addressed is the rhythmic parsing of acoustic musical signals. From the transcription point of view, this amounts to the temporal segmentation of music signals at different time scales. The relationship between the two subproblems and the general structure of the transcription problem is discussed. 1.

Citations

395	A Generative Theory of Tonal Music - Lerdahl, Jackendoff - 1983
362	Auditory scene analysis - Bregman - 1990
124	Prediction-driven computational auditory scene analysis - Ellis - 1996
121	Automatic extraction of tempo and beat from expressive performances - Dixon - 2001
114	Musical Sound Modeling with Sinusoids plus Noise - Serra
114	The cognition of basic musical structures - Temperley - 2001
93	MJ Virtual pitch and phase sensitivity of a computer model of the auditory periphery - Hewitt - 1991
84	a fundamental frequency estimator for speech and music - Cheveign´e, Kawahara, et al. - 2002
73	Resonance and the perception of musical meter - LARGE, KOLEN - 1994
71	A Computationally Efficient Multipitch Analysis Model - Tolonen, Karjalainen - 2000
67	Separation of speech from interfering sounds based on oscillatorycorrelation. Neural Networks - Wang, Brown - 1999
53	Tracking musical beats in real time - Allen, Dannenberg - 1990
51	A perceptual model of pulse salience and metrical accent in musical rhythms - Parncutt - 1994
49	Determination of the meter of musical scores by autocorrelation - Brown - 1993
49	A multipitch tracking algorithm for noisy speech - Wu, Wang, et al. - 2003
47	Fundamental frequency estimation of musical signals using a two-way mismatch procedure - Maher, Beauchamp - 1994
46	Multiple fundamental frequency estimation based on harmonicity and spectral smoothness - Klapuri - 2003
46	A Blackboard System for Automatic Transcription of Simple Polyphonic Music - Martin - 1996
44	Monte Carlo methods for Tempo Tracking and Rhythm Quantization - Cemgil, Kappen - 2003
44	Music understanding at the beat level: Real-time beat tracking of audio signals - Goto, Muraoka - 1998
41	Event formation and separation in musical sound - Mellinger - 1992
40	The auditory organization of speech and other sources in listeners and computational models - Cooke, Ellis
39	Sound source separation using sparse coding with temporal continuity objective - Virtanen - 2003
37	Transcription of simple polyphonic music: Robust front end processing - Martin - 1996
36	Bayesian Harmonic Models for Musical Signal Analysis - Davy, Godsill - 2003
34	Audio Representation for Data Compression and Compressed Domain Processing - Levine
34	On the segmentation and analysis of continuous musical sound by digital computer - Moorer - 1975
33	Computational models of beat induction: The rule-based approach - Desain, Honing
33	Techniques for the automated analysis of musical audio - Hainsworth - 2004
33	Signal processing methods for the automatic transcription of music - Klapuri - 2004
32	Structure out of sound - Hawley - 1993
29	Multiple period estimation and pitch perception model - Cheveigné, Kawahara - 1999
29	Fundamental frequency estimation and tracking using maximumlikelihood harmonic matching and HMMs - Doval, Rodet - 1993
29	Comparison of features for musical instrument recognition - Eronen - 2001
28	Musical fundamental frequency tracking using a pattern recognition method - Brown - 1992
28	A blackboard architecture for computational auditory scene analysis - Godsmark, Brown - 1999
28	A sound source identification system for ensemble music based on template adaptation and music stream extraction - Kashino, Murase - 1999
27	Musical frequency tracking using the methods of conventional and 'narrowed' autocorrelation - Brown, Zhang - 1991
27	Machine rhythm: Computer emulation of human rhythm perception - Rosenthal - 1992
26	Estimating tempo, swing and beat locations in audio recordings - Laroche - 2001
26	A unitary model of pitch perception - Meddis, O’Mard - 1997
25	Model-Based Segmentation of Time-Frequency Images for Musical Transcription - Sterian - 1999
24	Modeling meter and harmony: A preference-rule approach - Temperley, Sleator - 1999
23	Sub-band independent subspace analysis for drum transcription - FitzGerald, Lawlor, et al. - 2002
23	The Perception of Metrical Structure: Experimental Evidence and a - Lee - 1991
23	Automated rhythm transcription - Raphael
22	Mid-level representations for Computational Auditory Scene Analysis - Ellis - 1995
22	A sound source separation system with the ability of automatic tone modeling - Kashino, Tanaka - 1993
22	Conventional and periodic Ngrams in the transcription of drum sequences - Paulus, Klapuri
21	Exploration of techniques for automatic labeling of audio drum tracks instruments - Gouyon, Herrera - 2001