DMCA
Combining Pitch-Based Inference and Non-Negative Spectrogram Factorization in Separating Vocals from Polyphonic Music
| Citations: | 17 - 3 self |
BibTeX
@MISC{Virtanen_combiningpitch-based,
author = {Tuomas Virtanen and Annamaria Mesaros and Matti Ryynänen},
title = {Combining Pitch-Based Inference and Non-Negative Spectrogram Factorization in Separating Vocals from Polyphonic Music},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
This paper proposes a novel algorithm for separating vocals from polyphonic music accompaniment. Based on pitch estimation, the method first creates a binary mask indicating timefrequency segments in the magnitude spectrogram where harmonic content of the vocal signal is present. Second, nonnegative matrix factorization (NMF) is applied on the non-vocal segments of the spectrogram in order to learn a model for the accompaniment. NMF predicts the amount of noise in the vocal segments, which allows separating vocals and noise even when they overlap in time and frequency. Simulations with commercial and synthesized acoustic material show an average improvement of 1.3 dB and 1.8 dB, respectively, in comparison with a reference algorithm based on sinusoidal modeling, and also the perceptual quality of the separated vocals is clearly improved. The method was also tested in aligning separated vocals and textual lyrics, where it produced better results than the reference method. Index Terms: sound source separation, non-negative matrix factorization, unsupervised learning, pitch estimation
Keyphrases
polyphonic music non-negative spectrogram factorization pitch-based inference separated vocal pitch estimation index term unsupervised learning perceptual quality sound source separation non-vocal segment nonnegative matrix factorization polyphonic music accompaniment reference algorithm magnitude spectrogram binary mask textual lyric non-negative matrix factorization average improvement novel algorithm vocal segment harmonic content synthesized acoustic material show sinusoidal modeling reference method vocal signal timefrequency segment
