DMCA
accepted to appear in IEEE TRANSACTIONS ON MULTIMEDIA A Query-by-Singing System for Retrieving Karaoke Music
BibTeX
@MISC{Yu_acceptedto,
author = {Hung-ming Yu and Wei-ho Tsai and Hsin-min Wang and Senior Member},
title = {accepted to appear in IEEE TRANSACTIONS ON MULTIMEDIA A Query-by-Singing System for Retrieving Karaoke Music},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract—This paper investigates the problem of retrieving karaoke music using query-by-singing techniques. Unlike regular CD music, where the stereo sound involves two audio channels that usually sound the same, karaoke music encompasses two distinct channels in each track: one is a mixture of the lead vocals and background accompaniment, and the other consists of accompaniment only. Although the two audio channels are distinct, the accompaniments in the two channels often resemble each other. We exploit this characteristic to (i) infer the background accompaniment for the lead vocals from the accompaniment-only channel, so that the main melody underlying the lead vocals can be extracted more effectively; and (ii) detect phrase onsets based on the Bayesian Information Criterion (BIC) to predict the onset points of a song where a user’s sung query may begin, so that the similarity between the melodies of the query and the song can be examined more efficiently. To further refine extraction of the main melody, we propose correcting potential errors in the estimated sung notes by exploiting a composition characteristic of popular songs whereby the sung notes within a verse or chorus section usually vary no more than two octaves. In addition, to facilitate an efficient and accurate search of a large music database, we employ multiple-pass Dynamic Time Warping (DTW) combined with multiple-level data abstraction (MLDA) to compare the similarities of melodies. The results of experiments conducted on a karaoke database comprised of 1,071 popular songs demonstrate the feasibility of query-by-singing retrieval for karaoke music.
Keyphrases
karaoke music ieee transaction multimedia query-by-singing system lead vocal popular song main melody sung note audio channel background accompaniment stereo sound onset point large music database potential error detect phrase onset query-by-singing technique multiple-pass dynamic time warping multiple-level data abstraction user sung query bayesian information criterion regular cd music composition characteristic accompaniment-only channel accurate search query-by-singing retrieval distinct channel refine extraction karaoke database music encompasses chorus section
