August 19, 2003

BACK

Publications on the Visualization of Music :

• J. Foote et al. :
  • Automatic Music Summarization via Similarity Analysis, 2002.
  • Visualizing music and audio using self-similarity, 1999.
• S. Smith et al. :
  • A visualization of music, 1997.

BibTeX references.

Web links:

• The Shape of Song : www.turbulence.org/Works/song/
• International Conference on Auditory Display (ICAD)

We present methods for automatically producing summary excerpts or thumbnails of music. To find the most representative excerpt, we maximize the average segment similarity to the entire work. After window-based audio parameterization, a quantitative similarity measure is calculated between every pair of windows, and the results are embedded in a 2-D similarity matrix. Summing the similarity matrix over the support of a segment results in a measure of how similar that segment is to the whole. This can be maximized to find the segment that best represents the entire work. We discuss variations on the method, and present experimental results for orchestral music, popular songs, and jazz. These results demonstrate that the method finds significantly representative excerpts, using very few assumptions about the source audio.

This paper presents a novel approach to visualizing the time structure of music and audio. The acoustic similarity between any two instants of an audio recording is displayed in a 2D representation, allowing identification of structural and rhythmic characteristics. Examples are presented for classical and popular music. Applications include content-based analysis and segmentation, as well as tempo and structure extraction.

BACK

Page created & maintained by Frederic Leymarie, 2003.
Comments, suggestions, etc., mail to: leymarie@lems.brown.edu