Audio Features and Vamp Plugins¶

General outline¶

To be propagated to https://www.doc.gold.ac.uk/~mas01cr/teaching/dhoxss15/

1. Introductory notes and slides on acoustics and audio (CR)
2. Sonic Visualiser - hands on with waveform and spectrograms (CC)
3. Introductory notes and slides on audio features (CC)
4. Sonic Visualiser - hands on with Vamp plugins (CC)
5. Python/IPython intro (CR)
6. Feature Extraction using Vamp Plugins in Python (IPython Notebook) (CC)
7. Audio Indexing and Search in Python (IPython Notebook) (CR)

Breakdown of CC sections¶

Sonic Visualiser - hands on with waveform and spectrograms¶

1. Waveform
   1. Start Sonic Visualiser and open "A Friendly Warning"
   2. Play from the start, just to note what it sounds like
   3. Return to the start and zoom in (using the zoom wheel, but noting that the mouse wheel also works)
   4. Notice the different shapes in waveform resulting from different types of synthetic percussive sound (low-frequency kick drum / higher frequency cymbal-type sounds)
   5. Continue until the vocal starts, and observe that we can see very little that relates to e.g. sung pitch, although if we zoom in we can quite clearly see sibilance (these frequencies around 10kHz are pretty much the sweet spot for visibility in a 44.1kHz waveform)

Introductory notes and slides on audio features¶

Sonic Visualiser - hands on with Vamp plugins¶

Feature Extraction using Vamp Plugins in Python¶

Materials¶

• Audio features slides: PDF, PowerPoint

• IPython Notebook for Vamp Plugins in Python