Audio Features and Vamp Plugins » History » Version 5

Chris Cannam, 2015-07-15 12:36 PM

1 1 Chris Cannam
h1. Audio Features and Vamp Plugins
2 1 Chris Cannam
3 1 Chris Cannam
h3. General outline
4 1 Chris Cannam
5 3 Chris Cannam
To be propagated to https://www.doc.gold.ac.uk/~mas01cr/teaching/dhoxss15/
6 3 Chris Cannam
7 1 Chris Cannam
# Introductory notes and slides on acoustics and audio (CR)
8 2 Chris Cannam
# Sonic Visualiser - hands on with waveform and spectrograms (CC)
9 1 Chris Cannam
# Introductory notes and slides on audio features (CC)
10 1 Chris Cannam
# Sonic Visualiser - hands on with Vamp plugins (CC)
11 1 Chris Cannam
# Python/IPython intro (CR)
12 3 Chris Cannam
# Feature Extraction using Vamp Plugins in Python (IPython Notebook) (CC)
13 3 Chris Cannam
# Audio Indexing and Search in Python (IPython Notebook) (CR)
14 3 Chris Cannam
15 3 Chris Cannam
h3. Breakdown of CC sections
16 3 Chris Cannam
17 4 Chris Cannam
h5. Sonic Visualiser - hands on with waveform and spectrograms
18 3 Chris Cannam
19 5 Chris Cannam
# Waveform
20 5 Chris Cannam
## Start Sonic Visualiser and open "A Friendly Warning"
21 5 Chris Cannam
## Play from the start, just to note what it sounds like
22 5 Chris Cannam
## Return to the start and zoom in (using the zoom wheel, but noting that the mouse wheel also works)
23 5 Chris Cannam
## Notice the different shapes in waveform resulting from different types of synthetic percussive sound (low-frequency kick drum / higher frequency cymbal-type sounds)
24 5 Chris Cannam
## Continue until the vocal starts, and observe that we can see very little that relates to e.g. sung pitch, although if we zoom in we can quite clearly see sibilance (these frequencies around 10kHz are pretty much the sweet spot for visibility in a 44.1kHz waveform)
25 5 Chris Cannam
26 4 Chris Cannam
h5. Introductory notes and slides on audio features
27 3 Chris Cannam
28 4 Chris Cannam
h5. Sonic Visualiser - hands on with Vamp plugins
29 3 Chris Cannam
30 3 Chris Cannam
h5. Feature Extraction using Vamp Plugins in Python
31 3 Chris Cannam
32 3 Chris Cannam
h3. Materials
33 3 Chris Cannam
34 3 Chris Cannam
* Audio features slides: "PDF":https://code.soundsoftware.ac.uk/projects/dhoxss15/repository/raw/vamp-sv.pdf, "PowerPoint":https://code.soundsoftware.ac.uk/projects/dhoxss15/repository/raw/vamp-sv.pptx
35 3 Chris Cannam
36 3 Chris Cannam
* "IPython Notebook for Vamp Plugins in Python":https://code.soundsoftware.ac.uk/projects/dhoxss15/repository/raw/Vamp.v3.ipynb