| cannam@14 | 1 | 
| cannam@14 | 2 Vamp | 
| cannam@14 | 3 ==== | 
| cannam@14 | 4 | 
| cannam@14 | 5 An API for audio analysis and feature extraction plugins. | 
| cannam@14 | 6 | 
| cannam@44 | 7    http://www.vamp-plugins.org/ | 
| cannam@44 | 8 | 
| cannam@14 | 9 Vamp is an API for C and C++ plugins that process sampled audio data | 
| cannam@18 | 10 to produce descriptive output (measurements or semantic observations). | 
| cannam@14 | 11 | 
| cannam@14 | 12 The principal differences between Vamp and a real-time audio | 
| cannam@14 | 13 processing plugin system such as VST are: | 
| cannam@14 | 14 | 
| cannam@14 | 15  * Vamp plugins may output complex multidimensional data with labels. | 
| cannam@14 | 16    As a consequence, they are likely to work best when the output | 
| cannam@14 | 17    data has a much lower sampling rate than the input.  (This also | 
| cannam@14 | 18    means it is usually desirable to implement them in C++ using the | 
| cannam@14 | 19    high-level base class provided rather than use the raw C API.) | 
| cannam@14 | 20 | 
| cannam@14 | 21  * While Vamp plugins receive data block-by-block, they are not | 
| cannam@14 | 22    required to return output immediately on receiving the input. | 
| cannam@14 | 23    A Vamp plugin may be non-causal, preferring to store up data | 
| cannam@14 | 24    based on its input until the end of a processing run and then | 
| cannam@14 | 25    return all results at once. | 
| cannam@14 | 26 | 
| cannam@14 | 27  * Vamp plugins have more control over their inputs than a typical | 
| cannam@14 | 28    real-time processing plugin.  For example, they can indicate to | 
| cannam@18 | 29    the host their preferred processing block and step sizes, and these | 
| cannam@18 | 30    may differ. | 
| cannam@18 | 31 | 
| cannam@18 | 32  * Vamp plugins may ask to receive data in the frequency domain | 
| cannam@18 | 33    instead of the time domain.  The host takes the responsibility | 
| cannam@18 | 34    for converting the input data using an FFT of windowed frames. | 
| cannam@18 | 35    This simplifies plugins that do straightforward frequency-domain | 
| cannam@18 | 36    processing and permits the host to cache frequency-domain data | 
| cannam@18 | 37    when possible. | 
| cannam@14 | 38 | 
| cannam@14 | 39  * A Vamp plugin is configured once before each processing run, and | 
| cannam@78 | 40    receives no further parameter changes during use -- unlike real- | 
| cannam@14 | 41    time plugin APIs in which the input parameters may change at any | 
| cannam@14 | 42    time.  This also means that fundamental properties such as the | 
| cannam@14 | 43    number of values per output or the preferred processing block | 
| cannam@18 | 44    size may depend on the input parameters. | 
| cannam@14 | 45 | 
| cannam@38 | 46  * Vamp plugins do not have to be able to run in real time. | 
| cannam@38 | 47 | 
| cannam@14 | 48 | 
| cannam@14 | 49 About this SDK | 
| cannam@14 | 50 ============== | 
| cannam@14 | 51 | 
| cannam@162 | 52 This is version 1.3 of the Vamp plugin Software Development Kit. | 
| cannam@78 | 53 Plugins and hosts built with this SDK are binary compatible with those | 
| cannam@78 | 54 built using version 1.0 of the SDK. | 
| cannam@78 | 55 | 
| cannam@78 | 56 This SDK contains the following: | 
| cannam@14 | 57 | 
| cannam@14 | 58  * vamp/vamp.h | 
| cannam@14 | 59 | 
| cannam@14 | 60 The formal C language plugin API for Vamp plugins. | 
| cannam@14 | 61 | 
| cannam@14 | 62 A Vamp plugin is a dynamic library (.so, .dll or .dylib depending on | 
| cannam@14 | 63 platform) exposing one C-linkage entry point (vampGetPluginDescriptor) | 
| cannam@14 | 64 which returns data defined in the rest of this C header. | 
| cannam@14 | 65 | 
| cannam@78 | 66 Although the C API is the official API for Vamp, we don't recommend | 
| cannam@78 | 67 that you program directly to it.  The C++ abstraction found in the | 
| cannam@78 | 68 vamp-sdk directory (below) is preferable for most purposes and is | 
| cannam@78 | 69 more thoroughly documented. | 
| cannam@14 | 70 | 
| cannam@14 | 71  * vamp-sdk | 
| cannam@14 | 72 | 
| cannam@14 | 73 C++ classes for straightforwardly implementing Vamp plugins and hosts. | 
| cannam@18 | 74 | 
| cannam@78 | 75 Plugins should subclass Vamp::Plugin and then use Vamp::PluginAdapter | 
| cannam@78 | 76 to expose the correct C API for the plugin.  Plugin authors should | 
| cannam@78 | 77 read vamp-sdk/PluginBase.h and Plugin.h for code documentation, and | 
| cannam@78 | 78 refer to the example plugin code in the examples directory.  Plugins | 
| cannam@162 | 79 should link with -lvamp-sdk. | 
| cannam@18 | 80 | 
| cannam@14 | 81 Hosts may use the Vamp::PluginHostAdapter to convert the loaded | 
| cannam@78 | 82 plugin's C API back into a Vamp::Plugin object.  Host authors should | 
| cannam@78 | 83 refer to the example host code in the host directory.  Hosts should | 
| cannam@162 | 84 link with -lvamp-hostsdk. | 
| cannam@14 | 85 | 
| cannam@64 | 86  * vamp-sdk/hostext | 
| cannam@64 | 87 | 
| cannam@75 | 88 Additional C++ classes to make a host's life easier (introduced in | 
| cannam@125 | 89 versions 1.1 and 1.2 of the Vamp SDK). | 
| cannam@64 | 90 | 
| cannam@78 | 91 Vamp::HostExt::PluginLoader provides a very easy interface for a host | 
| cannam@78 | 92 to discover, load, and find out category information about the | 
| cannam@64 | 93 available plugins.  Most "casual" Vamp hosts will probably want to use | 
| cannam@64 | 94 this class. | 
| cannam@64 | 95 | 
| cannam@78 | 96 Vamp::HostExt::PluginInputDomainAdapter provides a means for hosts to | 
| cannam@78 | 97 handle plugins that expect frequency-domain input, without having to | 
| cannam@78 | 98 convert the input themselves. | 
| cannam@64 | 99 | 
| cannam@78 | 100 Vamp::HostExt::PluginChannelAdapter provides a means for hosts to use | 
| cannam@78 | 101 plugins that do not necessarily support the same number of audio | 
| cannam@78 | 102 channels as they have available, without having to worry about | 
| cannam@78 | 103 applying a channel management / mixdown policy themselves. | 
| cannam@64 | 104 | 
| cannam@125 | 105 Vamp::HostExt::PluginBufferingAdapter provides a means for hosts to | 
| cannam@125 | 106 avoid having to negotiate the input step and block size, instead | 
| cannam@125 | 107 permitting the host to use any block size they desire (and a step size | 
| cannam@125 | 108 equal to it).  This is particularly useful for "streaming" hosts that | 
| cannam@125 | 109 cannot seek backwards in the input audio stream and so would otherwise | 
| cannam@125 | 110 need to implement an additional buffer to support step sizes smaller | 
| cannam@125 | 111 than the block size. | 
| cannam@125 | 112 | 
| cannam@75 | 113 The PluginLoader class can also use the input domain and channel | 
| cannam@75 | 114 adapters automatically to make the entire conversion process | 
| cannam@75 | 115 transparent to the host if required. | 
| cannam@64 | 116 | 
| cannam@14 | 117  * examples | 
| cannam@14 | 118 | 
| cannam@14 | 119 Example plugins implemented using the C++ classes.  ZeroCrossing | 
| cannam@14 | 120 calculates the positions and density of zero-crossing points in an | 
| cannam@35 | 121 audio waveform.  SpectralCentroid calculates the centre of gravity of | 
| cannam@14 | 122 the frequency domain representation of each block of audio. | 
| cannam@78 | 123 AmplitudeFollower tracks the amplitude of a signal based on a method | 
| cannam@78 | 124 from the SuperCollider real-time audio system. | 
| cannam@35 | 125 PercussionOnsetDetector estimates the locations of percussive onsets | 
| cannam@35 | 126 using a simple method described in "Drum Source Separation using | 
| cannam@35 | 127 Percussive Feature Detection and Spectral Modulation" by Dan Barry, | 
| cannam@35 | 128 Derry Fitzgerald, Eugene Coyle and Bob Lawlor, ISSC 2005. | 
| cannam@14 | 129 | 
| cannam@14 | 130  * host | 
| cannam@14 | 131 | 
| cannam@16 | 132 A simple command-line Vamp host, capable of loading a plugin and using | 
| cannam@16 | 133 it to process a complete audio file, with its default parameters. | 
| cannam@64 | 134 Requires libsndfile (http://www.mega-nerd.com/libsndfile/). | 
| cannam@64 | 135 | 
| cannam@64 | 136 If you don't have libsndfile, you may want to edit the Makefile to | 
| cannam@75 | 137 change the default build target from "all" to "sdk", so as to compile | 
| cannam@75 | 138 only the SDK and not the host. | 
| cannam@14 | 139 | 
| cannam@40 | 140 | 
| cannam@40 | 141 Plugin Lookup and Categorisation | 
| cannam@40 | 142 ================================ | 
| cannam@40 | 143 | 
| cannam@40 | 144 The Vamp API does not officially specify how to load plugin libraries | 
| cannam@40 | 145 or where to find them.  However, the SDK does include a function | 
| cannam@40 | 146 (Vamp::PluginHostAdapter::getPluginPath()) that returns a recommended | 
| cannam@75 | 147 directory search path that hosts may use for plugin libraries, and a | 
| cannam@75 | 148 class (Vamp::HostExt::PluginLoader) that implements a sensible | 
| cannam@75 | 149 cross-platform lookup policy using this path.  We recommend using this | 
| cannam@75 | 150 class in your host unless you have a good reason not to want to.  This | 
| cannam@75 | 151 implementation also permits the user to set the environment variable | 
| cannam@75 | 152 VAMP_PATH to override the default path if desired. | 
| cannam@40 | 153 | 
| cannam@75 | 154 The policy used by Vamp::HostExt::PluginLoader -- and our | 
| cannam@75 | 155 recommendation for any host -- is to search each directory in the path | 
| cannam@75 | 156 returned by getPluginPath for .DLL (on Windows), .so (on Linux, | 
| cannam@75 | 157 Solaris, BSD etc) or .dylib (on OS/X) files, then to load each one and | 
| cannam@75 | 158 perform a dynamic name lookup on the vampGetPluginDescriptor function | 
| cannam@75 | 159 to enumerate the plugins in the library.  This operation will | 
| cannam@75 | 160 necessarily be system-dependent. | 
| cannam@40 | 161 | 
| cannam@40 | 162 Vamp also has an informal convention for sorting plugins into | 
| cannam@40 | 163 functional categories.  In addition to the library file itself, a | 
| cannam@40 | 164 plugin library may install a category file with the same name as the | 
| cannam@40 | 165 library but .cat extension.  The existence and format of this file are | 
| cannam@40 | 166 not specified by the Vamp API, but by convention the file may contain | 
| cannam@40 | 167 lines of the format | 
| cannam@40 | 168 | 
| cannam@40 | 169 vamp:pluginlibrary:pluginname::General Category > Specific Category | 
| cannam@40 | 170 | 
| cannam@40 | 171 which a host may read and use to assign plugins a location within a | 
| cannam@40 | 172 category tree for display to the user.  The expectation is that | 
| cannam@40 | 173 advanced users may also choose to set up their own preferred category | 
| cannam@40 | 174 trees, which is why this information is not queried as part of the | 
| cannam@75 | 175 Vamp plugin's API itself.  The Vamp::HostExt::PluginLoader class also | 
| cannam@75 | 176 provides support for plugin category lookup using this scheme. | 
| cannam@32 | 177 | 
| cannam@14 | 178 | 
| cannam@162 | 179 Compiling the SDK and Examples | 
| cannam@162 | 180 ============================== | 
| cannam@14 | 181 | 
| cannam@162 | 182 This SDK is intended for use on Windows, OS/X, Linux, and other POSIX | 
| cannam@162 | 183 platforms. | 
| cannam@162 | 184 | 
| cannam@162 | 185  * Windows | 
| cannam@162 | 186 | 
| cannam@162 | 187 A project file for Visual Studio is included (VampPluginSDK.vcproj). | 
| cannam@162 | 188 This builds the SDK library, but does not build the example plugins or | 
| cannam@162 | 189 command-line host. | 
| cannam@162 | 190 | 
| cannam@162 | 191 Alternatively, when using Visual Studio or another IDE to build a | 
| cannam@162 | 192 plugin or host using the SDK, you can simply add the .cpp files in the | 
| cannam@162 | 193 vamp-sdk and vamp-sdk/hostext directories to your existing project. | 
| cannam@162 | 194 | 
| cannam@162 | 195 If you are using a Cygwin or MinGW GNU toolchain, use the included | 
| cannam@162 | 196 Makefile (see Linux and other POSIX platforms below). | 
| cannam@162 | 197 | 
| cannam@162 | 198  * OS/X | 
| cannam@162 | 199 | 
| cannam@162 | 200 Run "make -f Makefile.osx" to build the SDK, example plugins, and | 
| cannam@162 | 201 command-line host. | 
| cannam@162 | 202 | 
| cannam@162 | 203 Note that the host requires that you have libsndfile | 
| cannam@162 | 204 (http://www.mega-nerd.com/libsndfile/) installed.  To build only the | 
| cannam@162 | 205 SDK and examples, "make -f Makefile.osx sdk examples". | 
| cannam@162 | 206 | 
| cannam@162 | 207 If you are using an IDE, you may prefer to simply add the .cpp files | 
| cannam@162 | 208 in the vamp-sdk and vamp-sdk/hostext directories to your existing | 
| cannam@162 | 209 project. | 
| cannam@162 | 210 | 
| cannam@162 | 211  * Linux and other POSIX platforms | 
| cannam@162 | 212 | 
| cannam@162 | 213 To build the SDK, example plugins, and command-line host, edit the | 
| cannam@42 | 214 Makefile to suit your platform according to the comments in it, then | 
| cannam@42 | 215 run "make". | 
| cannam@42 | 216 | 
| cannam@162 | 217 Note that the host requires that you have libsndfile | 
| cannam@162 | 218 (http://www.mega-nerd.com/libsndfile/) installed.  To build only the | 
| cannam@162 | 219 SDK and examples, edit the Makefile then run "make sdk examples". | 
| cannam@94 | 220 | 
| cannam@162 | 221 | 
| cannam@162 | 222 Installing the Example Plugins | 
| cannam@162 | 223 ============================== | 
| cannam@85 | 224 | 
| cannam@42 | 225 Installing the example plugins so that they can be found by other Vamp | 
| cannam@42 | 226 hosts depends on your platform: | 
| cannam@42 | 227 | 
| cannam@44 | 228  * Windows: copy the files | 
| cannam@44 | 229       examples/vamp-example-plugins.dll | 
| cannam@44 | 230       examples/vamp-example-plugins.cat | 
| cannam@44 | 231    to | 
| cannam@44 | 232       C:\Program Files\Vamp Plugins | 
| cannam@42 | 233 | 
| cannam@44 | 234  * Linux: copy the files | 
| cannam@44 | 235       examples/vamp-example-plugins.so | 
| cannam@44 | 236       examples/vamp-example-plugins.cat | 
| cannam@44 | 237    to | 
| cannam@44 | 238       /usr/local/lib/vamp/ | 
| cannam@42 | 239 | 
| cannam@44 | 240  * OS/X: copy the files | 
| cannam@44 | 241       examples/vamp-example-plugins.dylib | 
| cannam@44 | 242       examples/vamp-example-plugins.cat | 
| cannam@44 | 243    to | 
| cannam@44 | 244       /Library/Audio/Plug-Ins/Vamp | 
| cannam@42 | 245 | 
| cannam@14 | 246 | 
| cannam@14 | 247 Licensing | 
| cannam@14 | 248 ========= | 
| cannam@14 | 249 | 
| cannam@18 | 250 This plugin SDK is freely redistributable under a "new-style BSD" | 
| cannam@42 | 251 licence.  See the file COPYING for more details.  In short, you may | 
| cannam@42 | 252 modify and redistribute the SDK and example plugins within any | 
| cannam@42 | 253 commercial or non-commercial, proprietary or open-source plugin or | 
| cannam@42 | 254 application under almost any conditions, with no obligation to provide | 
| cannam@42 | 255 source code, provided you retain the original copyright note. | 
| cannam@14 | 256 | 
| cannam@14 | 257 | 
| cannam@14 | 258 See Also | 
| cannam@14 | 259 ======== | 
| cannam@14 | 260 | 
| cannam@14 | 261 Sonic Visualiser, an interactive open-source graphical audio | 
| cannam@14 | 262 inspection, analysis and visualisation tool supporting Vamp plugins. | 
| cannam@35 | 263 http://www.sonicvisualiser.org/ | 
| cannam@14 | 264 | 
| cannam@14 | 265 | 
| cannam@44 | 266 Authors | 
| cannam@44 | 267 ======= | 
| cannam@44 | 268 | 
| cannam@44 | 269 Vamp and the Vamp SDK were designed and made at the Centre for Digital | 
| cannam@64 | 270 Music at Queen Mary, University of London. | 
| cannam@44 | 271 | 
| cannam@127 | 272 The SDK was written by Chris Cannam, copyright (c) 2005-2008 | 
| cannam@64 | 273 Chris Cannam and QMUL. | 
| cannam@64 | 274 | 
| cannam@64 | 275 Mark Sandler and Christian Landone provided ideas and direction, and | 
| cannam@64 | 276 Mark Levy, Dan Stowell, Martin Gasser and Craig Sapp provided testing | 
| cannam@64 | 277 and other input for the 1.0 API and SDK.  The API also uses some ideas | 
| cannam@64 | 278 from prior plugin systems, notably DSSI (http://dssi.sourceforge.net) | 
| cannam@64 | 279 and FEAPI (http://feapi.sourceforge.net). | 
| cannam@64 | 280 |