annotate README @ 323:b070230a1fc8

Added tag vamp-plugin-sdk-v2.3 for changeset 71b69f569f52
author Chris Cannam
date Wed, 28 Sep 2011 16:36:32 +0100
parents 2351610cd3b0
children ef1dc9963638
rev   line source
cannam@14 1
cannam@14 2 Vamp
cannam@14 3 ====
cannam@14 4
cannam@14 5 An API for audio analysis and feature extraction plugins.
cannam@14 6
cannam@44 7 http://www.vamp-plugins.org/
cannam@44 8
cannam@14 9 Vamp is an API for C and C++ plugins that process sampled audio data
cannam@18 10 to produce descriptive output (measurements or semantic observations).
cannam@14 11
Chris@315 12 This is version 2.2.1 of the Vamp plugin Software Development Kit.
cannam@256 13
cannam@78 14 Plugins and hosts built with this SDK are binary compatible with those
cannam@256 15 built using version 1.0 of the SDK, with certain restrictions. See
cannam@256 16 the file README.compat for more details.
cannam@256 17
cannam@256 18 See the file CHANGELOG for a list of the changes in this release.
cannam@78 19
cannam@215 20 A documentation guide to writing plugins using the Vamp SDK can be
cannam@215 21 found at http://www.vamp-plugins.org/guide.pdf .
cannam@215 22
cannam@239 23
cannam@239 24 Compiling and Installing the SDK and Examples
cannam@239 25 =============================================
cannam@239 26
cannam@239 27 This SDK is intended for use on Windows, OS/X, Linux, and other POSIX
cannam@239 28 and GNU platforms.
cannam@239 29
cannam@239 30 Please see the platform-specific README file (README.msvc, README.osx,
cannam@239 31 README.linux) in the build/ directory for details about how to compile
cannam@239 32 and install the SDK, how to build plugin libraries using it, and how
cannam@239 33 to install the example plugins so you can use them in a host.
cannam@239 34
cannam@239 35
cannam@239 36 What's In This SDK
cannam@239 37 ==================
cannam@239 38
cannam@78 39 This SDK contains the following:
cannam@14 40
cannam@239 41
cannam@239 42 vamp/vamp.h
cannam@239 43 -----------
cannam@14 44
cannam@14 45 The formal C language plugin API for Vamp plugins.
cannam@14 46
cannam@14 47 A Vamp plugin is a dynamic library (.so, .dll or .dylib depending on
cannam@14 48 platform) exposing one C-linkage entry point (vampGetPluginDescriptor)
cannam@14 49 which returns data defined in the rest of this C header.
cannam@14 50
cannam@78 51 Although the C API is the official API for Vamp, we don't recommend
cannam@239 52 that you program directly to it. The C++ abstractions found in the
cannam@239 53 vamp-sdk and vamp-hostsdk directories (below) are preferable for most
cannam@239 54 purposes and are more thoroughly documented.
cannam@14 55
cannam@239 56
cannam@239 57 vamp-sdk
cannam@239 58 --------
cannam@14 59
cannam@237 60 C++ classes for implementing Vamp plugins.
cannam@18 61
cannam@78 62 Plugins should subclass Vamp::Plugin and then use Vamp::PluginAdapter
cannam@78 63 to expose the correct C API for the plugin. Plugin authors should
cannam@239 64 read vamp-sdk/PluginBase.h and Plugin.h for code documentation.
cannam@18 65
cannam@239 66 See "examples" below for details of the example plugins in the SDK,
cannam@239 67 from which you are welcome to take code and inspiration.
cannam@239 68
cannam@239 69 Plugins should link with -lvamp-sdk.
cannam@239 70
cannam@239 71
cannam@239 72 vamp-hostsdk
cannam@239 73 ------------
cannam@14 74
cannam@237 75 C++ classes for implementing Vamp hosts.
cannam@64 76
cannam@239 77 Hosts will normally use a Vamp::PluginHostAdapter to convert each
cannam@239 78 plugin's exposed C API back into a useful Vamp::Plugin C++ object.
cannam@237 79
cannam@237 80 The Vamp::HostExt namespace contains several additional C++ classes to
cannam@239 81 do this work for them, and make the host's life easier:
cannam@64 82
cannam@239 83 - Vamp::HostExt::PluginLoader provides a very easy interface for a
cannam@239 84 host to discover, load, and find out category information about the
cannam@239 85 available plugins. Most Vamp hosts will probably want to use this
cannam@239 86 class.
cannam@64 87
cannam@239 88 - Vamp::HostExt::PluginInputDomainAdapter provides a simple means for
cannam@239 89 hosts to handle plugins that want frequency-domain input, without
cannam@239 90 having to convert the input themselves.
cannam@64 91
cannam@239 92 - Vamp::HostExt::PluginChannelAdapter provides a simple means for
cannam@239 93 hosts to use plugins that do not necessarily support the same number
cannam@239 94 of audio channels as they have available, without having to apply a
cannam@239 95 channel management / mixdown policy themselves.
cannam@64 96
cannam@239 97 - Vamp::HostExt::PluginBufferingAdapter provides a means for hosts to
cannam@239 98 avoid having to negotiate the input step and block size, instead
cannam@239 99 permitting the host to use any block size they desire (and a step
cannam@239 100 size equal to it). This is particularly useful for "streaming" hosts
cannam@239 101 that cannot seek backwards in the input audio stream and so would
cannam@239 102 otherwise need to implement an additional buffer to support step
cannam@239 103 sizes smaller than the block size.
cannam@125 104
cannam@239 105 - Vamp::HostExt::PluginSummarisingAdapter provides summarisation
cannam@239 106 methods such as mean and median averages of output features, for use
cannam@239 107 in any context where an available plugin produces individual values
cannam@239 108 but the result that is actually needed is some sort of aggregate.
cannam@64 109
cannam@239 110 The PluginLoader class can also use the input domain, channel, and
cannam@239 111 buffering adapters automatically to make these conversions transparent
cannam@239 112 to the host if required.
cannam@14 113
cannam@239 114 Host authors should also refer to the example host code in the host
cannam@239 115 directory of the SDK.
cannam@14 116
cannam@239 117 Hosts should link with -lvamp-hostsdk.
cannam@239 118
cannam@239 119
cannam@239 120 examples
cannam@239 121 --------
cannam@239 122
cannam@239 123 Example plugins implemented using the C++ classes.
cannam@239 124
cannam@239 125 These plugins are intended to be useful examples you can draw code
cannam@239 126 from in order to provide the basic shape and structure of a Vamp
cannam@239 127 plugin. They are also intended to be correct and useful, if simple.
cannam@239 128
cannam@239 129 - ZeroCrossing calculates the positions and density of zero-crossing
cannam@239 130 points in an audio waveform.
cannam@239 131
cannam@239 132 - SpectralCentroid calculates the centre of gravity of the frequency
cannam@239 133 domain representation of each block of audio.
cannam@239 134
cannam@242 135 - PowerSpectrum calculates a power spectrum from the input audio.
cannam@244 136 Actually, it doesn't do any work except calculating power from a
cannam@244 137 cartesian complex FFT output. The work of calculating this frequency
cannam@244 138 domain output is done for it by the host or host SDK; the plugin just
cannam@244 139 needs to declare that it wants frequency domain input. This is the
cannam@244 140 simplest of the example plugins.
cannam@242 141
cannam@239 142 - AmplitudeFollower is a simple implementation of SuperCollider's
cannam@239 143 amplitude-follower algorithm.
cannam@239 144
cannam@239 145 - PercussionOnsetDetector estimates the locations of percussive
cannam@239 146 onsets using a simple method described in "Drum Source Separation
cannam@239 147 using Percussive Feature Detection and Spectral Modulation" by Dan
cannam@239 148 Barry, Derry Fitzgerald, Eugene Coyle and Bob Lawlor, ISSC 2005.
cannam@239 149
cannam@239 150 - FixedTempoEstimator calculates a single beats-per-minute value
cannam@239 151 which is an estimate of the tempo of a piece of music that is assumed
cannam@239 152 to be of fixed tempo, using autocorrelation of a frequency domain
cannam@239 153 energy rise metric. It has several outputs that return intermediate
cannam@239 154 results used in the calculation, and may be a useful example of a
cannam@239 155 plugin having several outputs with varying feature structures.
cannam@239 156
cannam@239 157
cannam@290 158 skeleton
cannam@290 159 --------
cannam@290 160
cannam@290 161 Skeleton code that could be used as a template for your new plugin
cannam@290 162 implementation.
cannam@290 163
cannam@290 164
cannam@239 165 host
cannam@239 166 ----
cannam@14 167
cannam@16 168 A simple command-line Vamp host, capable of loading a plugin and using
cannam@16 169 it to process a complete audio file, with its default parameters.
cannam@14 170
cannam@250 171 This host also contains a number of options for listing the installed
cannam@250 172 plugins and their properties in various formats. For that reason, it
cannam@250 173 isn't really as simple as one might hope. The core of the code is
cannam@250 174 still reasonably straightforward, however.
cannam@250 175
cannam@40 176
cannam@40 177 Plugin Lookup and Categorisation
cannam@40 178 ================================
cannam@40 179
cannam@40 180 The Vamp API does not officially specify how to load plugin libraries
cannam@40 181 or where to find them. However, the SDK does include a function
cannam@40 182 (Vamp::PluginHostAdapter::getPluginPath()) that returns a recommended
cannam@75 183 directory search path that hosts may use for plugin libraries, and a
cannam@75 184 class (Vamp::HostExt::PluginLoader) that implements a sensible
cannam@75 185 cross-platform lookup policy using this path. We recommend using this
cannam@75 186 class in your host unless you have a good reason not to want to. This
cannam@75 187 implementation also permits the user to set the environment variable
cannam@75 188 VAMP_PATH to override the default path if desired.
cannam@40 189
cannam@75 190 The policy used by Vamp::HostExt::PluginLoader -- and our
cannam@75 191 recommendation for any host -- is to search each directory in the path
cannam@75 192 returned by getPluginPath for .DLL (on Windows), .so (on Linux,
cannam@75 193 Solaris, BSD etc) or .dylib (on OS/X) files, then to load each one and
cannam@75 194 perform a dynamic name lookup on the vampGetPluginDescriptor function
cannam@75 195 to enumerate the plugins in the library. This operation will
cannam@75 196 necessarily be system-dependent.
cannam@40 197
cannam@40 198 Vamp also has an informal convention for sorting plugins into
cannam@40 199 functional categories. In addition to the library file itself, a
cannam@40 200 plugin library may install a category file with the same name as the
cannam@40 201 library but .cat extension. The existence and format of this file are
cannam@40 202 not specified by the Vamp API, but by convention the file may contain
cannam@40 203 lines of the format
cannam@40 204
cannam@40 205 vamp:pluginlibrary:pluginname::General Category > Specific Category
cannam@40 206
cannam@40 207 which a host may read and use to assign plugins a location within a
cannam@40 208 category tree for display to the user. The expectation is that
cannam@40 209 advanced users may also choose to set up their own preferred category
cannam@40 210 trees, which is why this information is not queried as part of the
cannam@75 211 Vamp plugin's API itself. The Vamp::HostExt::PluginLoader class also
cannam@75 212 provides support for plugin category lookup using this scheme.
cannam@32 213
cannam@14 214
cannam@14 215 Licensing
cannam@14 216 =========
cannam@14 217
cannam@18 218 This plugin SDK is freely redistributable under a "new-style BSD"
cannam@42 219 licence. See the file COPYING for more details. In short, you may
cannam@42 220 modify and redistribute the SDK and example plugins within any
cannam@42 221 commercial or non-commercial, proprietary or open-source plugin or
cannam@42 222 application under almost any conditions, with no obligation to provide
cannam@42 223 source code, provided you retain the original copyright note.
cannam@14 224
cannam@14 225
cannam@14 226 See Also
cannam@14 227 ========
cannam@14 228
cannam@14 229 Sonic Visualiser, an interactive open-source graphical audio
cannam@14 230 inspection, analysis and visualisation tool supporting Vamp plugins.
cannam@35 231 http://www.sonicvisualiser.org/
cannam@14 232
cannam@14 233
cannam@44 234 Authors
cannam@44 235 =======
cannam@44 236
cannam@44 237 Vamp and the Vamp SDK were designed and made at the Centre for Digital
cannam@64 238 Music at Queen Mary, University of London.
cannam@44 239
cannam@290 240 The SDK was written by Chris Cannam, copyright (c) 2005-2009
cannam@64 241 Chris Cannam and QMUL.
cannam@64 242
cannam@64 243 Mark Sandler and Christian Landone provided ideas and direction, and
cannam@64 244 Mark Levy, Dan Stowell, Martin Gasser and Craig Sapp provided testing
cannam@64 245 and other input for the 1.0 API and SDK. The API also uses some ideas
cannam@64 246 from prior plugin systems, notably DSSI (http://dssi.sourceforge.net)
cannam@64 247 and FEAPI (http://feapi.sourceforge.net).
cannam@64 248