Wiki » History » Version 24

Chris Cannam, 2013-10-28 03:08 PM

1 1 Chris Cannam
h1. Wiki
2 1 Chris Cannam
3 10 Chris Cannam
h2. The method
4 10 Chris Cannam
5 14 Chris Cannam
*The method to be implemented* is that from "Anssi's Constant-Q Toolbox page":http://www.eecs.qmul.ac.uk/~anssik/cqt/.
6 1 Chris Cannam
7 1 Chris Cannam
 * The MATLAB toolbox reference implementation is "here":/projects/constant-q-toolbox.
8 1 Chris Cannam
9 16 Chris Cannam
 * The "QM-DSP":/projects/qm-dsp library also contains a Constant-Q implementation: there is a Vamp plugin of it in the "QM Vamp Plugins":/projects/qm-vamp-plugins set. I believe it is based on the method of Brown and Puckette. Our version isn't very good. Among other things, we should aim to produce an improved plugin. But this one may be useful as an extra reference.
10 4 Chris Cannam
11 8 Chris Cannam
*Has anyone already made one* corresponding directly to the Schörkhuber/Klapuri method? We don't want to duplicate effort. And if someone has, why don't I know about it? -- can we do anything to help make it more universally known?
12 9 Chris Cannam
13 9 Chris Cannam
*What other modern methods* exist in C++?
14 10 Chris Cannam
15 22 Emmanouil Benetos
Emmanouil: there is a Dec 2011 discussion on music-ir about CQT implementations. It seems that there is a C++ GNU GPL 3 code for a forwards CQT available in the Qitch plugin for SuperCollider at http://sourceforge.net/projects/sc3-plugins/ (which however implements Judith Brown's old algorithm)
16 22 Emmanouil Benetos
17 22 Emmanouil Benetos
18 10 Chris Cannam
h2. What we want it for
19 1 Chris Cannam
20 11 Chris Cannam
The immediate requirement is as the first step in implementing Emmanouil Benetos and Simon Dixon's "music transcription":http://www.mitpressjournals.org/doi/abs/10.1162/COMJ_a_00146 method for a Vamp plugin.
21 11 Chris Cannam
22 11 Chris Cannam
But the reason we aren't using the QM-DSP constant-Q implementation is that it simply isn't good enough, and that means it isn't really good enough for the rest of the world either. We should make a better one to improve upon the existing QM Vamp Plugin as well.
23 13 Chris Cannam
24 17 Chris Cannam
The method described is invertible with some signal loss -- we should implement the inversion as well.
25 17 Chris Cannam
26 13 Chris Cannam
h2. Implementation notes
27 13 Chris Cannam
28 13 Chris Cannam
The Schörkhuber/Klapuri method has (at least) three useful qualities:
29 1 Chris Cannam
30 1 Chris Cannam
 # It's mathematically diligent. Decisions such as kernel and window shape are explained and supported in the paper.
31 17 Chris Cannam
 # There is an open source MATLAB implementation available, and others have tested it.
32 17 Chris Cannam
 # It is (somewhat) invertible. 
33 17 Chris Cannam
34 18 Chris Cannam
Also the nature of the constant-Q transform is such that it should be possible to test it using relatively little data.
35 17 Chris Cannam
36 20 Chris Cannam
This makes it a good case for implementation using a unit testing or test-first regime:
37 1 Chris Cannam
38 19 Chris Cannam
 # Mathematical support will help in generating synthetic test cases
39 19 Chris Cannam
 # The existing implementation gives a reference at each step (although we need to be careful not to trust it implicitly)
40 19 Chris Cannam
 # Invertibility means we can test the forward-backward transforms.
41 21 Chris Cannam
42 21 Chris Cannam
h2. Goals
43 21 Chris Cannam
44 21 Chris Cannam
This version needs to be:
45 21 Chris Cannam
46 21 Chris Cannam
 # *Correct* -- a lot of people have looked at the output of the existing QM-DSP constant-Q transform and said "hm, that doesn't look very good" but nobody who really knows their stuff has ever taken the time to figure out what's wrong with it. This sort of review after the fact just doesn't seem to happen. We should aim to see that it's right as we go along, with a suitable testing regime.
47 21 Chris Cannam
 # *Fast* -- the method has the potential to be pretty fast, we should make the most of it
48 21 Chris Cannam
 # *Compact* -- avoiding hard-to-satisfy library dependencies so that people can apply the code easily
49 23 Chris Cannam
50 23 Chris Cannam
h2. General procedure
51 23 Chris Cannam
52 24 Chris Cannam
 # Pick apart the MATLAB and implement it in another high-level language. I'm using Yeti with "May":/projects/may, because I like it. The main thing is to target a language without the same built-in syntax as MATLAB for matrix and complex arithmetic, so that you actually have to understand how the original algorithm works. Once I have a version in another high-level language that produces the same results, I can be confident I have understood (at some level) how the toolbox code works.
53 23 Chris Cannam
 # Refactor and introduce unit tests in addition to the high-level tests that compare results against the original MATLAB.
54 1 Chris Cannam
 # Port across the test structure and reimplement the code into C++.
55 24 Chris Cannam
56 24 Chris Cannam
Is this any more efficient or effective than porting directly to C++? Not sure, let's find out -- mostly in the past I've gone straight to C++ so this is a novelty for me.