# HG changeset patch # User Chris Cannam # Date 1401883436 -3600 # Node ID 5f4a38f8d9ff207831e29efda1c0e5f91a7eccee # Parent ce8118644f162bab6fbdaef4ebf7af9d33380fd0 Agent test output. Much worse! diff -r ce8118644f16 -r 5f4a38f8d9ff testdata/evaluation/outputs/ce8118644f16-noteagent.txt --- /dev/null Thu Jan 01 00:00:00 1970 +0000 +++ b/testdata/evaluation/outputs/ce8118644f16-noteagent.txt Wed Jun 04 13:03:56 2014 +0100 @@ -0,0 +1,605 @@ +Yeti 0.9.9+ +1.0 +make -C constant-q-cpp -f Makefile.linux libcq.a +make[1]: Entering directory '/home/cannam/code/silvet/constant-q-cpp' +make[1]: 'libcq.a' is up to date. +make[1]: Leaving directory '/home/cannam/code/silvet/constant-q-cpp' +g++ -Wall -O3 -fopenmp -ffast-math -msse -msse2 -mfpmath=sse -ftree-vectorize -fPIC -I../vamp-plugin-sdk/ -DUSE_PTHREADS -I. -I../vamp-plugin-sdk -Iconstant-q-cpp -Ibqvec/src -Wall -O3 -fopenmp -ffast-math -msse -msse2 -mfpmath=sse -ftree-vectorize -fPIC -I../vamp-plugin-sdk/ -DUSE_PTHREADS -c -o src/Instruments.o src/Instruments.cpp +g++ -o silvet.so src/Silvet.o src/EM.o src/Instruments.o src/NoteHypothesis.o src/libmain.o bqvec/src/Allocators.o constant-q-cpp/libcq.a ../vamp-plugin-sdk/libvamp-sdk.a constant-q-cpp/libcq.a ../vamp-plugin-sdk/libvamp-sdk.a -lgomp -shared -Wl,-Bsymbolic -Wl,-z,defs -Wl,--version-script=vamp-plugin.map -lpthread + +Input files are: +/home/cannam/Music/TRIOS_dataset/mozart/piano.wav +/home/cannam/Music/TRIOS_dataset/mozart/viola.wav +/home/cannam/Music/TRIOS_dataset/mozart/mix.wav +/home/cannam/Music/TRIOS_dataset/mozart/clarinet.wav +/home/cannam/Music/TRIOS_dataset/lussier/piano.wav +/home/cannam/Music/TRIOS_dataset/lussier/mix.wav +/home/cannam/Music/TRIOS_dataset/lussier/bassoon.wav +/home/cannam/Music/TRIOS_dataset/lussier/trumpet.wav +/home/cannam/Music/TRIOS_dataset/take_five/piano.wav +/home/cannam/Music/TRIOS_dataset/take_five/mix.wav +/home/cannam/Music/TRIOS_dataset/take_five/saxophone.wav + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/piano.wav... + +For piece mozart, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 28.3, recall 33.5, accuracy 18.1, F 30.7 <-- main mozart/piano + +Validating against MIREX submission at 50 ms: +precision 15, recall 15.5, accuracy 8.2, F 15.2 + +Validating MIREX against ground truth at 50 ms: +precision 56.2, recall 64.3, accuracy 42.9, F 60 + +Validating against ground truth at 100 ms: +precision 45.6, recall 54.1, accuracy 32.9, F 49.5 + +Validating against MIREX submission at 100 ms: +precision 47.9, recall 49.7, accuracy 32.2, F 48.8 + +Validating MIREX against ground truth at 100 ms: +precision 69.4, recall 79.4, accuracy 58.8, F 74.1 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/viola.wav... + +For piece mozart, arrangement viola, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 17, recall 53.1, accuracy 14.7, F 25.7 <-- main mozart/viola + +Validating against MIREX submission at 50 ms: +precision 17, recall 13.7, accuracy 8.2, F 15.1 + +Validating MIREX against ground truth at 50 ms: +precision 20.9, recall 81.2, accuracy 20, F 33.3 + +Validating against ground truth at 100 ms: +precision 26, recall 81.2, accuracy 24.5, F 39.3 + +Validating against MIREX submission at 100 ms: +precision 53, recall 42.7, accuracy 30.9, F 47.3 + +Validating MIREX against ground truth at 100 ms: +precision 22.5, recall 87.5, accuracy 21.8, F 35.8 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/mix.wav... + +For piece mozart, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 47.2, recall 38.8, accuracy 27.1, F 42.6 <-- main mozart/mix + +Validating against MIREX submission at 50 ms: +precision 17.2, recall 14, accuracy 8.3, F 15.4 + +Validating MIREX against ground truth at 50 ms: +precision 50.4, recall 51, accuracy 33.9, F 50.7 + +Validating against ground truth at 100 ms: +precision 62.5, recall 51.4, accuracy 39.3, F 56.4 + +Validating against MIREX submission at 100 ms: +precision 55.1, recall 44.8, accuracy 32.8, F 49.4 + +Validating MIREX against ground truth at 100 ms: +precision 67.2, recall 68, accuracy 51, F 67.6 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/clarinet.wav... + +For piece mozart, arrangement clarinet, using instrument 8... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 78.8, recall 59.4, accuracy 51.2, F 67.7 <-- main mozart/clarinet + +Validating against MIREX submission at 50 ms: +precision 59.6, recall 43, accuracy 33.3, F 50 + +Validating MIREX against ground truth at 50 ms: +precision 72.2, recall 75.3, accuracy 58.4, F 73.7 + +Validating against ground truth at 100 ms: +precision 100, recall 75.3, accuracy 75.3, F 85.9 + +Validating against MIREX submission at 100 ms: +precision 100, recall 72.2, accuracy 72.2, F 83.8 + +Validating MIREX against ground truth at 100 ms: +precision 75, recall 78.2, accuracy 62, F 76.5 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/piano.wav... + +For piece lussier, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 37.9, recall 39.4, accuracy 23.9, F 38.6 <-- main lussier/piano + +Validating against MIREX submission at 50 ms: +precision 18.5, recall 19.3, accuracy 10.4, F 18.9 + +Validating MIREX against ground truth at 50 ms: +precision 45.3, recall 45.3, accuracy 29.3, F 45.3 + +Validating against ground truth at 100 ms: +precision 50, recall 52.1, accuracy 34.2, F 51 + +Validating against MIREX submission at 100 ms: +precision 39.5, recall 41.1, accuracy 25.2, F 40.3 + +Validating MIREX against ground truth at 100 ms: +precision 62.1, recall 62.1, accuracy 45.1, F 62.1 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/mix.wav... + +For piece lussier, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 42.4, recall 35, accuracy 23.7, F 38.4 <-- main lussier/mix + +Validating against MIREX submission at 50 ms: +precision 15.6, recall 16.5, accuracy 8.7, F 16.1 + +Validating MIREX against ground truth at 50 ms: +precision 40.4, recall 31.7, accuracy 21.6, F 35.5 + +Validating against ground truth at 100 ms: +precision 51.7, recall 42.7, accuracy 30.5, F 46.8 + +Validating against MIREX submission at 100 ms: +precision 45.9, recall 48.4, accuracy 30.8, F 47.1 + +Validating MIREX against ground truth at 100 ms: +precision 57.6, recall 45.1, accuracy 33.9, F 50.6 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/bassoon.wav... + +For piece lussier, arrangement bassoon, using instrument 10... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 63, recall 44.6, accuracy 35.3, F 52.2 <-- main lussier/bassoon + +Validating against MIREX submission at 50 ms: +precision 43.4, recall 14.2, accuracy 12, F 21.5 + +Validating MIREX against ground truth at 50 ms: +precision 31.4, recall 67.6, accuracy 27.3, F 42.9 + +Validating against ground truth at 100 ms: +precision 84.7, recall 60, accuracy 54.1, F 70.2 + +Validating against MIREX submission at 100 ms: +precision 67.3, recall 22.1, accuracy 20, F 33.3 + +Validating MIREX against ground truth at 100 ms: +precision 37.1, recall 80, accuracy 33.9, F 50.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/trumpet.wav... + +For piece lussier, arrangement trumpet, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 32.3, recall 87.5, accuracy 30.8, F 47.1 <-- main lussier/trumpet + +Validating against MIREX submission at 50 ms: +precision 32.3, recall 30.4, accuracy 18.5, F 31.3 + +Validating MIREX against ground truth at 50 ms: +precision 28.9, recall 83.3, accuracy 27.3, F 43 + +Validating against ground truth at 100 ms: +precision 35.3, recall 95.8, accuracy 34.8, F 51.6 + +Validating against MIREX submission at 100 ms: +precision 67.6, recall 63.7, accuracy 48.8, F 65.6 + +Validating MIREX against ground truth at 100 ms: +precision 31.8, recall 91.6, accuracy 30.9, F 47.3 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/piano.wav... + +For piece take_five, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 16.1, recall 21.6, accuracy 10.1, F 18.5 <-- main take_five/piano + +Validating against MIREX submission at 50 ms: +precision 18.5, recall 16.3, accuracy 9.5, F 17.3 + +Validating MIREX against ground truth at 50 ms: +precision 50.1, recall 76.4, accuracy 43.4, F 60.5 + +Validating against ground truth at 100 ms: +precision 32.9, recall 44.2, accuracy 23.3, F 37.7 + +Validating against MIREX submission at 100 ms: +precision 62.8, recall 55.2, accuracy 41.6, F 58.8 + +Validating MIREX against ground truth at 100 ms: +precision 51.9, recall 79.2, accuracy 45.7, F 62.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/mix.wav... + +For piece take_five, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 33.4, recall 34.7, accuracy 20.5, F 34 <-- main take_five/mix + +Validating against MIREX submission at 50 ms: +precision 16.1, recall 13.8, accuracy 8, F 14.9 + +Validating MIREX against ground truth at 50 ms: +precision 56.5, recall 68.3, accuracy 44.8, F 61.8 + +Validating against ground truth at 100 ms: +precision 52.8, recall 54.9, accuracy 36.8, F 53.8 + +Validating against MIREX submission at 100 ms: +precision 56.4, recall 48.5, accuracy 35.3, F 52.2 + +Validating MIREX against ground truth at 100 ms: +precision 65.5, recall 79.1, accuracy 55.9, F 71.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/saxophone.wav... + +For piece take_five, arrangement saxophone, using instrument 0... +force -> +one-file -> /tmp/17183 +Have audio source: "/tmp/17183norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/17183norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/17183norm.wav" +Audio file "/tmp/17183norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 50.3, recall 64.7, accuracy 39.5, F 56.6 <-- main take_five/saxophone + +Validating against MIREX submission at 50 ms: +precision 32.5, recall 31.4, accuracy 19, F 32 + +Validating MIREX against ground truth at 50 ms: +precision 67.8, recall 90.4, accuracy 63.3, F 77.5 + +Validating against ground truth at 100 ms: +precision 69.6, recall 89.5, accuracy 64.3, F 78.3 + +Validating against MIREX submission at 100 ms: +precision 82.9, recall 80, accuracy 68.7, F 81.4 + +Validating MIREX against ground truth at 100 ms: +precision 70, recall 93.3, accuracy 66.6, F 80 + + +real 3m23.608s +user 7m37.760s +sys 0m3.450s