# HG changeset patch # User Chris Cannam # Date 1406050320 -3600 # Node ID ec296f783a6f0a197bdc8073f4c90d73d71fdadb # Parent 9fa02a1c9bb66e1ff116fc0162f6a6bc5ad8828b Add current trios output results for non-normalised input on default branch diff -r 9fa02a1c9bb6 -r ec296f783a6f testdata/evaluation/outputs/trios-9fa02a1c9bb6.txt --- /dev/null Thu Jan 01 00:00:00 1970 +0000 +++ b/testdata/evaluation/outputs/trios-9fa02a1c9bb6.txt Tue Jul 22 18:32:00 2014 +0100 @@ -0,0 +1,603 @@ +Yeti 0.9.9+ +1.0 +make -C constant-q-cpp -f Makefile.linux libcq.a +make[1]: Entering directory '/home/cannam/code/silvet/constant-q-cpp' +make[1]: 'libcq.a' is up to date. +make[1]: Leaving directory '/home/cannam/code/silvet/constant-q-cpp' + +Input files are: +/home/cannam/Music/TRIOS_dataset/mozart/piano.wav +/home/cannam/Music/TRIOS_dataset/mozart/viola.wav +/home/cannam/Music/TRIOS_dataset/mozart/mix.wav +/home/cannam/Music/TRIOS_dataset/mozart/clarinet.wav +/home/cannam/Music/TRIOS_dataset/lussier/piano.wav +/home/cannam/Music/TRIOS_dataset/lussier/mix.wav +/home/cannam/Music/TRIOS_dataset/lussier/bassoon.wav +/home/cannam/Music/TRIOS_dataset/lussier/trumpet.wav +/home/cannam/Music/TRIOS_dataset/take_five/piano.wav +/home/cannam/Music/TRIOS_dataset/take_five/mix.wav +/home/cannam/Music/TRIOS_dataset/take_five/saxophone.wav + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/piano.wav... + +For piece mozart, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 60, recall 67.8, accuracy 46.6, F 63.6 <-- main mozart/piano + +Validating against MIREX submission at 50 ms: +precision 69.6, recall 68.8, accuracy 52.9, F 69.2 + +Validating MIREX against ground truth at 50 ms: +precision 56.2, recall 64.3, accuracy 42.9, F 60 + +Validating against ground truth at 100 ms: +precision 68.4, recall 77.3, accuracy 57, F 72.6 + +Validating against MIREX submission at 100 ms: +precision 83.6, recall 82.6, accuracy 71.1, F 83.1 + +Validating MIREX against ground truth at 100 ms: +precision 69.4, recall 79.4, accuracy 58.8, F 74.1 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/viola.wav... + +For piece mozart, arrangement viola, using instrument 4... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 24.4, recall 71.8, accuracy 22.3, F 36.5 <-- main mozart/viola + +Validating against MIREX submission at 50 ms: +precision 35.1, recall 26.6, accuracy 17.8, F 30.2 + +Validating MIREX against ground truth at 50 ms: +precision 20.9, recall 81.2, accuracy 20, F 33.3 + +Validating against ground truth at 100 ms: +precision 25.5, recall 75, accuracy 23.5, F 38 + +Validating against MIREX submission at 100 ms: +precision 44.6, recall 33.8, accuracy 23.8, F 38.5 + +Validating MIREX against ground truth at 100 ms: +precision 22.5, recall 87.5, accuracy 21.8, F 35.8 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/mix.wav... + +For piece mozart, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 59.7, recall 57, accuracy 41.2, F 58.3 <-- main mozart/mix + +Validating against MIREX submission at 50 ms: +precision 62.2, recall 58.8, accuracy 43.3, F 60.4 + +Validating MIREX against ground truth at 50 ms: +precision 50.4, recall 51, accuracy 33.9, F 50.7 + +Validating against ground truth at 100 ms: +precision 71.1, recall 68, accuracy 53.3, F 69.5 + +Validating against MIREX submission at 100 ms: +precision 82.2, recall 77.6, accuracy 66.4, F 79.8 + +Validating MIREX against ground truth at 100 ms: +precision 67.2, recall 68, accuracy 51, F 67.6 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/mozart/clarinet.wav... + +For piece mozart, arrangement clarinet, using instrument 9... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 89.2, recall 72.4, accuracy 66.6, F 80 <-- main mozart/clarinet + +Validating against MIREX submission at 50 ms: +precision 89.2, recall 69.4, accuracy 64.1, F 78.1 + +Validating MIREX against ground truth at 50 ms: +precision 72.2, recall 75.3, accuracy 58.4, F 73.7 + +Validating against ground truth at 100 ms: +precision 96.4, recall 78.2, accuracy 76, F 86.4 + +Validating against MIREX submission at 100 ms: +precision 98.2, recall 76.3, accuracy 75.3, F 85.9 + +Validating MIREX against ground truth at 100 ms: +precision 75, recall 78.2, accuracy 62, F 76.5 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/piano.wav... + +For piece lussier, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 53.5, recall 51.2, accuracy 35.4, F 52.3 <-- main lussier/piano + +Validating against MIREX submission at 50 ms: +precision 54.3, recall 52.1, accuracy 36.2, F 53.2 + +Validating MIREX against ground truth at 50 ms: +precision 45.3, recall 45.3, accuracy 29.3, F 45.3 + +Validating against ground truth at 100 ms: +precision 64.9, recall 62.1, accuracy 46.5, F 63.5 + +Validating against MIREX submission at 100 ms: +precision 72.8, recall 69.7, accuracy 55.3, F 71.2 + +Validating MIREX against ground truth at 100 ms: +precision 62.1, recall 62.1, accuracy 45.1, F 62.1 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/mix.wav... + +For piece lussier, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 50, recall 37.5, accuracy 27.2, F 42.8 <-- main lussier/mix + +Validating against MIREX submission at 50 ms: +precision 55.7, recall 53.3, accuracy 37.5, F 54.5 + +Validating MIREX against ground truth at 50 ms: +precision 40.4, recall 31.7, accuracy 21.6, F 35.5 + +Validating against ground truth at 100 ms: +precision 60.8, recall 45.6, accuracy 35.3, F 52.1 + +Validating against MIREX submission at 100 ms: +precision 75.6, recall 72.3, accuracy 58.7, F 73.9 + +Validating MIREX against ground truth at 100 ms: +precision 57.6, recall 45.1, accuracy 33.9, F 50.6 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/bassoon.wav... + +For piece lussier, arrangement bassoon, using instrument 11... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 66.6, recall 86.1, accuracy 60.2, F 75.1 <-- main lussier/bassoon + +Validating against MIREX submission at 50 ms: +precision 44, recall 26.4, accuracy 19.7, F 33 + +Validating MIREX against ground truth at 50 ms: +precision 31.4, recall 67.6, accuracy 27.3, F 42.9 + +Validating against ground truth at 100 ms: +precision 67.8, recall 87.6, accuracy 61.9, F 76.5 + +Validating against MIREX submission at 100 ms: +precision 66.6, recall 40, accuracy 33.3, F 50 + +Validating MIREX against ground truth at 100 ms: +precision 37.1, recall 80, accuracy 33.9, F 50.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/lussier/trumpet.wav... + +For piece lussier, arrangement trumpet, using instrument 0... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 2% Extracting and writing features... 4% Extracting and writing features... 6% Extracting and writing features... 8% Extracting and writing features... 10% Extracting and writing features... 12% Extracting and writing features... 14% Extracting and writing features... 16% Extracting and writing features... 18% Extracting and writing features... 20% Extracting and writing features... 22% Extracting and writing features... 24% Extracting and writing features... 26% Extracting and writing features... 28% Extracting and writing features... 31% Extracting and writing features... 33% Extracting and writing features... 35% Extracting and writing features... 37% Extracting and writing features... 39% Extracting and writing features... 41% Extracting and writing features... 43% Extracting and writing features... 45% Extracting and writing features... 47% Extracting and writing features... 49% Extracting and writing features... 51% Extracting and writing features... 53% Extracting and writing features... 55% Extracting and writing features... 57% Extracting and writing features... 59% Extracting and writing features... 62% Extracting and writing features... 64% Extracting and writing features... 66% Extracting and writing features... 68% Extracting and writing features... 70% Extracting and writing features... 72% Extracting and writing features... 74% Extracting and writing features... 76% Extracting and writing features... 78% Extracting and writing features... 80% Extracting and writing features... 82% Extracting and writing features... 84% Extracting and writing features... 86% Extracting and writing features... 88% Extracting and writing features... 90% Extracting and writing features... 92% Extracting and writing features... 95% Extracting and writing features... 97% Extracting and writing features... 99% Extracting and writing features... Done + + +Validating against ground truth at 50 ms: +precision 30.8, recall 87.5, accuracy 29.5, F 45.6 <-- main lussier/trumpet + +Validating against MIREX submission at 50 ms: +precision 48.5, recall 47.8, accuracy 31.7, F 48.1 + +Validating MIREX against ground truth at 50 ms: +precision 28.9, recall 83.3, accuracy 27.3, F 43 + +Validating against ground truth at 100 ms: +precision 30.8, recall 87.5, accuracy 29.5, F 45.6 + +Validating against MIREX submission at 100 ms: +precision 66.1, recall 65.2, accuracy 48.9, F 65.6 + +Validating MIREX against ground truth at 100 ms: +precision 31.8, recall 91.6, accuracy 30.9, F 47.3 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/piano.wav... + +For piece take_five, arrangement piano, using instrument 1... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 37, recall 59.9, accuracy 29.6, F 45.7 <-- main take_five/piano + +Validating against MIREX submission at 50 ms: +precision 67.8, recall 71.9, accuracy 53.6, F 69.7 + +Validating MIREX against ground truth at 50 ms: +precision 50.1, recall 76.4, accuracy 43.4, F 60.5 + +Validating against ground truth at 100 ms: +precision 48.7, recall 78.8, accuracy 43, F 60.2 + +Validating against MIREX submission at 100 ms: +precision 85.1, recall 90.3, accuracy 78, F 87.6 + +Validating MIREX against ground truth at 100 ms: +precision 51.9, recall 79.2, accuracy 45.7, F 62.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/mix.wav... + +For piece take_five, arrangement mix, using instrument 0... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 71.8, recall 73.6, accuracy 57.1, F 72.6 <-- main take_five/mix + +Validating against MIREX submission at 50 ms: +precision 70.6, recall 59.8, accuracy 47.9, F 64.8 + +Validating MIREX against ground truth at 50 ms: +precision 56.5, recall 68.3, accuracy 44.8, F 61.8 + +Validating against ground truth at 100 ms: +precision 78.4, recall 80.4, accuracy 65.9, F 79.4 + +Validating against MIREX submission at 100 ms: +precision 93.9, recall 79.6, accuracy 75.7, F 86.2 + +Validating MIREX against ground truth at 100 ms: +precision 65.5, recall 79.1, accuracy 55.9, F 71.7 + + +Evaluating for file /home/cannam/Music/TRIOS_dataset/take_five/saxophone.wav... + +For piece take_five, arrangement saxophone, using instrument 0... +force -> +one-file -> /tmp/28539 +Have audio source: "/tmp/28539norm.wav" + Determining default rate and channel count from first input file... Done +File or URL "/tmp/28539norm.wav" opened successfully +Taking default channel count of 1 from file +Taking default sample rate of 44100Hz from file +(Note: Default may be overridden by transforms) +RDFTransformFactory: NOTE: Transform is: + + + + + + +NOTE: Transform does not specify a sample rate, using default rate of 44100 +NOTE: Loaded and initialised plugin for transform "vamp:silvet:silvet:" with plugin step size 1024 and block size 1024 (adapter step and block size 16384) +Extracting features for: "/tmp/28539norm.wav" +Audio file "/tmp/28539norm.wav": 1ch at 44100Hz + Extracting and writing features... 1% Extracting and writing features... 2% Extracting and writing features... 3% Extracting and writing features... 4% Extracting and writing features... 5% Extracting and writing features... 6% Extracting and writing features... 7% Extracting and writing features... 8% Extracting and writing features... 9% Extracting and writing features... 10% Extracting and writing features... 11% Extracting and writing features... 12% Extracting and writing features... 13% Extracting and writing features... 14% Extracting and writing features... 15% Extracting and writing features... 16% Extracting and writing features... 17% Extracting and writing features... 18% Extracting and writing features... 19% Extracting and writing features... 20% Extracting and writing features... 21% Extracting and writing features... 22% Extracting and writing features... 23% Extracting and writing features... 24% Extracting and writing features... 25% Extracting and writing features... 26% Extracting and writing features... 27% Extracting and writing features... 28% Extracting and writing features... 29% Extracting and writing features... 30% Extracting and writing features... 31% Extracting and writing features... 32% Extracting and writing features... 33% Extracting and writing features... 34% Extracting and writing features... 35% Extracting and writing features... 36% Extracting and writing features... 37% Extracting and writing features... 38% Extracting and writing features... 39% Extracting and writing features... 40% Extracting and writing features... 41% Extracting and writing features... 42% Extracting and writing features... 43% Extracting and writing features... 44% Extracting and writing features... 45% Extracting and writing features... 46% Extracting and writing features... 47% Extracting and writing features... 48% Extracting and writing features... 49% Extracting and writing features... 50% Extracting and writing features... 51% Extracting and writing features... 52% Extracting and writing features... 53% Extracting and writing features... 54% Extracting and writing features... 55% Extracting and writing features... 56% Extracting and writing features... 57% Extracting and writing features... 58% Extracting and writing features... 59% Extracting and writing features... 60% Extracting and writing features... 61% Extracting and writing features... 62% Extracting and writing features... 63% Extracting and writing features... 64% Extracting and writing features... 65% Extracting and writing features... 66% Extracting and writing features... 67% Extracting and writing features... 68% Extracting and writing features... 69% Extracting and writing features... 70% Extracting and writing features... 71% Extracting and writing features... 72% Extracting and writing features... 73% Extracting and writing features... 74% Extracting and writing features... 75% Extracting and writing features... 76% Extracting and writing features... 77% Extracting and writing features... 78% Extracting and writing features... 79% Extracting and writing features... 80% Extracting and writing features... 81% Extracting and writing features... 82% Extracting and writing features... 83% Extracting and writing features... 84% Extracting and writing features... 85% Extracting and writing features... 86% Extracting and writing features... 87% Extracting and writing features... 88% Extracting and writing features... 89% Extracting and writing features... 90% Extracting and writing features... 91% Extracting and writing features... 92% Extracting and writing features... 93% Extracting and writing features... 94% Extracting and writing features... 95% Extracting and writing features... 96% Extracting and writing features... 97% Extracting and writing features... 98% Extracting and writing features... 99% Extracting and writing features... 100% Extracting and writing features... Done + +Validating against ground truth at 50 ms: +precision 74.1, recall 87.6, accuracy 67.1, F 80.3 <-- main take_five/saxophone + +Validating against MIREX submission at 50 ms: +precision 76.6, recall 67.8, accuracy 56.2, F 71.9 + +Validating MIREX against ground truth at 50 ms: +precision 67.8, recall 90.4, accuracy 63.3, F 77.5 + +Validating against ground truth at 100 ms: +precision 78.2, recall 92.3, accuracy 73.4, F 84.7 + +Validating against MIREX submission at 100 ms: +precision 93.5, recall 82.8, accuracy 78.3, F 87.8 + +Validating MIREX against ground truth at 100 ms: +precision 70, recall 93.3, accuracy 66.6, F 80 + + +real 3m28.819s +user 8m59.653s +sys 0m2.553s