MeetingNotes19Sept2012 » History » Version 1

Chris Cannam, 2012-09-19 03:32 PM

1 1 Chris Cannam
h1. Meeting Notes - 19 Sept 2012
2 1 Chris Cannam
3 1 Chris Cannam
h1. Meeting 19 Sep 2012
4 1 Chris Cannam
5 1 Chris Cannam
h2. Minutes
6 1 Chris Cannam
7 1 Chris Cannam
Present: Ian Dickson, Karen Kruzycka, Tim Kay, Mark P, Chris C
8 1 Chris Cannam
9 1 Chris Cannam
 * Mark: we're wanting to set up some sort of thing in which people can attach research output "blobs"
10 1 Chris Cannam
 * Rather than just sticking up our own work and hoping people will reproduce it, we want to get third parties putting up things that they have used (autonomously)
11 1 Chris Cannam
 * Ian: We talked about Drupal because we thought there might be an EndNote/BibTeX importer -- and there is
12 1 Chris Cannam
 * Mark sketches a diagram
13 1 Chris Cannam
14 1 Chris Cannam
<pre>
15 1 Chris Cannam
          BibTeX, Endnote etc ----> Paper [URL/DOI]
16 1 Chris Cannam
                                       |
17 1 Chris Cannam
                                   Experiment ---------- [Instructions/Workflow]
18 1 Chris Cannam
                                      / \
19 1 Chris Cannam
                          ,----------'   `----------.
20 1 Chris Cannam
                         /                           \
21 1 Chris Cannam
               Code [URL]                             Data [URL]
22 1 Chris Cannam
</pre>
23 1 Chris Cannam
24 1 Chris Cannam
The relationships all need to be N-to-N.
25 1 Chris Cannam
26 1 Chris Cannam
 * Code + Data constitute experiment. Experiment may need many bits of code and many bits of data, and each conversely may be in many experiments
27 1 Chris Cannam
 * Likewise an experiment may appear in many papers and vice versa
28 1 Chris Cannam
 * Data may be in various partitions, e.g. training + test
29 1 Chris Cannam
 * Data might not be openly available, but would still require an entity (e.g. RWC dataset)
30 1 Chris Cannam
 * Users -- is there a one-to-one relationship between code site and RR site? (Mark thinks no -- the code site should have a greater level of authorisation)
31 1 Chris Cannam
 * Ian notes need for logging / versioning -- rolling back in the case of erroneous / malicious edits
32 1 Chris Cannam
 * Tim notes that using a wiki to hold actual object / entity data seems infelicitous
33 1 Chris Cannam
 * Tim: Metrics for number of people reporting reproducibility etc -- even if the figures are all zero, we need to know that. Tracking outlinks may also be necessary
34 1 Chris Cannam
 * Ian: Would like some examples of the end points (what code & data look like) -- Mark refers to Wavelab and SMALLbox, rr.epfl.ch, RWC dataset, Million Song dataset, MARSYAS, Sonic Visualiser etc as examples of RR, RR repo that doesn't necessarily have the vitality we'd like, datasets, code, etc