MeetingNotes19Sept2012 » History » Version 2
Chris Cannam, 2012-09-19 03:32 PM
| 1 | 1 | Chris Cannam | h1. Meeting Notes - 19 Sept 2012 |
|---|---|---|---|
| 2 | 1 | Chris Cannam | |
| 3 | 1 | Chris Cannam | h2. Minutes |
| 4 | 1 | Chris Cannam | |
| 5 | 1 | Chris Cannam | Present: Ian Dickson, Karen Kruzycka, Tim Kay, Mark P, Chris C |
| 6 | 1 | Chris Cannam | |
| 7 | 1 | Chris Cannam | * Mark: we're wanting to set up some sort of thing in which people can attach research output "blobs" |
| 8 | 1 | Chris Cannam | * Rather than just sticking up our own work and hoping people will reproduce it, we want to get third parties putting up things that they have used (autonomously) |
| 9 | 1 | Chris Cannam | * Ian: We talked about Drupal because we thought there might be an EndNote/BibTeX importer -- and there is |
| 10 | 1 | Chris Cannam | * Mark sketches a diagram |
| 11 | 1 | Chris Cannam | |
| 12 | 1 | Chris Cannam | <pre> |
| 13 | 1 | Chris Cannam | BibTeX, Endnote etc ----> Paper [URL/DOI] |
| 14 | 1 | Chris Cannam | | |
| 15 | 1 | Chris Cannam | Experiment ---------- [Instructions/Workflow] |
| 16 | 1 | Chris Cannam | / \ |
| 17 | 1 | Chris Cannam | ,----------' `----------. |
| 18 | 1 | Chris Cannam | / \ |
| 19 | 1 | Chris Cannam | Code [URL] Data [URL] |
| 20 | 1 | Chris Cannam | </pre> |
| 21 | 1 | Chris Cannam | |
| 22 | 1 | Chris Cannam | The relationships all need to be N-to-N. |
| 23 | 1 | Chris Cannam | |
| 24 | 1 | Chris Cannam | * Code + Data constitute experiment. Experiment may need many bits of code and many bits of data, and each conversely may be in many experiments |
| 25 | 1 | Chris Cannam | * Likewise an experiment may appear in many papers and vice versa |
| 26 | 1 | Chris Cannam | * Data may be in various partitions, e.g. training + test |
| 27 | 1 | Chris Cannam | * Data might not be openly available, but would still require an entity (e.g. RWC dataset) |
| 28 | 1 | Chris Cannam | * Users -- is there a one-to-one relationship between code site and RR site? (Mark thinks no -- the code site should have a greater level of authorisation) |
| 29 | 1 | Chris Cannam | * Ian notes need for logging / versioning -- rolling back in the case of erroneous / malicious edits |
| 30 | 1 | Chris Cannam | * Tim notes that using a wiki to hold actual object / entity data seems infelicitous |
| 31 | 1 | Chris Cannam | * Tim: Metrics for number of people reporting reproducibility etc -- even if the figures are all zero, we need to know that. Tracking outlinks may also be necessary |
| 32 | 1 | Chris Cannam | * Ian: Would like some examples of the end points (what code & data look like) -- Mark refers to Wavelab and SMALLbox, rr.epfl.ch, RWC dataset, Million Song dataset, MARSYAS, Sonic Visualiser etc as examples of RR, RR repo that doesn't necessarily have the vitality we'd like, datasets, code, etc |