Sound Data Management Training » History » Version 33

Steve Welburn, 2012-07-30 03:13 PM

1 5 Steve Welburn
h1. WP1.2 Online Training Material
2 1 Steve Welburn
3 7 Steve Welburn
(back to [[Wiki]])
4 7 Steve Welburn
5 9 Steve Welburn
{{>toc}}
6 9 Steve Welburn
7 28 Steve Welburn
h2. By Stage Of Research
8 28 Steve Welburn
9 33 Steve Welburn
h3. Before Research - Planning Reserach Data Management
10 28 Steve Welburn
11 32 Steve Welburn
It is likely that some form of data management plan will be required as part of a grant proposal. The data management plan is an opportunity to think about the resources that will be required during the lifetime of the research project and to make sure that any necessary resources can be funded through the project.
12 32 Steve Welburn
13 32 Steve Welburn
The main three questions the plan will cover are:
14 32 Steve Welburn
* What type of storage do you require ?
15 32 Steve Welburn
* How much storage do you require ?
16 32 Steve Welburn
* How long will you require the storage for ?
17 32 Steve Welburn
18 33 Steve Welburn
Appropriate answers will relate to: the types of data you will be using and creating; available existing resources; funder requirements; and relevant policies (e.g. research group, institutional).
19 28 Steve Welburn
20 28 Steve Welburn
h3. During Research
21 28 Steve Welburn
22 31 Steve Welburn
During the course of a piece of research, dat management is largely risk mitigation - it makes your research more robust and allows you to continue if something goes wrong.
23 31 Steve Welburn
24 31 Steve Welburn
The two main areas to consider are:
25 31 Steve Welburn
* backing up research data - in case you lose, or corrupt, the main copy of your data;
26 31 Steve Welburn
* documenting data - in case you need to to return to it later.
27 28 Steve Welburn
28 28 Steve Welburn
h3. At The End Of A Piece of Research
29 28 Steve Welburn
30 28 Steve Welburn
(Includes on publication of a paper based on your research)
31 28 Steve Welburn
32 28 Steve Welburn
* Archiving research data
33 28 Steve Welburn
* Publishing research data
34 30 Steve Welburn
* Reviewing the data management plan
35 28 Steve Welburn
36 29 Steve Welburn
h2. Researcher use cases
37 1 Steve Welburn
38 29 Steve Welburn
h3. Quantitative research
39 1 Steve Welburn
40 1 Steve Welburn
bq. A common use-case in C4DM research is to run a newly-developed analysis algorithm on a set of audio examples and evaluate the algorithm by comparing its output with that of a human annotator. Results are then compared with published results using the same input data to determine whether the newly proposed approach makes any improvement on the state of the art.
41 1 Steve Welburn
42 29 Steve Welburn
There are two main types of quantitative research which we consider:
43 29 Steve Welburn
* Testing new data using existing algorithms
44 29 Steve Welburn
* Using existing data, and algoritghms, to test a new algorithm.
45 26 Steve Welburn
46 1 Steve Welburn
Data involved includes:
47 1 Steve Welburn
* Software for the algorithm (which can be hosted on "Sound Software":http://www.soundsoftware.ac.uk)
48 1 Steve Welburn
* An annotated dataset against which the algorithm can be tested
49 1 Steve Welburn
* Results of applying the new algorithm and competing algorithms to the dataset
50 1 Steve Welburn
* Documentation of the testing methodology
51 1 Steve Welburn
52 22 Steve Welburn
Note that *if* other algorithms have published results using the same dataset and methodology, then results should be directly comparable between the published results and the results for the new algorithm. In this case, most of the methodology is already documented and only details specific to the new algorithm (e.g. parameters) need separately recording.
53 1 Steve Welburn
54 23 Steve Welburn
Also, if the testing is scripted, then the code used would be sufficient documentation during the research - readable documentation only being required at publication.
55 1 Steve Welburn
56 1 Steve Welburn
If no suitable annotated dataset already exists, a new dataset may be created including:
57 12 Steve Welburn
* Selection of underlying (audio) data (the actual audio may be in the dataset or the dataset may reference material - e.g. for [[Copyright|copyright]] reasons)
58 11 Steve Welburn
* Ground-truth annotations for the audio and the type of algorithm (e.g. chord sequences for chord estimation, onset times for onset detection)
59 1 Steve Welburn
60 25 Steve Welburn
h3. Qualitative testing
61 1 Steve Welburn
62 27 Steve Welburn
An example would be using interviews with performers to evaluate a new instrument design.
63 1 Steve Welburn
64 24 Steve Welburn
Data involved may include:
65 24 Steve Welburn
* the interface design
66 24 Steve Welburn
* Captured audio from performances
67 24 Steve Welburn
* Recorded interviews with performers (possibly audio or video)
68 24 Steve Welburn
* Interview transcripts
69 1 Steve Welburn
70 24 Steve Welburn
The research may also involve:
71 1 Steve Welburn
* Demographic details of participants
72 3 Steve Welburn
* Identifiable participants (Data Protection])
73 24 Steve Welburn
* Release forms for people taking part
74 1 Steve Welburn
75 1 Steve Welburn
and *will* involve:
76 1 Steve Welburn
* ethics-board approval
77 1 Steve Welburn
78 1 Steve Welburn
h3. Publication
79 1 Steve Welburn
80 1 Steve Welburn
Additionally, publication of results will require:
81 1 Steve Welburn
* Summarising the results
82 1 Steve Welburn
* Publishing the paper
83 8 Steve Welburn
84 17 Steve Welburn
Note that the EPSRC data management principles require sources of data to be referenced.
85 17 Steve Welburn
86 15 Steve Welburn
h3. Primary Investigator (PI)
87 14 Steve Welburn
88 14 Steve Welburn
The data management concerns of a PI will largely revolve around planning and appraisal of data management for research projects.
89 14 Steve Welburn
90 14 Steve Welburn
Areas of interest may involve:
91 14 Steve Welburn
* legalities (Freedom of Information, Copyright and Data Protection)
92 14 Steve Welburn
* data management plan
93 14 Steve Welburn
** covering the research council requirements
94 14 Steve Welburn
** during the project
95 14 Steve Welburn
** data archiving
96 14 Steve Welburn
** data publication
97 14 Steve Welburn
* After the project is completed, an appraisal of how the data was managed should be carried out as part of the project's "lessons learned"
98 14 Steve Welburn
99 16 Steve Welburn
Data management training should provide an overview of all the above, and keep PIs informed of any changes in the above that affect data management requirements.
100 16 Steve Welburn
101 19 Steve Welburn
The DCC DMP Online tool provides a series of questions which allow the user to build a data management plan which will match research council requirements.
102 18 Steve Welburn
103 8 Steve Welburn
h2. Overarching concerns
104 8 Steve Welburn
105 8 Steve Welburn
Human participation - ethics, data protection
106 8 Steve Welburn
107 8 Steve Welburn
Audio data - copyright
108 10 Steve Welburn
109 10 Steve Welburn
Storage - where ? how ? SLA ?
110 20 Steve Welburn
111 21 Steve Welburn
Short-term resilient storage for work-in-progress
112 20 Steve Welburn
113 21 Steve Welburn
Long-term archival storage for research data outputs
114 1 Steve Welburn
115 1 Steve Welburn
Curation of archived data - refreshing media and formats
116 21 Steve Welburn
117 21 Steve Welburn
Drivers - FoI, RCUK