Sound Data Management Training

h1. WP1.2 Online Training Material

{{>toc}}

We consider three stages of a research project, and the appropriate research data management considerations for each of those stages. The stages are:

* [[Before The Research|before the research]];

* [[During The Research|during the research]];

* [[At The End Of The Research|at the end of the research]].

In addition, we consider the [[Research Management|responsibilities of a Principal Investigator]] regarding data management.

{{include(Data Management By Research Stage)}}

h2. Why manage research data ?

Funder requirements: http://researchonline.lshtm.ac.uk/208596/

Ponemon reports for Intel on the "Lost Laptop problem" ~10% of Education and Research laptops are lost during their lifetime.

PC World study on laptop failure rates: 20-30% of laptops with a significant failure

h3. Failure Trends In A Large Disk Drive Population

FAST '07 paper on "Failure Trends In A Large Disk Drive Population":https://www.usenix.org/conference/fast-07/failure-trends-large-disk-drive-population

Google report on over 100,000 consumer-grade disk drives from 80-400 GB produced in or after 2001 and used within Google. Data collected December 2005 - August 2006. Disk drives had a burn-in process and only those that were commissioned for use were included in the study - certain basic defects may well be excluded from this report.

Hard drive manufacturers often quote yearly failure rates below 2% [2]

User studies have seen rates as high as 6% [9]

Between 15-60% of drives returned to manufacturers having been considered to have failed by users have no defect as far as the manufacturers are concerned [7]

Between 20-30% “no problem found” cases were observed after analyzing failed drives from a study of 3477 disks [11]

bq. the most accurate definition we can present of a failure event for our study is: a drive is considered to have failed if it was replaced as part of a repairs procedure. Note that this definition implicitly excludes drives that were replaced due to an upgrade.

h2. Overarching concerns

Human participation - ethics, data protection

Audio data - copyright

Storage - where ? how ? SLA ?

Short-term resilient storage for work-in-progress

Long-term archival storage for research data outputs

Curation of archived data - refreshing media and formats

Drivers - FoI, RCUK