Evidence Promoting Good Data Management » History » Version 51

Steve Welburn, 2012-11-12 03:50 PM

1 1 Steve Welburn
h1. Evidence Promoting Good Data Management
2 1 Steve Welburn
3 18 Steve Welburn
{{>toc}}
4 18 Steve Welburn
5 20 Steve Welburn
If you have any additional examples that you would like to share, please email them to: rdm.c4dm at gmail.com
6 11 Steve Welburn
7 49 Steve Welburn
h2. Disasters!
8 49 Steve Welburn
9 49 Steve Welburn
h3. Fire!
10 49 Steve Welburn
11 50 Steve Welburn
"Southampton University Mountbatten Building Fire":http://news.bbc.co.uk/1/hi/england/hampshire/4390048.stm (BBC)
12 1 Steve Welburn
* "Images on Flickr":http://www.flickr.com/search/?q=Southampton%20University%20Mountbatten%20Building%20Fire
13 50 Steve Welburn
* "University vows to rebuild centre":http://news.bbc.co.uk/1/hi/england/hampshire/4394294.stm (BBC)
14 50 Steve Welburn
15 50 Steve Welburn
h3. Hurricane
16 50 Steve Welburn
17 50 Steve Welburn
Hurricane Sandy
18 50 Steve Welburn
* "Sandy destroyed years of medical research": http://rt.com/usa/news/sandy-research-power-medicine-681/ 31 October 2012
19 51 Steve Welburn
20 51 Steve Welburn
bq. When Hurricane Sandy struck New York, it washed away years of scientific research from the New York University School of Medicine, including genetically modified mice, enzymes, antibodies and DNA strands.
21 50 Steve Welburn
22 50 Steve Welburn
* "Help for Sandy-Stricken Scientists":http://www.the-scientist.com/?articles.view/articleNo/33223/title/Help-for-Sandy-Stricken-Scientists/ 9 November 2012
23 49 Steve Welburn
24 1 Steve Welburn
h2. Anecdotal Tales Of Lost Data
25 1 Steve Welburn
26 4 Steve Welburn
h3. Recovery of Overwritten Hard Disk Data
27 5 Steve Welburn
28 5 Steve Welburn
5 October 2005 Linux Forums - http://tinyurl.com/8t7uaop
29 5 Steve Welburn
30 3 Steve Welburn
<pre>
31 21 Steve Welburn
Hi, a friend of mine just overwrote two months of her
32 21 Steve Welburn
PhD thesis with an older version. I know recovery of
33 21 Steve Welburn
overwritten data is possible, but wonder if I'd need
34 21 Steve Welburn
special hardware to do it. Does anyone know something
35 21 Steve Welburn
about this ?
36 21 Steve Welburn
37 2 Steve Welburn
Thank You.
38 3 Steve Welburn
</pre>
39 1 Steve Welburn
40 1 Steve Welburn
h3. Stolen laptop had PhD research
41 5 Steve Welburn
42 5 Steve Welburn
19 March 2008 Surrey Leader - http://tinyurl.com/9hmtlv4
43 5 Steve Welburn
44 1 Steve Welburn
<pre>
45 45 Steve Welburn
Thirty-five minutes spent in Langley’s Willowbrook
46 23 Steve Welburn
Shopping Centre cost a Surrey woman much more than
47 23 Steve Welburn
she had anticipated.
48 23 Steve Welburn
49 23 Steve Welburn
Langley RCMP say that while she was shopping from
50 23 Steve Welburn
1-1:35 p.m. last Monday, someone broke into her
51 23 Steve Welburn
vehicle and stole a number of items, including
52 23 Steve Welburn
a Mac iBook laptop containing the research she had 
53 23 Steve Welburn
compiled as she worked towards her PhD.
54 23 Steve Welburn
55 24 Steve Welburn
“All that information was on that computer and she
56 24 Steve Welburn
has no back-up file,” said Langley RCMP spokesman
57 24 Steve Welburn
Cpl. Brenda Marshall.
58 1 Steve Welburn
</pre>
59 45 Steve Welburn
60 45 Steve Welburn
61 45 Steve Welburn
Google images of "Langley Willowbrook":https://www.google.co.uk/search?num=50&hl=en&q=Langley+Willowbrook+Shopping+Centre&&tbm=isch
62 6 Steve Welburn
63 6 Steve Welburn
h3. Happiness is the return of a stolen computer, with data intact
64 6 Steve Welburn
65 6 Steve Welburn
27 May 2010 The Press, NZ - http://tinyurl.com/38sznnh
66 6 Steve Welburn
67 6 Steve Welburn
<pre>
68 6 Steve Welburn
Never has a man been so happy to see a computer full of data
69 6 Steve Welburn
spreadsheets.
70 6 Steve Welburn
71 6 Steve Welburn
Claudio De Sassi's world fell apart when a car containing almost three
72 6 Steve Welburn
years work towards his PhD was stolen two weeks ago.
73 6 Steve Welburn
De Sassi, a Canterbury University academic, could not hide his joy
74 6 Steve Welburn
yesterday as police reunited him with his stolen laptop and backpack.
75 6 Steve Welburn
</pre>
76 6 Steve Welburn
77 19 Steve Welburn
h3. Thugs steal Christmas, doctoral dreams
78 8 Steve Welburn
79 8 Steve Welburn
22 December 2010 KRQE - http://tinyurl.com/9a5j56f
80 8 Steve Welburn
81 8 Steve Welburn
<pre>
82 8 Steve Welburn
A tiny television sits where a big screen used to, and a Christmas tree
83 8 Steve Welburn
stands with little underneath it...
84 8 Steve Welburn
85 8 Steve Welburn
Even worse than the gifts, the crooks stole a MacBook Pro laptop and a
86 8 Steve Welburn
LaCie hard drive.
87 8 Steve Welburn
88 8 Steve Welburn
The hard drive had … her dissertation and nearly seven years of
89 8 Steve Welburn
research for her doctoral degree she was set to fnish in a few weeks.
90 8 Steve Welburn
Osuna had everything backed up on a separate hard drive in a safe, but
91 8 Steve Welburn
burglars made off with that too.
92 8 Steve Welburn
93 8 Steve Welburn
"All I could think about is that all that time is gone, all that effort,
94 8 Steve Welburn
everything is gone," Osuna said.
95 9 Steve Welburn
</pre>
96 8 Steve Welburn
97 8 Steve Welburn
98 8 Steve Welburn
h3. Laptop Stolen From OSU Doctoral Student
99 8 Steve Welburn
100 8 Steve Welburn
NBC4i January 06 2011 - http://tinyurl.com/bmybv9x
101 8 Steve Welburn
102 8 Steve Welburn
<pre>
103 8 Steve Welburn
...her car was broken into and her chrome Mac book pro was stolen.
104 8 Steve Welburn
She has a back-up for all but the last six months of research, but the
105 8 Steve Welburn
most important part of the research had happened recently.
106 8 Steve Welburn
</pre>
107 8 Steve Welburn
108 39 Steve Welburn
h3. Lost Thesis Poster
109 39 Steve Welburn
110 39 Steve Welburn
http://twitpic.com/45t7vu
111 1 Steve Welburn
112 40 Steve Welburn
!http://twitpic.com/show/thumb/45t7vu.jpg!
113 39 Steve Welburn
114 42 Steve Welburn
h3. Recovery
115 42 Steve Welburn
116 42 Steve Welburn
PostgraduateForum.com > Current PhD Students, PhD Life. 29 September 2011 - http://tinyurl.com/ct5e2no
117 42 Steve Welburn
118 42 Steve Welburn
<pre>
119 42 Steve Welburn
I've 'lost' my thesis
120 1 Steve Welburn
121 43 Steve Welburn
Yes, I 'lost' my thesis today, at around 12:42pm (thesis RIP), microsoft word couldn't
122 43 Steve Welburn
cope with the size of the document and my file got corrupted. I'd removed a small chunk
123 43 Steve Welburn
of it and did some formatting to decrease its size yesterday but that obviously didn't
124 43 Steve Welburn
stop it happening. After a few hours trying to recover it, I gave in and called for
125 43 Steve Welburn
help. I then found out that, even if I'd managed to recover it, it probably wouldn't
126 44 Steve Welburn
be the whole document, there could be parts missing, formatting gone awol, etc No sweat
127 44 Steve Welburn
though, I regularly back up my work so it's just today's work that's been lost, well
128 44 Steve Welburn
morning and lunch really as I spent the afternoon attempting to savage it,-) bit
129 44 Steve Welburn
stressful but hey ho, not the end of the world. So for those of you who don't back your
130 44 Steve Welburn
work up, start doing it now! And regularly! I can't possibly imagine what would have
131 44 Steve Welburn
happened to me if I'd really lost everything weeks before submission...
132 42 Steve Welburn
</pre>
133 42 Steve Welburn
134 6 Steve Welburn
h2. The Lost Laptop Problem
135 6 Steve Welburn
136 6 Steve Welburn
* 2010 Ponemon Institute report for Intel re. US laptops
137 6 Steve Welburn
** On average, 2.3% of laptops assigned to employees are lost each year
138 25 Steve Welburn
** In education & research that rises to 3.7%, with 10.8% of laptops being lost before the end of their useful life
139 25 Steve Welburn
*** ~3 years i.e. within 1 PhD of allocation!
140 6 Steve Welburn
** 75% lost outside the workplace
141 6 Steve Welburn
* Very similar results from 2011 European report!
142 6 Steve Welburn
143 46 Steve Welburn
Intel 2010, The Billion Dollar Lost Laptop Problem - http://tinyurl.com/8c9m4bn
144 46 Steve Welburn
145 46 Steve Welburn
Intel 2011, The Billion Euro Laptop Problem - http://tinyurl.com/9wpbxn9
146 7 Steve Welburn
147 7 Steve Welburn
h2. Laptop Reliability
148 7 Steve Welburn
149 7 Steve Welburn
* 2011 PC World Laptop Reliability Survey from 63,000 readers:
150 7 Steve Welburn
** 22.6% had signifcant problems during the product's lifetime
151 7 Steve Welburn
** Of which...
152 7 Steve Welburn
*** 19% had OS problems ~1 in 25 of all laptops
153 7 Steve Welburn
*** 18% had HDD problems ~1 in 25 of all laptops
154 7 Steve Welburn
*** 10% PSU problems ~1 in 50 of all laptops
155 7 Steve Welburn
156 7 Steve Welburn
PC World 2011 - http://tinyurl.com/876qza5
157 8 Steve Welburn
158 8 Steve Welburn
h2. Hard Disk Failures
159 8 Steve Welburn
160 8 Steve Welburn
* Failure Trends In A Large Disk Drive Population
161 8 Steve Welburn
** Usenix conference on File and Storage Technologies 2007 (FAST '07)
162 8 Steve Welburn
** Eduardo Pinheiro & Wolf-Dietrich Weber, Google Inc.
163 8 Steve Welburn
* Data collected from over 100,000 disk drives at Google
164 8 Steve Welburn
* As part of repairs procedures:
165 8 Steve Welburn
** ~13% of disk drives replaced over 3 years
166 8 Steve Welburn
** ~20% of disk drives replaced over 4 years
167 8 Steve Welburn
168 8 Steve Welburn
Article: http://tinyurl.com/octz6b
169 8 Steve Welburn
170 38 Steve Welburn
[[Failure Trends In A Large Disk Drive Population|More info]]
171 37 Steve Welburn
172 8 Steve Welburn
h2. Data management in the cloud
173 8 Steve Welburn
174 8 Steve Welburn
See JISC/DCC document "Curation In The Cloud" - http://tinyurl.com/8nogtmv
175 8 Steve Welburn
176 8 Steve Welburn
Service agreements may give wide-ranging rights to the data service.
177 8 Steve Welburn
178 8 Steve Welburn
h3. Google Terms Of Service
179 8 Steve Welburn
180 8 Steve Welburn
1 March 2012 Google Terms of Service : http://tinyurl.com/89dc9fa
181 8 Steve Welburn
182 8 Steve Welburn
<pre>
183 8 Steve Welburn
When you upload or otherwise submit content to our Services, you give
184 8 Steve Welburn
Google (and those we work with) a worldwide license to use, host, store,
185 8 Steve Welburn
reproduce, modify, create derivative works (such as those resulting from
186 8 Steve Welburn
translations, adaptations or other changes we make so that your
187 8 Steve Welburn
content works better with our Services), communicate, publish, publicly
188 8 Steve Welburn
perform, publicly display and distribute such content. The rights you
189 8 Steve Welburn
grant in this license are for the limited purpose of operating, promoting,
190 8 Steve Welburn
and improving our Services, and to develop new ones. This license
191 8 Steve Welburn
continues even if you stop using our Services (for example, for a
192 8 Steve Welburn
business listing you have added to Google Maps).
193 8 Steve Welburn
</pre>
194 8 Steve Welburn
195 8 Steve Welburn
h3. Microsoft Services Agreement
196 8 Steve Welburn
197 10 Steve Welburn
19 October 2012 Microsoft services agreement : http://tinyurl.com/8e4kucy
198 8 Steve Welburn
199 8 Steve Welburn
<pre>
200 8 Steve Welburn
When you upload your content to the services, you agree that it may
201 8 Steve Welburn
be used, modifed, adapted, saved, reproduced, distributed, and
202 8 Steve Welburn
displayed to the extent necessary to protect you and to provide, protect
203 8 Steve Welburn
and improve Microsoft products and services. For example, we may
204 8 Steve Welburn
occasionally use automated means to isolate information from email,
205 8 Steve Welburn
chats, or photos in order to help detect and protect against spam and
206 8 Steve Welburn
malware, or to improve the services with new features that makes them
207 8 Steve Welburn
easier to use. When processing your content, Microsoft takes steps to
208 8 Steve Welburn
help preserve your privacy.
209 8 Steve Welburn
</pre>
210 8 Steve Welburn
211 8 Steve Welburn
h2. Archiving Data
212 8 Steve Welburn
213 8 Steve Welburn
h3. BBC Domesday Project
214 8 Steve Welburn
215 8 Steve Welburn
1986 Project to do a modern-day Domesday book (early crowd-sourcing)
216 8 Steve Welburn
* Used “BBC Master” computers with data on laserdisc
217 8 Steve Welburn
* Collected 147,819 pages of text and 23,225 photos
218 8 Steve Welburn
* Media expiring and obsolete technology put the data at risk!
219 8 Steve Welburn
220 8 Steve Welburn
Domesday Reloaded (2011)
221 8 Steve Welburn
* Required emulation of software
222 8 Steve Welburn
* Images restored from original masters
223 8 Steve Welburn
* http://www.bbc.co.uk/history/domesday
224 8 Steve Welburn
225 8 Steve Welburn
To allow long-term access to data
226 8 Steve Welburn
* Don't use obscure formats!
227 8 Steve Welburn
* Don't use obscure media!
228 8 Steve Welburn
* Don't rely on technology being available!
229 8 Steve Welburn
* Do keep original source material!
230 12 Steve Welburn
231 15 Steve Welburn
Google images for "BBC Domesday":https://www.google.co.uk/search?tbm=isch&q=bbc+domesday
232 12 Steve Welburn
233 27 Steve Welburn
h2. Sharing Data
234 27 Steve Welburn
235 47 Steve Welburn
Piwowar, Heather A., Roger S. Day, and Douglas B. Fridsma. "Sharing detailed research data is associated with increased citation rate.":http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0000308
236 47 Steve Welburn
PLoS One 2.3 (2007): e308.
237 12 Steve Welburn
238 12 Steve Welburn
239 12 Steve Welburn
h2. Related Media
240 12 Steve Welburn
241 12 Steve Welburn
h3. Disk Drives Break
242 12 Steve Welburn
243 12 Steve Welburn
"DataCent collection of disk drive failure sounds":http://datacent.com/hard_drive_sounds.php
244 12 Steve Welburn
245 12 Steve Welburn
h3. Laptops Break / Get Broken
246 13 Steve Welburn
247 13 Steve Welburn
* "Shot laptop":http://lilysussman.wordpress.com/tag/laptop-destroyed/
248 22 Steve Welburn
* "Google images of broken laptops":https://www.google.co.uk/search?q=broken%20laptop&um=1&tbm=isch
249 1 Steve Welburn
250 1 Steve Welburn
h2. More To Read
251 1 Steve Welburn
252 48 Steve Welburn
Albers, S. "Editorial: Well Documented Articles Achieve More Impact":http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1568022
253 48 Steve Welburn
BuR Business Research Journal, Vol. 2, No.2, May 2009
254 1 Steve Welburn
255 48 Steve Welburn
Anderson, Richard G., et al. "The role of data/code archives in the future of economic research.":http://www.tandfonline.com/doi/abs/10.1080/13501780801915574
256 48 Steve Welburn
Journal of Economic Methodology 15.1 (2008): 99-119.
257 32 Steve Welburn
258 48 Steve Welburn
Borgman, Christine L. "The conundrum of sharing research data."
259 48 Steve Welburn
Journal of the American Society for Information Science and Technology 63.6 (2012): 1059-1078.
260 1 Steve Welburn
261 48 Steve Welburn
Campbell, Eric G., et al. "Data withholding in academic genetics."
262 48 Steve Welburn
JAMA: the journal of the American Medical Association 287.4 (2002): 473-480.
263 31 Steve Welburn
264 48 Steve Welburn
Evanschitzky, Heiner, et al. "Replication research's disturbing trend.":http://www.sciencedirect.com/science/article/pii/S0148296306002347
265 48 Steve Welburn
Journal of Business Research 60.4 (2007): 411-415.
266 1 Steve Welburn
267 48 Steve Welburn
Fischer, Beth A., and Michael J. Zigmond. "The essential nature of sharing in science."
268 48 Steve Welburn
Science and engineering ethics 16.4 (2010): 783-799.
269 48 Steve Welburn
270 1 Steve Welburn
Freckleton, R.P., P. Hulme, P. Giller and G. Kerby. 2005. "The changing face of applied ecology.":http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2664.2005.00969.x/full
271 31 Steve Welburn
J. Appl. Ecol. 42:1–3.
272 1 Steve Welburn
273 48 Steve Welburn
Gleditsch, N.P., C. Metelits and H. Strand. 2003. Posting your data: Will you be scooped or will you be famous?.
274 48 Steve Welburn
Int. Stud. Perspect. 4:89–97.
275 1 Steve Welburn
276 48 Steve Welburn
Lancaster, Larry, and Alan Rowe. "Measuring Real World Data Availability.":http://static.usenix.org/publications/library/proceedings/lisa2001/tech/full_papers/lancaster/lancaster_html/
277 48 Steve Welburn
Proceedings of the LISA 2001 15th Systems Administration Conference. 2001.
278 1 Steve Welburn
279 48 Steve Welburn
McCullough, Bruce D., Kerry Anne McGeary, and Teresa D. Harrison. "Lessons from the JMCB Archive.":http://muse.jhu.edu/journals/mcb/summary/v038/38.4mccullough.html
280 48 Steve Welburn
Journal of Money, Credit, and Banking 38.4 (2006): 1093-1107.
281 1 Steve Welburn
282 48 Steve Welburn
Piwowar, Heather A., and Wendy W. Chapman. "Public sharing of research datasets: a pilot study of associations."
283 48 Steve Welburn
Journal of informetrics 4.2 (2010): 148-156.
284 1 Steve Welburn
285 48 Steve Welburn
Piwowar, Heather A., et al. "Towards a data sharing culture: recommendations for leadership from academic health centers."
286 48 Steve Welburn
PLoS medicine 5.9 (2008): e183.
287 31 Steve Welburn
288 48 Steve Welburn
Schroeder, Bianca, and Garth A. Gibson. "Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you.":http://www.usenix.org/event/fast07/tech/schroeder/schroeder.pdf
289 48 Steve Welburn
Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST). 2007.
290 48 Steve Welburn
291 48 Steve Welburn
Vandewalle, Patrick, Jelena Kovacevic, and Martin Vetterli. "Reproducible research in signal processing."
292 48 Steve Welburn
Signal Processing Magazine, IEEE 26.3 (2009): 37-47.
293 48 Steve Welburn
294 48 Steve Welburn
Whitlock, Michael C. "Data archiving in ecology and evolution: best practices."
295 48 Steve Welburn
Trends in ecology & evolution 26.2 (2011): 61-65.
296 48 Steve Welburn
297 48 Steve Welburn
Whitlock, Michael C., et al. "Data archiving."
298 48 Steve Welburn
The American Naturalist 175.2 (2010): 145-146.
299 48 Steve Welburn
300 48 Steve Welburn
Wicherts, Jelte M., Marjan Bakker, and Dylan Molenaar. "Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results."
301 48 Steve Welburn
PloS one 6.11 (2011): e26828.