Evidence Promoting Good Data Management » History » Version 50

Steve Welburn, 2012-11-12 03:49 PM

1 1 Steve Welburn
h1. Evidence Promoting Good Data Management
2 1 Steve Welburn
3 18 Steve Welburn
{{>toc}}
4 18 Steve Welburn
5 20 Steve Welburn
If you have any additional examples that you would like to share, please email them to: rdm.c4dm at gmail.com
6 11 Steve Welburn
7 49 Steve Welburn
h2. Disasters!
8 49 Steve Welburn
9 49 Steve Welburn
h3. Fire!
10 49 Steve Welburn
11 50 Steve Welburn
"Southampton University Mountbatten Building Fire":http://news.bbc.co.uk/1/hi/england/hampshire/4390048.stm (BBC)
12 1 Steve Welburn
* "Images on Flickr":http://www.flickr.com/search/?q=Southampton%20University%20Mountbatten%20Building%20Fire
13 50 Steve Welburn
* "University vows to rebuild centre":http://news.bbc.co.uk/1/hi/england/hampshire/4394294.stm (BBC)
14 50 Steve Welburn
15 50 Steve Welburn
h3. Hurricane
16 50 Steve Welburn
17 50 Steve Welburn
Hurricane Sandy
18 50 Steve Welburn
* "Sandy destroyed years of medical research": http://rt.com/usa/news/sandy-research-power-medicine-681/ 31 October 2012
19 50 Steve Welburn
When Hurricane Sandy struck New York, it washed away years of scientific research from the New York University School of Medicine, including genetically modified mice, enzymes, antibodies and DNA strands.
20 50 Steve Welburn
21 50 Steve Welburn
* "Help for Sandy-Stricken Scientists":http://www.the-scientist.com/?articles.view/articleNo/33223/title/Help-for-Sandy-Stricken-Scientists/ 9 November 2012
22 49 Steve Welburn
23 1 Steve Welburn
h2. Anecdotal Tales Of Lost Data
24 1 Steve Welburn
25 4 Steve Welburn
h3. Recovery of Overwritten Hard Disk Data
26 5 Steve Welburn
27 5 Steve Welburn
5 October 2005 Linux Forums - http://tinyurl.com/8t7uaop
28 5 Steve Welburn
29 3 Steve Welburn
<pre>
30 21 Steve Welburn
Hi, a friend of mine just overwrote two months of her
31 21 Steve Welburn
PhD thesis with an older version. I know recovery of
32 21 Steve Welburn
overwritten data is possible, but wonder if I'd need
33 21 Steve Welburn
special hardware to do it. Does anyone know something
34 21 Steve Welburn
about this ?
35 21 Steve Welburn
36 2 Steve Welburn
Thank You.
37 3 Steve Welburn
</pre>
38 1 Steve Welburn
39 1 Steve Welburn
h3. Stolen laptop had PhD research
40 5 Steve Welburn
41 5 Steve Welburn
19 March 2008 Surrey Leader - http://tinyurl.com/9hmtlv4
42 5 Steve Welburn
43 1 Steve Welburn
<pre>
44 45 Steve Welburn
Thirty-five minutes spent in Langley’s Willowbrook
45 23 Steve Welburn
Shopping Centre cost a Surrey woman much more than
46 23 Steve Welburn
she had anticipated.
47 23 Steve Welburn
48 23 Steve Welburn
Langley RCMP say that while she was shopping from
49 23 Steve Welburn
1-1:35 p.m. last Monday, someone broke into her
50 23 Steve Welburn
vehicle and stole a number of items, including
51 23 Steve Welburn
a Mac iBook laptop containing the research she had 
52 23 Steve Welburn
compiled as she worked towards her PhD.
53 23 Steve Welburn
54 24 Steve Welburn
“All that information was on that computer and she
55 24 Steve Welburn
has no back-up file,” said Langley RCMP spokesman
56 24 Steve Welburn
Cpl. Brenda Marshall.
57 1 Steve Welburn
</pre>
58 45 Steve Welburn
59 45 Steve Welburn
60 45 Steve Welburn
Google images of "Langley Willowbrook":https://www.google.co.uk/search?num=50&hl=en&q=Langley+Willowbrook+Shopping+Centre&&tbm=isch
61 6 Steve Welburn
62 6 Steve Welburn
h3. Happiness is the return of a stolen computer, with data intact
63 6 Steve Welburn
64 6 Steve Welburn
27 May 2010 The Press, NZ - http://tinyurl.com/38sznnh
65 6 Steve Welburn
66 6 Steve Welburn
<pre>
67 6 Steve Welburn
Never has a man been so happy to see a computer full of data
68 6 Steve Welburn
spreadsheets.
69 6 Steve Welburn
70 6 Steve Welburn
Claudio De Sassi's world fell apart when a car containing almost three
71 6 Steve Welburn
years work towards his PhD was stolen two weeks ago.
72 6 Steve Welburn
De Sassi, a Canterbury University academic, could not hide his joy
73 6 Steve Welburn
yesterday as police reunited him with his stolen laptop and backpack.
74 6 Steve Welburn
</pre>
75 6 Steve Welburn
76 19 Steve Welburn
h3. Thugs steal Christmas, doctoral dreams
77 8 Steve Welburn
78 8 Steve Welburn
22 December 2010 KRQE - http://tinyurl.com/9a5j56f
79 8 Steve Welburn
80 8 Steve Welburn
<pre>
81 8 Steve Welburn
A tiny television sits where a big screen used to, and a Christmas tree
82 8 Steve Welburn
stands with little underneath it...
83 8 Steve Welburn
84 8 Steve Welburn
Even worse than the gifts, the crooks stole a MacBook Pro laptop and a
85 8 Steve Welburn
LaCie hard drive.
86 8 Steve Welburn
87 8 Steve Welburn
The hard drive had … her dissertation and nearly seven years of
88 8 Steve Welburn
research for her doctoral degree she was set to fnish in a few weeks.
89 8 Steve Welburn
Osuna had everything backed up on a separate hard drive in a safe, but
90 8 Steve Welburn
burglars made off with that too.
91 8 Steve Welburn
92 8 Steve Welburn
"All I could think about is that all that time is gone, all that effort,
93 8 Steve Welburn
everything is gone," Osuna said.
94 9 Steve Welburn
</pre>
95 8 Steve Welburn
96 8 Steve Welburn
97 8 Steve Welburn
h3. Laptop Stolen From OSU Doctoral Student
98 8 Steve Welburn
99 8 Steve Welburn
NBC4i January 06 2011 - http://tinyurl.com/bmybv9x
100 8 Steve Welburn
101 8 Steve Welburn
<pre>
102 8 Steve Welburn
...her car was broken into and her chrome Mac book pro was stolen.
103 8 Steve Welburn
She has a back-up for all but the last six months of research, but the
104 8 Steve Welburn
most important part of the research had happened recently.
105 8 Steve Welburn
</pre>
106 8 Steve Welburn
107 39 Steve Welburn
h3. Lost Thesis Poster
108 39 Steve Welburn
109 39 Steve Welburn
http://twitpic.com/45t7vu
110 1 Steve Welburn
111 40 Steve Welburn
!http://twitpic.com/show/thumb/45t7vu.jpg!
112 39 Steve Welburn
113 42 Steve Welburn
h3. Recovery
114 42 Steve Welburn
115 42 Steve Welburn
PostgraduateForum.com > Current PhD Students, PhD Life. 29 September 2011 - http://tinyurl.com/ct5e2no
116 42 Steve Welburn
117 42 Steve Welburn
<pre>
118 42 Steve Welburn
I've 'lost' my thesis
119 1 Steve Welburn
120 43 Steve Welburn
Yes, I 'lost' my thesis today, at around 12:42pm (thesis RIP), microsoft word couldn't
121 43 Steve Welburn
cope with the size of the document and my file got corrupted. I'd removed a small chunk
122 43 Steve Welburn
of it and did some formatting to decrease its size yesterday but that obviously didn't
123 43 Steve Welburn
stop it happening. After a few hours trying to recover it, I gave in and called for
124 43 Steve Welburn
help. I then found out that, even if I'd managed to recover it, it probably wouldn't
125 44 Steve Welburn
be the whole document, there could be parts missing, formatting gone awol, etc No sweat
126 44 Steve Welburn
though, I regularly back up my work so it's just today's work that's been lost, well
127 44 Steve Welburn
morning and lunch really as I spent the afternoon attempting to savage it,-) bit
128 44 Steve Welburn
stressful but hey ho, not the end of the world. So for those of you who don't back your
129 44 Steve Welburn
work up, start doing it now! And regularly! I can't possibly imagine what would have
130 44 Steve Welburn
happened to me if I'd really lost everything weeks before submission...
131 42 Steve Welburn
</pre>
132 42 Steve Welburn
133 6 Steve Welburn
h2. The Lost Laptop Problem
134 6 Steve Welburn
135 6 Steve Welburn
* 2010 Ponemon Institute report for Intel re. US laptops
136 6 Steve Welburn
** On average, 2.3% of laptops assigned to employees are lost each year
137 25 Steve Welburn
** In education & research that rises to 3.7%, with 10.8% of laptops being lost before the end of their useful life
138 25 Steve Welburn
*** ~3 years i.e. within 1 PhD of allocation!
139 6 Steve Welburn
** 75% lost outside the workplace
140 6 Steve Welburn
* Very similar results from 2011 European report!
141 6 Steve Welburn
142 46 Steve Welburn
Intel 2010, The Billion Dollar Lost Laptop Problem - http://tinyurl.com/8c9m4bn
143 46 Steve Welburn
144 46 Steve Welburn
Intel 2011, The Billion Euro Laptop Problem - http://tinyurl.com/9wpbxn9
145 7 Steve Welburn
146 7 Steve Welburn
h2. Laptop Reliability
147 7 Steve Welburn
148 7 Steve Welburn
* 2011 PC World Laptop Reliability Survey from 63,000 readers:
149 7 Steve Welburn
** 22.6% had signifcant problems during the product's lifetime
150 7 Steve Welburn
** Of which...
151 7 Steve Welburn
*** 19% had OS problems ~1 in 25 of all laptops
152 7 Steve Welburn
*** 18% had HDD problems ~1 in 25 of all laptops
153 7 Steve Welburn
*** 10% PSU problems ~1 in 50 of all laptops
154 7 Steve Welburn
155 7 Steve Welburn
PC World 2011 - http://tinyurl.com/876qza5
156 8 Steve Welburn
157 8 Steve Welburn
h2. Hard Disk Failures
158 8 Steve Welburn
159 8 Steve Welburn
* Failure Trends In A Large Disk Drive Population
160 8 Steve Welburn
** Usenix conference on File and Storage Technologies 2007 (FAST '07)
161 8 Steve Welburn
** Eduardo Pinheiro & Wolf-Dietrich Weber, Google Inc.
162 8 Steve Welburn
* Data collected from over 100,000 disk drives at Google
163 8 Steve Welburn
* As part of repairs procedures:
164 8 Steve Welburn
** ~13% of disk drives replaced over 3 years
165 8 Steve Welburn
** ~20% of disk drives replaced over 4 years
166 8 Steve Welburn
167 8 Steve Welburn
Article: http://tinyurl.com/octz6b
168 8 Steve Welburn
169 38 Steve Welburn
[[Failure Trends In A Large Disk Drive Population|More info]]
170 37 Steve Welburn
171 8 Steve Welburn
h2. Data management in the cloud
172 8 Steve Welburn
173 8 Steve Welburn
See JISC/DCC document "Curation In The Cloud" - http://tinyurl.com/8nogtmv
174 8 Steve Welburn
175 8 Steve Welburn
Service agreements may give wide-ranging rights to the data service.
176 8 Steve Welburn
177 8 Steve Welburn
h3. Google Terms Of Service
178 8 Steve Welburn
179 8 Steve Welburn
1 March 2012 Google Terms of Service : http://tinyurl.com/89dc9fa
180 8 Steve Welburn
181 8 Steve Welburn
<pre>
182 8 Steve Welburn
When you upload or otherwise submit content to our Services, you give
183 8 Steve Welburn
Google (and those we work with) a worldwide license to use, host, store,
184 8 Steve Welburn
reproduce, modify, create derivative works (such as those resulting from
185 8 Steve Welburn
translations, adaptations or other changes we make so that your
186 8 Steve Welburn
content works better with our Services), communicate, publish, publicly
187 8 Steve Welburn
perform, publicly display and distribute such content. The rights you
188 8 Steve Welburn
grant in this license are for the limited purpose of operating, promoting,
189 8 Steve Welburn
and improving our Services, and to develop new ones. This license
190 8 Steve Welburn
continues even if you stop using our Services (for example, for a
191 8 Steve Welburn
business listing you have added to Google Maps).
192 8 Steve Welburn
</pre>
193 8 Steve Welburn
194 8 Steve Welburn
h3. Microsoft Services Agreement
195 8 Steve Welburn
196 10 Steve Welburn
19 October 2012 Microsoft services agreement : http://tinyurl.com/8e4kucy
197 8 Steve Welburn
198 8 Steve Welburn
<pre>
199 8 Steve Welburn
When you upload your content to the services, you agree that it may
200 8 Steve Welburn
be used, modifed, adapted, saved, reproduced, distributed, and
201 8 Steve Welburn
displayed to the extent necessary to protect you and to provide, protect
202 8 Steve Welburn
and improve Microsoft products and services. For example, we may
203 8 Steve Welburn
occasionally use automated means to isolate information from email,
204 8 Steve Welburn
chats, or photos in order to help detect and protect against spam and
205 8 Steve Welburn
malware, or to improve the services with new features that makes them
206 8 Steve Welburn
easier to use. When processing your content, Microsoft takes steps to
207 8 Steve Welburn
help preserve your privacy.
208 8 Steve Welburn
</pre>
209 8 Steve Welburn
210 8 Steve Welburn
h2. Archiving Data
211 8 Steve Welburn
212 8 Steve Welburn
h3. BBC Domesday Project
213 8 Steve Welburn
214 8 Steve Welburn
1986 Project to do a modern-day Domesday book (early crowd-sourcing)
215 8 Steve Welburn
* Used “BBC Master” computers with data on laserdisc
216 8 Steve Welburn
* Collected 147,819 pages of text and 23,225 photos
217 8 Steve Welburn
* Media expiring and obsolete technology put the data at risk!
218 8 Steve Welburn
219 8 Steve Welburn
Domesday Reloaded (2011)
220 8 Steve Welburn
* Required emulation of software
221 8 Steve Welburn
* Images restored from original masters
222 8 Steve Welburn
* http://www.bbc.co.uk/history/domesday
223 8 Steve Welburn
224 8 Steve Welburn
To allow long-term access to data
225 8 Steve Welburn
* Don't use obscure formats!
226 8 Steve Welburn
* Don't use obscure media!
227 8 Steve Welburn
* Don't rely on technology being available!
228 8 Steve Welburn
* Do keep original source material!
229 12 Steve Welburn
230 15 Steve Welburn
Google images for "BBC Domesday":https://www.google.co.uk/search?tbm=isch&q=bbc+domesday
231 12 Steve Welburn
232 27 Steve Welburn
h2. Sharing Data
233 27 Steve Welburn
234 47 Steve Welburn
Piwowar, Heather A., Roger S. Day, and Douglas B. Fridsma. "Sharing detailed research data is associated with increased citation rate.":http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0000308
235 47 Steve Welburn
PLoS One 2.3 (2007): e308.
236 12 Steve Welburn
237 12 Steve Welburn
238 12 Steve Welburn
h2. Related Media
239 12 Steve Welburn
240 12 Steve Welburn
h3. Disk Drives Break
241 12 Steve Welburn
242 12 Steve Welburn
"DataCent collection of disk drive failure sounds":http://datacent.com/hard_drive_sounds.php
243 12 Steve Welburn
244 12 Steve Welburn
h3. Laptops Break / Get Broken
245 13 Steve Welburn
246 13 Steve Welburn
* "Shot laptop":http://lilysussman.wordpress.com/tag/laptop-destroyed/
247 22 Steve Welburn
* "Google images of broken laptops":https://www.google.co.uk/search?q=broken%20laptop&um=1&tbm=isch
248 1 Steve Welburn
249 1 Steve Welburn
h2. More To Read
250 1 Steve Welburn
251 48 Steve Welburn
Albers, S. "Editorial: Well Documented Articles Achieve More Impact":http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1568022
252 48 Steve Welburn
BuR Business Research Journal, Vol. 2, No.2, May 2009
253 1 Steve Welburn
254 48 Steve Welburn
Anderson, Richard G., et al. "The role of data/code archives in the future of economic research.":http://www.tandfonline.com/doi/abs/10.1080/13501780801915574
255 48 Steve Welburn
Journal of Economic Methodology 15.1 (2008): 99-119.
256 32 Steve Welburn
257 48 Steve Welburn
Borgman, Christine L. "The conundrum of sharing research data."
258 48 Steve Welburn
Journal of the American Society for Information Science and Technology 63.6 (2012): 1059-1078.
259 1 Steve Welburn
260 48 Steve Welburn
Campbell, Eric G., et al. "Data withholding in academic genetics."
261 48 Steve Welburn
JAMA: the journal of the American Medical Association 287.4 (2002): 473-480.
262 31 Steve Welburn
263 48 Steve Welburn
Evanschitzky, Heiner, et al. "Replication research's disturbing trend.":http://www.sciencedirect.com/science/article/pii/S0148296306002347
264 48 Steve Welburn
Journal of Business Research 60.4 (2007): 411-415.
265 1 Steve Welburn
266 48 Steve Welburn
Fischer, Beth A., and Michael J. Zigmond. "The essential nature of sharing in science."
267 48 Steve Welburn
Science and engineering ethics 16.4 (2010): 783-799.
268 48 Steve Welburn
269 1 Steve Welburn
Freckleton, R.P., P. Hulme, P. Giller and G. Kerby. 2005. "The changing face of applied ecology.":http://onlinelibrary.wiley.com/doi/10.1111/j.1365-2664.2005.00969.x/full
270 31 Steve Welburn
J. Appl. Ecol. 42:1–3.
271 1 Steve Welburn
272 48 Steve Welburn
Gleditsch, N.P., C. Metelits and H. Strand. 2003. Posting your data: Will you be scooped or will you be famous?.
273 48 Steve Welburn
Int. Stud. Perspect. 4:89–97.
274 1 Steve Welburn
275 48 Steve Welburn
Lancaster, Larry, and Alan Rowe. "Measuring Real World Data Availability.":http://static.usenix.org/publications/library/proceedings/lisa2001/tech/full_papers/lancaster/lancaster_html/
276 48 Steve Welburn
Proceedings of the LISA 2001 15th Systems Administration Conference. 2001.
277 1 Steve Welburn
278 48 Steve Welburn
McCullough, Bruce D., Kerry Anne McGeary, and Teresa D. Harrison. "Lessons from the JMCB Archive.":http://muse.jhu.edu/journals/mcb/summary/v038/38.4mccullough.html
279 48 Steve Welburn
Journal of Money, Credit, and Banking 38.4 (2006): 1093-1107.
280 1 Steve Welburn
281 48 Steve Welburn
Piwowar, Heather A., and Wendy W. Chapman. "Public sharing of research datasets: a pilot study of associations."
282 48 Steve Welburn
Journal of informetrics 4.2 (2010): 148-156.
283 1 Steve Welburn
284 48 Steve Welburn
Piwowar, Heather A., et al. "Towards a data sharing culture: recommendations for leadership from academic health centers."
285 48 Steve Welburn
PLoS medicine 5.9 (2008): e183.
286 31 Steve Welburn
287 48 Steve Welburn
Schroeder, Bianca, and Garth A. Gibson. "Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you.":http://www.usenix.org/event/fast07/tech/schroeder/schroeder.pdf
288 48 Steve Welburn
Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST). 2007.
289 48 Steve Welburn
290 48 Steve Welburn
Vandewalle, Patrick, Jelena Kovacevic, and Martin Vetterli. "Reproducible research in signal processing."
291 48 Steve Welburn
Signal Processing Magazine, IEEE 26.3 (2009): 37-47.
292 48 Steve Welburn
293 48 Steve Welburn
Whitlock, Michael C. "Data archiving in ecology and evolution: best practices."
294 48 Steve Welburn
Trends in ecology & evolution 26.2 (2011): 61-65.
295 48 Steve Welburn
296 48 Steve Welburn
Whitlock, Michael C., et al. "Data archiving."
297 48 Steve Welburn
The American Naturalist 175.2 (2010): 145-146.
298 48 Steve Welburn
299 48 Steve Welburn
Wicherts, Jelte M., Marjan Bakker, and Dylan Molenaar. "Willingness to share research data is related to the strength of the evidence and the quality of reporting of statistical results."
300 48 Steve Welburn
PloS one 6.11 (2011): e26828.