Evidence Promoting Good Data Management » History » Version 72

« Previous - Version 72/89 (diff) - Next » - Current version
Steve Welburn, 2012-11-16 11:32 AM

Evidence Promoting Good Data Management¶

If you have any additional examples that you would like to share, please email them to: rdm.c4dm at gmail.com

Disasters!¶

General list of destroyed libraries on Wikipedia!

Shipwreck!¶

Wealth of cephalopod research lost in a 19th century shipwreck 29 May 2015 (ScienceNews, Wild Things)

There are some 3 million shipwrecks scattered across the ocean floor, UNESCO has estimated, and most of them are still waiting to be found. One of those ships, which sank off the French coast in 1843, carried a treasure trove of science — most of the papers and research equipment of Jeanne Villepreux-Power, who was one of the leading cephalopod researchers of her time.

Earthquake!¶

L'Aquila earthquake, Italy

Valuable Cancer Research Lost In Italian Earthquake 12 April 2009 (medindia.net)

A major casualty of the last week’s earthquake in Italy could be valuable research work done by a UK-based charity over the last two years.

Leukaemia Busters, Southampton, has been developing pioneering drugs in a clinic in the quake-hit city of L'Aquila.

Dr David Flavell, from the charity, said it was likely specially engineered leukaemia cells used to produce anti-bodies had been lost.

Leukaemia Busters' research survives Italian earthquake 10 April 2009 (Southern Daily Echo)

Two years of life-saving research into the treatment of a killer disease feared lost forever by a Hampshire charity has incredibly survived the Italian earthquake disaster.

Leukaemia Busters were delighted to discover that laboratories where scientists had spent the past two-and-a-half years working to develop pioneering drugs to fight leukaemia remain standing.

The unbelievable news came after rescue workers allowed Professor Rodolfo Ippoliti into the devastated city of L’Aquila and see for himself the destruction caused by the 6.3 magnitude quake.

Tohoku earthquake, Japan 2011

Assistance for the researchers affected by the Tohoku Earthquake, A message from the Japanese scientist community at NIH 2 April 2011

We have heard that research facilities and equipment at many universities and research institutions in the Tohoku and Kanto regions were damaged as a result of this disaster, and many scientists and students have been forced to stop their research because their valuable research samples or data have been lost. All of the staff and the researchers at NIH are deeply distressed by the devastation that has struck Japan.

Fire!¶

Southampton University Mountbatten building

Fire destroys top research centre (BBC)
Images on Flickr
University vows to rebuild centre (BBC)
Fire at University of Southampton data recovery 1 March 2011 (Computer Weekly)

U. of York Chemistry - 1980

Aftermath of the Chemistry Department fire, May 1980 (U. of York Digital Library)

U. of York History - 1992

Fire damage to University of York History Department, Vanbrugh College 1992 (U. of York Digital Library)
Fire damaged corridor, University of York History Department, Vanbrugh College 1992 (U. of York Digital Library)

U. of York, fire in student room - 1993

Student room after fire - Goodricke College Block C, 1993 (U. of York Digital Library)

University of Glasgow

University counts cost of fire damage 24 October 2001 (BBC)

Professor Sir Graeme Davies said that a substantial amount of research had been lost in the fire.

U. of York chemistry building

University of York chemistry department fire 2 February 2012 (BBC)
Fire at University of York's chemistry department 3 February 2012 (York Press)

Strathclyde university engineering department

Firefighters tackle blaze at Strathclyde University 7 February 2012 (BBC)

Further disruption for Strathclyde teaching students 12 September 2012 (The Journal)
bq. The disruption began on 7 February when 150 students had to be evacuated as a fire started in the Roche Lab in the university's chemical engineering department, forcing the university to relocate lectures across the campus including the Royal College, and Students' Association building on John Street.

U. of Nottingham - GlaxoSmithKline Carbon Neutral Laboratory for Sustainable Chemistry

The state-of-the art building, which had been partly funded by a £12m grant from GlaxoSmithKline (GSK), was still under construction and due to be completed by next year. It was to be "the world's first carbon neutral lab", the university said, and would have housed work aimed at "fundamentally changing how we do chemistry in a more sustainable way".

Hurricane¶

Hurricane Katrina

Riding Out the Storm 9 September 2005 (Science)
Displaced Researchers Scramble to Keep Their Science Going 23 September 2005 (Science)
New Orleans Labs Start Their Uncertain Comeback 25 November 2005 (Science)
One Year After, New Orleans Researchers Struggle to Rebuild 25 August 2006 (Science)

Hurricane Sandy

"Sandy destroyed years of medical research": http://rt.com/usa/news/sandy-research-power-medicine-681/ 31 October 2012

When Hurricane Sandy struck New York, it washed away years of scientific research from the New York University School of Medicine, including genetically modified mice, enzymes, antibodies and DNA strands.

NYC Science Stunned by Sandy 2 November 2012 (The Scientist)

Flooding and blackouts caused by super storm Sandy have had a devastating impact on scores of scientists in the Big Apple, with one research center losing thousands of lab mice as well as precious reagents—a situation that could set some researchers back years.

Help for Sandy-Stricken Scientists 9 November 2012 (The Scientist)

New York research facilities feel Sandy's wrath 1 November 2012 (Nature blog)

Although New York University (NYU) was clearly the research facility hardest hit by this week’s storm, others were also affected. Leslie Vosshall, who studies the olfactory system of mosquitoes at Rockefeller University, located about 35 blocks further up river from NYU, shut down a computer server in the basement on Sunday, but fears it could have been damaged from flooding. She has had to wait for the university to pump out the water, before she can check on it. “We do have some of the data backed up elsewhere, but it would set us back significantly.”

Sandy wounded servers, some grievously, say services firms 7 November 2012 (PC Advisor)

Sandy and Allison...

Sandy’s Toll on Medical Research 31 October 2012 (Slate)

In 2001, a tropical storm called Allison flooded Houston with several feet of rain and pushed 10 million gallons of water into the medical-school basements at the University of Texas. The disaster drowned at least 4,000 rats and mice, along with 78 monkeys, 35 dogs, and 300 rabbits. (More than half the animals on campus had been living underground.) Nearby, at the Baylor College of Medicine, basement flooding killed 30,000 mice.

Tropical storm Allison

Texas researchers regroup after Tropical Storm Allison 13 August 2001 amednews.com

Soaked hard drives and drowned lab animals may delay new medical discoveries by months or years, but hope survives as research facilities dry out.

Tropical Storm Allison's flood caused the following losses at Baylor College of Medicine and the University of Texas-Houston Medical School:
One calf
Thirty-five dogs
Seventy-eight monkeys
Several hundred rabbits
More than 30,000 transgenic mice and rats
A state-of-the-art MRI machine worth $2 million
Ten years' worth of data on spinal cord injuries
A 20-year collection of 60,000 breast tumor samples

Drowned rats 12 June 2001 (New Scientist)

As well as destroying research animals, the floodwater has swamped computers. It has also caused power failures, knocking out the refrigerators and freezers used to store samples for research. Back-up cell cultures used for research into cancer at the Baylor College of Medicine will have died, say local officials.

Flood¶

Flood descimates building, work at University of Hawaii 1 November 2004 (USA Today)

HONOLULU — Heavy rain sent water as much as 8 feet deep rushing through the University of Hawaii's main research library Saturday, destroying irreplaceable documents and books, toppling doors and walls and forcing a few students to break a window to escape.

Lyttle's genetic research on the Drosophila goes back 35 years and some of it is irretrievably lost, he said.

McBride and much of the library staff worked all day Sunday to try to save some of the 90,000 photographs stored in the basement along with rare government documents and Hawaiian maps.

The flood also destroyed computers, books, magazines and equipment.

Classes canceled at UH on Wednesday 2 November 2004 (kpua.net)
bq. ...But researchers at the University of Hawaii, which was hard hit, say the flash flood caused untold losses of research damage in computers damaged by flood waters.

Also risk during research for physical data... Cereal research programs set back a season from summer flooding 12 August 2014 (Manitoba Co-Operator)
bq. ...All three programs have been set back a season due to data lost after their plots were inundated by the rising Assiniboine at July’s beginning ... they are starting to talk about what to do to mitigate the risk of this happening again...

Anecdotal Tales Of Lost Data ¶

The Lost Laptop Problem¶

2010 Ponemon Institute report for Intel re. US laptops
- On average, 2.3% of laptops assigned to employees are lost each year
- In education & research that rises to 3.7%, with 10.8% of laptops being lost before the end of their useful life
  - ~3 years i.e. within 1 PhD of allocation!
- 75% lost outside the workplace
Very similar results from 2011 European report!

Intel 2010, The Billion Dollar Lost Laptop Problem - http://tinyurl.com/8c9m4bn

Intel 2011, The Billion Euro Laptop Problem - http://tinyurl.com/9wpbxn9

Reliability¶

Laptop Reliability¶

2011 PC World Laptop Reliability Survey from 63,000 readers:
- 22.6% had signifcant problems during the product's lifetime
- Of which...
  - 19% had OS problems ~1 in 25 of all laptops
  - 18% had HDD problems ~1 in 25 of all laptops
  - 10% PSU problems ~1 in 50 of all laptops

PC World 2011 - http://tinyurl.com/876qza5

Hard Disk Failures¶

Failure Trends In A Large Disk Drive Population
- Usenix conference on File and Storage Technologies 2007 (FAST '07)
- Eduardo Pinheiro & Wolf-Dietrich Weber, Google Inc.
Data collected from over 100,000 disk drives at Google
As part of repairs procedures:
- ~13% of disk drives replaced over 3 years
- ~20% of disk drives replaced over 4 years

Article: http://tinyurl.com/octz6b

More info

Data management in the cloud¶

See JISC/DCC document "Curation In The Cloud" - http://tinyurl.com/8nogtmv

Service agreements may give wide-ranging rights to the data service.

Google Terms Of Service¶

1 March 2012 Google Terms of Service : http://tinyurl.com/89dc9fa

When you upload or otherwise submit content to our Services, you give
Google (and those we work with) a worldwide license to use, host, store,
reproduce, modify, create derivative works (such as those resulting from
translations, adaptations or other changes we make so that your
content works better with our Services), communicate, publish, publicly
perform, publicly display and distribute such content. The rights you
grant in this license are for the limited purpose of operating, promoting,
and improving our Services, and to develop new ones. This license
continues even if you stop using our Services (for example, for a
business listing you have added to Google Maps).

Microsoft Services Agreement¶

19 October 2012 Microsoft services agreement : http://tinyurl.com/8e4kucy

When you upload your content to the services, you agree that it may
be used, modifed, adapted, saved, reproduced, distributed, and
displayed to the extent necessary to protect you and to provide, protect
and improve Microsoft products and services. For example, we may
occasionally use automated means to isolate information from email,
chats, or photos in order to help detect and protect against spam and
malware, or to improve the services with new features that makes them
easier to use. When processing your content, Microsoft takes steps to
help preserve your privacy.

Archiving Data¶

BBC Domesday Project¶

1986 Project to do a modern-day Domesday book (early crowd-sourcing)

Used “BBC Master” computers with data on laserdisc
Collected 147,819 pages of text and 23,225 photos
Media expiring and obsolete technology put the data at risk!

Domesday Reloaded (2011)

Required emulation of software
Images restored from original masters
http://www.bbc.co.uk/history/domesday

To allow long-term access to data

Don't use obscure formats!
Don't use obscure media!
Don't rely on technology being available!
Do keep original source material!

Google images for BBC Domesday

Sharing Data¶

Piwowar, Heather A., Roger S. Day, and Douglas B. Fridsma. Sharing detailed research data is associated with increased citation rate.
PLoS One 2.3 (2007): e308.

Related Media¶

Disk Drives Break¶

DataCent collection of disk drive failure sounds

C4DM Sustainable Research Data »

Sound Data Management Training

Wiki