Sound Data Management Training

h1. WP2.1 Evaluation Strategy Design

In order to evaluate the (training) materials, it is necessary to:

* identify specific (learning) objectives which they aim to meet

* evaluate whether the materials meet those objectives

additionally, we need to 

* identify the overall purposes of the materials

* evaluate whether the cumulative objectives satisfy these overall purposes

h2. Methods of Evaluation

* Informal / Formal Review e.g.:

** "Cloze Test":http://en.wikipedia.org/wiki/Cloze_test to assess readability

** Questionnaire to see how easy it is to find relevant material

** Internal use of materials

** "I-Tech Instructional Design & Materials Evaluation Form and Guide":http://www.go2itech.org/HTML/TT06/toolkit/evaluation/forms.html

* In-course evaluation (see "I-Tech":http://www.go2itech.org/HTML/TT06/toolkit/evaluation/dev_eval.html)

** Assessment of level of knowledge within training group

** Checking progress with participants

** Trainer assessment - self assessment and from other trainers if possible

** Pre- and Post-course questionnaires - assess change in answers (true/false + multiple-choice)

* Post-course questionnaire

** "Sample training evaluation forms":http://www.go2itech.org/HTML/TT06/toolkit/evaluation/forms.html

* Medium-term review of usefulness of course content / adoption of techniques (e.g. 2-3 months after course)

I-Tech consider four levels of results from training:

* Reaction - to the course

** Pacing, was it enjoyable

* Learning - from the course

** Did the facts get across ?

* Behavior - changes after the course

** Did participants actually manage their data better

*** during research ? 

*** at the end of research ?

** Have data management plans been produced for grant proposals ?

* Results or Impact - to a wider community

** Did they publish data ?

** Was any data loss avoided ?

Review content for:

* reading level

* correctness

* organization

* ease of use

based on the target audience

h2. Tools

"Bristol Online Surveys":http://www.survey.bris.ac.uk/

"I-Tech Training Toolkit":http://www.go2itech.org/HTML/TT06/toolkit/evaluation/index.html