WP2.1 Evaluation Strategy Design¶

In order to evaluate the (training) materials, it is necessary to:

• identify specific (learning) objectives which they aim to meet
• evaluate whether the materials meet those objectives
  additionally, we need to
• identify the overall purposes of the materials
• evaluate whether the cumulative objectives satisfy these overall purposes

Methods of Evaluation¶

• Informal / Formal Review e.g.:
  • Cloze Test to assess readability
  • Questionnaire to see how easy it is to find relevant material
  • Internal use of materials
  • I-Tech Instructional Design & Materials Evaluation Form and Guide
• In-course evaluation (see I-Tech)
  • Assessment of level of knowledge within training group
  • Checking progress with participants
  • Trainer assessment - self assessment and from other trainers if possible
  • Pre- and Post-course questionnaires - assess change in answers (true/false + multiple-choice)
• Post-course questionnaire
  • Sample training evaluation forms
• Medium-term review of usefulness of course content / adoption of techniques (e.g. 2-3 months after course)

I-Tech consider four levels of results from training:

• Reaction - to the course
  • Pacing, was it enjoyable
• Learning - from the course
  • Did the facts get across ?
• Behavior - changes after the course
  • Did participants actually manage their data better
    • during research ?
    • at the end of research ?
  • Have data management plans been produced for grant proposals ?
• Results or Impact - to a wider community
  • Did they publish data ?
  • Was any data loss avoided ?

Review content for:

• reading level
• correctness
• organization
• ease of use

based on the target audience

Tools¶

Bristol Online Surveys
I-Tech Training Toolkit