WP2 1 Evaluation Strategy Design » History » Version 8

WP2.1 Evaluation Strategy Design¶

In order to evaluate the (training) materials, it is necessary to:

Evaluation of materials

On-going evaluation of course

Informal / Formal Review e.g.:
- Cloze Test to assess readability
- Questionnaire to see how easy it is to find relevant material
- Internal use of materials
- I-Tech Instructional Design & Materials Evaluation Form and Guidelines
- Focus Groups (I-Tech guide)
In-course / formative evaluation (see I-Tech)
- Assessment of level of knowledge within training group
- Checking progress with participants
- Trainer assessment - self assessment and from other trainers if possible
- Pre- and Post-course questionnaires - assess change in answers (true/false + multiple-choice)
Post-course / summative evaluation
- Debriefing of trainer (did it work ? to time ? did it engage people ?)
- Questionnaire for participants Sample training evaluation forms
- Medium-term review of usefulness of course content / adoption of techniques (e.g. 2-3 months after course)

Reaction - to the course ("motivation" may be more appropriate)
- Pacing, was it enjoyable
Learning - from the course
- Did the facts get across ?
Behavior - changes after the course
- Did participants actually manage their data better
  - during research ?
  - at the end of research ?
- Have data management plans been produced for grant proposals ?
Results or Impact - to a wider community
- Did they publish data ?
- Was any data loss avoided ?

Review content for:

based on the target audience

Instructional System Design approach to training

Training Works!... ...what you need to know about managing, designing, delivering, and evaluating group-based training