Evaluation Objectives: A Brief Description
I got an email today from someone asking me about a term I created called “Evaluation Objectives.” I realize that I have not actually written anything for public consumption on this, SO this blog post will suffice until my book on workplace learning is released. Apologies if the following is not completely clear.
The basic idea is that we ought to have evaluation objectives rather than learning objectives in the traditional sense.
Specifically, we need to decouple our learning objectives from our evaluation objectives so that what we evaluate is directly relevant. Of course our evaluation objectives and learning objectives have to
be linked, but not necessarily with a one-on-one correspondence.
AN EXAMPLE
Suppose you want to train managers to be better at championing change efforts.
Traditionally, we might have objectives like:
The learner will be able to describe how people tend to resist change.
Or, put in a more performance-oriented fashion, a traditional objective might read:
The learner will engage in activities that lessen colleagues’ resistance to change.
Examples of evaluation objectives might be as follows:
The learner will initiate a change effort within one month after the training ends and be successful in getting 75% of his/her colleagues to sign a public statement of support for the effort.
OR, if real-world compliance cannot be assessed, an evaluation objective might be something like:
2. In the “Change-Management Simulation” the learner will score 65 points out of a total possible of 90.
OR, if a simulated performance can’t be created, an evaluation objective might focus on ratings by employees.
3. Two months after the training ends, the learners’ colleagues will rate them on average at least 4.5 (of 6 levels) on the multi-rater 360-degree change-management scale on each of the 5 indices.
OR, if this can’t be done, an evaluation objective might focus on a series of scenario-based questions.
4. On the 20-question scenario-based quiz on change management given two weeks after the course ended, the learner will get at least 17 correct.
NOTE: More than one evaluation objective can be used for any learning intervention.
THE POINT:
Evaluation objectives are NOT tied to individual learning points that have to be learned, though of course they are linked because both should be relevant to the overarching goals of the learning program.
THE BIG BENEFIT:
When objectives focus on the big picture, as compared to when there is a one-to-one correspondence between learning objectives and evaluation items, (1) they are more relevant, (2) the learners are more likely to see them as valuable and worth achieving, (3) organization stakeholders are more likely to see the evaluation results as having face validity, (4) the evaluation results will give us additional pertinent information on how to improve our learning interventions.