I want to thank David Kelly and the eLearning Guild for awarding me the prestigious title of Guild Master.
Guild Masters including an amazing list of folks, including lots of research-to-practice legends like Ruth Clark, Julie Dirksen, Clark Quinn, Jane Bozarth, Karl Kapp, and others who utilize research-based recommendations in their work.
Delighted to be included!
For years, we have used the Kirkpatrick-Katzell Four-Level Model to evaluate workplace learning. With this taxonomy as our guide, we have concluded that the most common form of learning evaluation is learner surveys, that the next most common evaluation is learning, then on-the-job behavior, then organizational results.
The truth is more complicated.
In some recent research I led with the eLearning Guild and Jane Bozarth, we used the LTEM model to look for further differentiation. We found it.
The biggest opportunity—or the juiciest low-hanging fruit—is that we can stop just using Tier-1 attendance and Tier-3 learner-perception measures.
We can also begin to go beyond our 60%-rate in measuring Tier-4 knowledge and do more Tier-5 and Tier-6 assessments. As I’ve advocated for years, Tier-5 assessments using well-constructed scenario-based questions are the perfect balance of power and cost. They are aligned with the research on learning, they have moderate costs in terms of resources, and learners see them as challenging and interesting rather than punitive and unhelpful like they often see knowledge checks.
We can also begin to emphasize more Tier-7 evaluations. Shouldn’t we know whether our learning interventions are actually transferring to the workplace? The same is true for Tier-8 measures. We should look for strategic opportunities here—being mindful to the incredible costs of doing good Tier-8 evaluations. We should also consider looking beyond business results—as these are not the only effects our learning interventions are having.
Finally, we can use LTEM to help guide our learning-development efforts and our learning evaluations. By using LTEM, we are prompted to see things that have been hidden from us for decades.
To get the original eLearning Guild report, click here.
To get the LTEM Model and the 34-page report that goes with it, click here.
Released Today: Research Report on Learning Evaluation Conducted with The eLearning Guild.
Report Title: Evaluating Learning: Insights from Learning Professionals.
I am delighted to announce that a research effort that I led in conjunction with Dr. Jane Bozarth and the eLearning Guild has been released today. I’ll be blogging about our findings over the next couple of months.
This is a major report — packed into 39 pages — and should be read by everyone in the workplace learning field interested in learning evaluation!
Just a teaser here:
We asked folks to consider the last three learning programs their units developed and to reflect on the learning-evaluation approaches they used.
While a majority were generally happy with their evaluation methods on these recent learning programs, about 40% where dissatisfied. Later, in a more general question about whether learning professionals are able to do the learning measurement they want to do, fully 52% said they were NOT able to do the kind of evaluation they thought was right to do.
In the full report, available only to Guild members, we dig down and explore the practices and perspectives that drive our learning-evaluation efforts. I encourage you to get the full report, as it touches on the methods we use, how we communicate with senior business leaders, what we’d like to do differently, and what we think we’re good at. Also, the report concludes with 12 powerful action strategies for getting the most out of our learning-evaluation efforts.
You can get the full report by clicking here.
If you're going to the eLearning Guild's Learning Solutions Conference this coming week in Orlando, come join me–and say hello!
I'll be speaking in three sessions:
Time: Wednesday March 19, 10:45AM
Over 300 people are expected to attend. Get there early for a good seat!
Time: Wednesday March 19, 1:00PM
We will hand out paper version of the Manifesto at the session (there are no slides)
Time: Thursday March 20, 7:15AM
A casual conversation about the eLearning Manifesto and Instructional Design
Note: Look for Clark Quinn, or Michael Allen's name (as mine is not listed), but I'll be there!
This week, on March 19th, Wednesday at 10:45 AM, Will Thalheimer (that's me) will be speaking on Subscription Learning at the eLearning Guild's Learning Solutions Conference.
300 people are expected to attend, so come early for your seat!!
Does Subscription Learning have legs?
It's too early to tell, but the eLearning Guild is buying Google Ads on "subscription learning."
At the recent eLearning Guild conference in Orlando, I was asked to lead an Espresso Cafe roundtable discussion on a topic of interest.
My topic: The Pluses and Minuses of Social Media and User-generated Content.
I promised folks from my three sessions that I'd post all the results. Here they are:
Plusses:
Minuses:
Thanks to all the folks who contributed to my discussions. It was kind of hard to hear, but here are the names to thank: Nancy, Leslie, Terra, Pat, Sonya, Betsy, Michael, David, David, Ann, Joyce, Nancy, Chris, Chris, Richard, John, Susan, Paula, John.
The eLearning Guild is offering a $400 early-bird discount if you register for their March Annual Gathering by December 19th. Check it out.
Note: I'll be presenting a workshop (with Roy Pollock) on Learning Measurement, and speaking several other times, so this conference is well worth your while. AND, by saving $400, you can easily afford our symposium.
You must be logged in to post a comment.