Precisely False Industry Data

Recently, the New York Times Public Editor wrote an article on polling. The article skewered many current practices. It also was educational for any of us who want to truly understand the polling data we may hear in the news.

Sadly, the article made me think of the pathetic data that runs around our field—the training, learning, development, e-learning field. I’ve already mentioned some of the data allegedly posing as learning research.

But there is another wide swath of data that we should be very skeptical about—the data some "research" firms and trade organizations are peddling as industry data. The data is typically gathered by sending out surveys to an unrepresentative sample of companies, by having only a fraction of respondants complete the data, by gathering opinions, and by boisterously proclaiming that the data tell us what the industry best-practices are. Here are some of the problems with this farce:

  1. Biased sampling of organizations.
  2. No control for the biasing effects of non-respondants.
  3. Assuming that opinion is fact.
  4. Relying on the averaging of opinions.
  5. Assuming that the average respondants have the best insights.
  6. The arrogance and lack of caveats in the reporting.
  7. Year-to-Year comparisons with different companies in each year’s sample.
  8. Additional biasing due to fraud and corruption, as when these "research" organizations tilt the best-practice results to their paid customers.

Will Rants at MIT Forum in Chicago

Come hear me rant!!

I’ve been invited to deliver one of six rants on the learning/e-learning field at the MIT Enterprise Forum in Chicago, co-sponsored by The Chicago Learning Council.

When: October 17th, 2006. 5:00PM to 8:30PM

To learn more about the event or to sign up: Click Here.

Title of my rant: The big lie at the heart of our fogbound wannabe profession.

Workshop on Learning/e-Learning

At the eLearningGuild’s upcoming conference in San Francisco, DevLearn06, I’ll be leading a workshop entitled, "Designing Learning Into E-Learning: What the Research Says…"

The workshop focuses on fundamental learning principles and specifically about how to utilize these in e-learning to maximize learning results.

Date of Workshop: October 10th, 2006.

See more about Workshop by clicking here. It’s Workshop P2.

See more about the eLearningGuild conference by clicking here.