We continue to hear about data, BIG data, ROI, analytics and measurement. And we may recall what Mark Twain "popularized" about statistics https://en.wikipedia.org/wiki/Lies,_damned_lies,_and_statistics.
Where are we with ROI?
What kind of progress are we making with analytics as it relates to learning in the workplace?
What obstacles exist? persist? are mythical?
What would it take for something to be so obviously effective that we no longer take the time or cost to measure it?
Do you remember the joke about a drunk man crawling around on his hands and knees under a street light late at night looking for his wallet? A passerby asks the man if he is sure this is where he dropped the wallet, to which the drunk replies, “I actually think I dropped it across the street.”
“Then why are you looking over here?” the baffled passerby asks.
“Because the light is better here,” explains the drunk.
Unfortunately, the same can be true for the “key performance indicators” (KPIs) we often rely on to calculate ROI. Instead of matching KPIs to the ultimate desired objectives, many times we find ourselves focusing on “where the light is better” — i.e. what is easiest to quantify.
The effectiveness of educational programs can be viewed multiple ways:
The first metric is relatively easy to quantify with a simple quiz. I am very interested in how others approach the latter questions.