Continual improvement efforts are often implemented poorly, leaving the folks being “improved” feeling hostile and unappreciated. But improvement efforts do not have to be foolish or punitive. If we want to improve online programs, courses, and instruction, we have to first determine and gain consensus around the goals for these efforts, select metrics that will tell us what we want to know, and intelligently analyze these metrics for clues about needed changes. Sounds simple, but it isn’t.