Lessons learned from a web based distributed learning case study: evaluation of course design, modules, effectiveness, and students' performance and reactions

Abstract

This thesis evaluated the first iteration of Navy PostgraduateSchool (NPS) on-line courseSpace Systems - Technology andApplications'. The thesis goal wasto evaluate: course design; courseeffectiveness; student expectationsand motivation before and affectivereactions after the course; andtypical patterns of on-line learningbehavior according to Long'stheory. Ultimately, the thesisintended to derive lessons learnedand recommendations for futuredistributed learning (DL) coursesand future research in this areaThere were thirty regular, residentNPS students in the sample. Datawas collected from nine sources:four on-line questionnaires,Student Opinion Forms, on-line tracking:, final grades, interviews with students, and interviews with the instructor. Even though thecourse first course taught by this instructor, it was successful. Student expectations, motivation, affective and utility reactions werepredominantly positive. For students, the most important advantage of the course was timeflexibility and convenience. Students and the instructor agreed about central role of interactivity/feedback in a DL, which should be included into models of training effectiveness evaluation. Long- Dziuban's protocol results were surprising, but solid conclusions cannot be made without focused research. Results provided several recommendations about the course design, pedagogical improvements, instructional counseling ,and future research.