|
The
Evaluation and Redesign of eDeploy
Online Learning Modules
View
Master's Project
Note: The actual artifact will open in a new window.
Problem
Statement
In 1999 eDeploy, Inc. created an extensive set of online learning modules
for their software. The learners are to complete these modules prior to
attending an instructor-led training session, however 90% of the learners
were not completing the tutorials. Aside from the time, money and effort
put forth by the design and development team for these modules, there
were other impacts on eDeploy from the lack of online tutorial completion.
The online modules are a prerequisite for an advanced instructor-led hands-on
workshop. Without the learners previously completing the introductory
information online, the instructor must back track and review the information
provided in the online learning modules. This additional information increases
the amount of face-to-face training time and oftentimes the advanced content
has to be overlooked due to time constraints. The eDeploy audience is
varied in technical ability, job function and largely geographically dispersed,
which was the initial reasoning for developing the online learning modules.
My role with eDeploy, Inc. was to evaluate the existing online learning
modules, determine the reasons for the extremely high number of learners
that are abandoning these tutorials and redesign the online learning curriculum
to increase learner usage and information retention.
top
Situation
Analysis
This project
spanned seven months. My initial assignment with eDeploy was to evaluate
the second release of the eLearning modules and assist the beta test team
in obtaining quality results. The evaluation revealed that only 10% of
the learners were actually passing the course, the other 90% were not
failing, but were not completing the course. The end result was a complete
redesign of the eLearning suite including identifying a new Learning Management
System (LMS).
This project includes
4 main parts:
- The evaluation
of the existing eDeploy eLearning modules
- The redesign of
the eDeploy eLearning modules
- Selecting and implementing
a Learning Management System
- The development
of the eDeploy eLearning modules
Top
Rationale
The main goal in the redesign of the eLearning modules was to increase
the learner usage and learner retention, reducing the amount of overview
content review in the face-to-face advance workshop. Learner completion
of the online modules would also reduce the amount of overall helpdesk
calls for simple issues covered in the eLearning content. As the audience
is varied, the eLearning modules needed to accommodate a wide range of
technical ability as well as meet the needs of each job role as defined
within the eDeploy user population.
The Web is the primary
medium for the eDeploy application, thus the learning medium was decidedly
web-based prior to my arrival. eDeploy also had very high technical restrictions
that the evaluation and redesign of the online learning did not need to
worry about technical needs. eDeploy supported Internet Explorer 4.0 and
above only, and the software application was designed for 800x600 resolution.
There are 5000+ eDeploy users worldwide, thus the eLearning audience is
large in number and extremely geographically dispersed, which only solidified
the use of the Web as the training delivery media.
eDeploy is a process-based
software. There is no definite procedure as far as configuring the software
to meet the needs of the customer, and most often than not there are two
ways to complete each task. The primary goal with the initial eLearning
modules is navigation and where to locate task information. The second
goal is to ensure the learners are able to use the software according
to their needs. Since this is software application training, the simple
strategy of Rule, Example, Practice will be used. Simulation and visual
representation of the material is key for this strategy to work, and is
discussed in greater detail in later sections. As stated earlier, there
are several ways to perform each task in eDeploy. Each eDeploy customer
defines the practice of these tasks; therefore the eLearning suite must
be flexible. The online learning strategy is to remain learner controlled,
with a linear progression available, but not necessary.
Top
Results
Report
eDeploy Inc. suffered through three layoffs in the spring of 2001 before
finally closing its doors. The training department was let go in the final
layoff before the company went defunct. During the initial layoffs the
software went back into a development phase, however employees in the
customer service areas were retained to support the existing software.
The development of the entire suite of eLearning modules was never completed.
Only one full example exists, and that is of the overview module. This
entire eLearning redesign and development was never rolled out to the
end user population and thus no formative or summative evaluation could
be conducted. The eDeploy eLearning Module 1 is an introductory module
covering logon, navigation and content and directory structure.
Top
Evidence
of Value
Although the end eLearning product was never realized, the project
itself was indeed valuable. I was able to take a project from start to
finish through all design phases, I just happened to start the design
cycle with evaluation and progress from there. I was also able to review,
evaluate and implement a Learning Management System, which could have
been a project in itself.
I feel that if eDeploy,
Inc. were still in business we would have achieved success with the redesigned
eLearning modules. The customers were behind us and willing to help out
and evaluate our new modules. It is truly a shame, but a sign of the times
that eDeploy went out of business.
Top
Reflections
This project spanned seven months. My initial assignment was to evaluate
the second release of the eLearning modules and assist the beta test team
in obtaining quality results. The beta test team was well into the quality
assurance phase and did not like my prodding around in their hard design
and development work. The valuation revealed that only 10% of the learners
were actually passing the course, the other 90% were not failing, they
were not even completing the course. The end result was a complete redesign
of the eLearning suite including a new LMS. I couldn't have asked for
a better project for my Master's Project. I ended up choosing this project
in particular because it derived from a real-world work project. I was
able to collaborate with colleagues, eDeploy employees and customers on
the design and development. Until the time came to finally compile all
the project information, did I realize that I could have had 4 separate
projects. However, I felt that showcasing my work in this way demonstrates
my ability as an instructional designer.
Top
Responsibilities
Met
Responsibility #2- Designs instruction or human performance strategy to
meet the needs of learners. The eDeploy online learning module was designed
to meet the needs of a dispersed audience. The online learning was designed
to be used as a training tool first and reference later, therefore it
is very learner controlled and learner centered.
Responsibility #3-Uses
a variety of media to deliver instruction to students and to engage student
in learning. The online setting for this tutorial is appropriate for the
diverse audience targeted, and the variety of instructional strategies
and activities used within the tutorial strive to engage the learner.
Responsibility #4-Understands
how to capitalize on the capacities and abilities of each learner. The
online learning was ultimately destined for a wide audience. With that
in mind, supplemental face-to-face courses and downloadable job aids and
software simulation (demonstration) was developed.
Responsibility #5-Manages
complex projects and resources in support of learning. I wore two hats
on this project, one of project manager and the other of instructional
designer. Through the course of this project I coordinated the selection
and implementation of a Learning Management System and managed technical
writers in the development of the online modules, while remaining the
key instructional designer.
Responsibility #6-Uses
incisive and relevant assessment and evaluation techniques. The start
of this project is actually an evaluation of the prior online learning
modules. I was able to access multiple sources for data gathering and
review both qualitative and quantitative data. As far as evaluation and
assessment in the online tutorial, there are both hands-on exercises and
multiple-choice quizzes to test the learner throughout the course of the
modules.
Top
|
