Office of Operations
21st Century Operations Using 21st Century Technologies
Table of Contents

Traffic Incident Management Training Post-Course Assessment Tool Final Evaluation Report

CHAPTER 2. OVERVIEW

This final evaluation report provides an analysis of the data entered into the Tool by course participants and their respective agency administrators and/or senior management from date of inception through August 15, 2017 (when the data for the last quarterly report was exported from the Tool).

The Tool is designed to:

  • Evaluate whether the course materials and delivery are effective, or perhaps need to be revised or enhanced.
  • Determine the effectiveness of the training in terms of how the student comprehends and retains the course information.
  • Provide an understanding of changes in policy and operational procedures precipitated by the training program that foster enhanced safety and mobility.
  • Gain an understanding of the operational benefits derived from the training program.

Through August 15, 2017, a total of 1,160 Level 1, 3 and 4 assessment had been entered into the tool by training participants and their respective supervisors, agency administrators and/or senior management.

The Level 1 surveys, for both train-the-trainer (TtT) and responder participants, are designed to solicit training participant feedback regarding training content and the instructor. Among TtT course participants, the six questions regarding instructor performance received the highest average percentage (98.6%) of positive responses, with 72.3 percent Strongly Agree and 26.3 percent Agree across the six quarterly reports (Figure 1).

Pie graph of the train-the-trainer participant responses for the six questions regarding instructor performance.

Figure 1. Graph. Train-the-trainer participant feedback on course instructors.

Among responder course participants, the six questions pertaining to trainers also received the highest average percentage (96.4%) of positive responses with 72.6 percent Strongly Agree and 23.8 percent Agree (Figure 2).

Pie graph of the responder participant responses for the six questions regarding trainer performance.

Figure 2. Graph. Responder participant feedback on trainers.

The Level 3 surveys for Responders and Supervisors are designed to solicit feedback on the impact of the training. As shown in Figure 3 below, several metrics consistently received high levels of agreement from both responders and supervisors on the positive impacts from the training across the six quarterly reports.

Graph of the level 3 post-training assessment of positive impacts from the training.

Figure 3. Graph. Level 3 Post-Training assessment of positive impacts.

Similar positive impacts of the training were also captured in the Level 4 survey which identified high levels of agreement from Agency Administrators and Senior Management on improvements resulting from personnel participating in the training.

Graph of the level 4 post-training assessment of positive impacts from the training.

Figure 4. Graph. Level 4 post-training assessment of positive impacts.

The respondent disciplines of those submitting assessments from inception of the tool through August 15, 2017, by training type and evaluation level, is listed in Table 1 below.

Table 1. Assessment tool respondent discipline by training type and evaluation level.
No value Law Enforcement Fire/Rescue/Emergency Medical Services Towing & Recovery Transportation Other
Level 1 Train-the-Trainer course participants
(381 total)		 29.1% 45.0% 4.7% 12.6% 8.5%
Level 1 Responder course participants
(290 total)		 25.5% 54.4% 4.2% 8.0% 8.0%
Level 3 Responders
(375 total)		 30.0% 31.9% 4.1% 28.6% 5.4%
Level 3 Supervisors
(59 total)		 30.5% 35.6% 6.8% 15.3% 11.9%
Level 4 Agency Administrators/Senior Management
(55 total)		 30.9% 27.3% 9.1% 27.3% 5.5%
Office of Operations