PowerPoint Presentation

Document Sample
PowerPoint Presentation Powered By Docstoc
					 Safe Mission Accomplishment

Tough, Realistic, Well-Disciplined Training
                   ASIST Results

Aviation Safety Investment Strategy Team (ASIST)
 – In-depth analysis of accident experience
 – All force-modernized aircraft during FY 94-98
 – Eight of top ten hazards (290 total hazards) are
    crew coordination related
 – Number four of top ten controls (249 total controls)
    is crew coordination related, number one
    financially feasible control

Develop, monitor, and evaluate a Crew Coordination
Sustainment Training program integrated into aviation
   tasks (Control Number 4 in “One to Goal List”)
                   Research Focus
 Army applied research for aviation team training
   – “Can interactive multimedia courseware using web-based
     distribution and Distance Learning provide the realism and
     relevance necessary for effective behavior-based team
     training and evaluation?”
 Focus areas
   – Revitalize and enhance the current ACT program without
     repeating research conducted in the initial program
   – Automation and aircraft configuration issues
   – Reduced course length
   – Streamlined assessment and evaluation
   – Adult learning presentation, feedback, and discussion
 Design and develop prototype training and
  evaluation products for usability assessment,
  evaluation, and validation testing by aviation units
  in the field
                       Prototype Products

         Phase I                                   Phase II
– ACT Master Plan                     – Train the Trainer Course
  (ARI/DRC)                           – Nonrated Crewmember
– Aircrew Course                        Course
– Instructor Course                   – Training Support Package
– Performance Evaluation              – IEFT Course
   System                             – AQC Course
– Research Reports                    – IPC Course
                                      – Research Reports
Total of 8 prototype courses of instruction providing 88 training hours. All
  courses include an electronic critique, lesson plan, and instructor notes.
ACT Enhanced Aircrew Course

• Contains 5 Modules with Multiple Lessons
• Modules 1, 2 and 5 Web-Based, Self Paced
• Modules 3 and 4 Instructor Facilitated
• One day in length, Distance Learning Deliverable
ACT Enhanced Instructor Course

 • Contains 6 Modules with Multiple Lessons
 • Modules 2 through 5 Instructor Facilitated
 • One day in length, Distance Learning Deliverable
          ACT Enhanced
     Train the Trainer Course

• Contains six Modules with Multiple Lessons
• All Modules Instructor Facilitated
• Three days in length, Distance Learning Deliverable
        ACT Enhanced Nonrated
    Crewmember Qualification Course

• Contains five modules with multiple lessons
• A mix of CBT and instructor facilitated lessons, built in testing
• One day in length, Distance Learning Deliverable
            ACT Testing and Evaluation

 Phase I Testing
  – Aircrew and Instructor Course (March 2002)
 Phase II Testing
  – Train the Trainer Course (Aug 02, Nov 02, Mar 03)
  – NCM Qualification Course (Jan 03)

       Active and Reserve Component Crewmembers Involved in
              ACTE Courseware Testing as of March 2003
                       Aircrew Course - 154
                       Instructor Course - 63
                       Train the Trainer – 27
                    Nonrated Crewmembers - 7
           ACT Versus ACTE Effectiveness

    Comparison Points               ACT (1992)                  ACTE (2001)
                                16 UH-60 aircrews             8 UH-60 aircrews
     Validation Test            18 hours classroom         8 hours web-based CBT
                                     academics                   Courseware
                           2 simulator training missions
                                  1993 final report        2001 preliminary results
  Measures and Metrics       Descriptive statistics and      Descriptive statistics
                               significance test data
     ACT Behaviors                     +34%                        +14%
                                (13 Basic Qualities)         (5 Crew Objectives)
         ATM Tasks                     +33%                        +11%
   Mission Effectiveness
-Transition to IMC                      +12%                        +13%
-Mission segments complete              +20%                        +20%
    Crew Related Errors
-Manage Threatening Errors              +27%                        +37%
-Number of aircraft crashes             -43%                        -67%
             • Field Study, 29 October-8 November 2001
           • Pre/Post Training Evaluation Simulator Based Missions
                       Operational Field Test
                      Aircrew Course Results

 Participants (March 2002)
    – 28 PCs and PIs and 3 NCMs
 Participant Ratings of Aircrew Course
    –   Tutorial effectiveness (4.0 on 5-point scale)
    –   Content realistic and relevant (3.8 on 5-point scale)
    –   Functions logical and understandable (4.1 on 5-point scale)
    –   Information, pace and timing (3.1 on 5-point scale; 3.0 optimal)
    –   Instructor knowledge, preparation, and clarity (4.4 on 5-point scale)
    –   Effect as refresher to previous ACT (4.1 on 5-point scale)
    –   Training both effective and valuable (4.3 on 5-point scale)
 Aircrew Course Participant Comments . . .
    – “Multimedia presentation was very effective and enjoyable.”
    – “This program allowed you to utilize everyone as a team member.”
    – “The combination of self-paced computer and classroom instruction, as well as, the
      facilitated discussion helped to enhance absorption of material.”
                Operational Field Test
              Instructor Course Results

 Participants (March 2002)
   – 18 SPs IPs IEs MEs MPs and 2 FIs SIs
 Participant Ratings of Instructor Course
   – Lessons helped understand how to . . .
      • Identify ACT behaviors (3.9 on 5-point scale)
      • Evaluate ACT performance (4.2 on 5-point scale)
      • Facilitate ACT performance improvement (4.0 on 5-point scale)
   – IE Guide helpful for implementing ACT in daily ops (4.0 on 5-point scale)
   – Positive effect on flying safety (4.0 on 5-point scale)
   – This instructor training valuable (4.2 on 5-point scale)
 Instructor Course Participant Comments . . .
   – “Enhanced AAR’s should have a positive impact on the unit.”
   – “The mix of multi-media and class interaction help with understanding the
     instructor course.”
   – “Good review of relevant information, the automated format is good.”
               Train the Trainer Test Results

 Participant Ratings of Train the Trainer
   – Lessons helped understand how to…
      • Set up an ACTE class (4.5 on 5-point scale)
      • Present ACTE courses (4.5 on 5-point scale)
      • Facilitate ACT improvement (4.7 on 5-point scale)
   – This ACT Train the trainer Course will have a
     positive effect on standardizing ACT (4.6 on 5-point scale)
   – Overall value of this ACT Train the Trainer Course (4.5 on 5-point scale)

 Train the Trainer Course Participant Comments . . .
   – “It’s opened a whole new way of thinking about ACT….and it works!”
   – “Web-based, easy access and all information can be saved on line. All
     Army and National Guard Aviation units NEED this training”
   – “The CBT design will be of great value to units that are required to be
   – “Student presentations re-enforce learning. This gave me the best
     understanding of the overall course and material.”
                 Nonrated Crewmember Test

 67T and 67U assigned to 101st Airborne
 Participant Ratings of the NCM Course
   – Lessons helped understand how to…
      • Apply aircrew coordination (4.7 of 5-point scale)
      • Evaluate aircrew coordination (4.7 on 5-point scale)
      • Relate ACT to Risk Management (4.4 on 5-point scale)
   – Positive effect on contribution to flying safety (4.3 on 5-point
   – Overall value of this training is positive (4.4 on 5-point scale)

 NCM Course Participant Comments . . .
  – “I liked learning to view problems in a standardized manner.”
  – “I liked the multimedia and self-paced mix.”
     Phase III Research Focus

          Answer the Question

Does the Training Make a Difference?
Courseware Demonstration

User testing results to date indicate high levels
 of acceptance for prototype courseware
    Aircrew Course
    Instructor Course
    Train the Trainer Course
    Nonrated Crewmember Course
               Contact Information

  Army Research Institute
Commercial: (334) 255-2385
Email: KatzL@rwaru.army.mil

                       Center for Team Performance
                        Commercial: (334) 308-5360
                            Email: kkline@drc.com

Shared By: