Documents
Resources
Learning Center
Upload
Plans & pricing Sign in
Sign Out

152.122.44.126CarrierResearchResultsoutreachSta

VIEWS: 2 PAGES: 23

									FMCSA State Safety Data
Quality:
Enhancing the Evaluation
August 2006
Presentation Overview
State Safety Data Quality Enhancements



   Where are we now?

   How can we improve?

   Where are we headed?
Where are we now?
Data Driven

   Through our partnership in the MCSAP the
    FMCSA shares a common safety goal with the
    States

   FMCSA and State partners share in
    recognition that quality data is essential
    –   Uniform, complete, accurate and timely information
        needs to be collected and reported to FMCSA on
        crashes and roadside inspections
Where are we now?
Data Quality Efforts
                         Monthly                    UMTRI
                        Monitoring             Off-site Analysis
                         of State              of State Crash
                       Data Quality                   Data


                                                                      On-site
Ongoing Evaluation                 FMCSA                             State Data
of State Safety Data             Data Quality                      Quality Reviews
       Quality
                                Improvement
                                  Program
                                                               Analysis and
                                                              Improvement
                                                              of State PARs

           DataQs                      Safety Data
                                      Improvement
                                        Funding
Where are we now?
Data Quality Efforts
                         Monthly                    UMTRI
                        Monitoring             Off-site Analysis
                         of State              of State Crash
                       Data Quality                   Data


                                                                      On-site
Ongoing Evaluation                 FMCSA                             State Data
of State Safety Data             Data Quality                      Quality Reviews
       Quality
                                Improvement
                                  Program
                                                               Analysis and
                                                              Improvement
                                                              of State PARs

           DataQs                      Safety Data
                                      Improvement
                                        Funding
Where are we now?
State Safety Data Quality (SSDQ)

   Objective
    –   To evaluate the completeness, timeliness, accuracy
        and consistency of State-reported crash and
        inspection data in the Motor Carrier Management
        Information System (MCMIS)
   Methodology
    –   Consists of 5 performance measures and 1
        overriding indicator
    –   Results in a scorecard for each State
Where are we now?
SSDQ Measures and Indicator


                       Fatal Crash
                       Completeness
                                              Crash
     Inspection
                                              Timeliness
     Accuracy

                            Overall
                            Rating
                                            Crash
       Inspection                           Accuracy
       Timeliness


                    Crash Reporting
                    Consistency Indicator
Where are we now?
SSDQ Measures


                      Fatal Crash
                      Completeness
                                             Crash
    Inspection
                                             Timeliness
    Accuracy

                           Overall
                           Rating
                                           Crash
      Inspection                           Accuracy
      Timeliness


                   Crash Reporting
                   Consistency Indicator
Where are we now?
SSDQ Enhancements to date
                          March 2006: Inclusion of ‘Change’ records
                          into Timeliness analyses

March 2004: SSDQ released to public




December 2004: Inclusion of HM Intrastate
records into Accuracy analyses

                         June 2006: Exclusion of ‘carrier non identifiable’
                         crash records from Accuracy analyses
Where are we now?
June 2006 SSDQ results
Where are we now?
SSDQ results: 27 Month Comparison


          Overall State Ratings
             March 2004 June 2006
       Good: 24 States 32 States
        Fair: 13 States 12 States
       Poor: 14 States    7 States
How can we improve?
2005 GAO Data Quality Report



   GAO Recommendations related to SSDQ
    –   Develop an Action Plan to implement
        enhancements to the SSDQ map and methodology
    –   Provide a crash-specific data quality rating
        separate from the Overall State rating
    –   Provide information on the website on the
        limitations of the map and the underlying ratings
How can we improve?
Potential Enhancements to SSDQ




   GAO’s evaluation highlighted areas for
    improvement in the SSDQ methodology

   FMCSA is addressing these items as well as
    developing potential new measures.
Where are we headed?
Potential New Crash Measures


  Crash Reporting Completeness


               Crash Record Completeness


   Crash Record Accuracy
Where are we headed?
Crash Reporting Completeness




   Non-Fatal Crash Completeness Measure
    –   Evaluates the completeness of reporting of non-
        fatal crash records
    –   Fatal to non fatal crash records in MCMIS
        compared to the expected number of fatal to non
        fatal crash records
Where are we headed?
Crash Record Completeness


   Driver Identification Record Completeness
    –   Evaluates whether a crash record has driver
        identification fields filled out completely
    –   Driver Identification fields
            Driver License #
            Driver date-of-birth
            Driver First Name
            Driver Last Name
            License class
Where are we headed?
Crash Record Completeness


   Vehicle Identification Record Completeness
    –   Evaluates whether a crash record has truck/bus
        identification fields filled out completely
    –   Vehicle Identification fields
            VIN
            License plate #
            Vehicle configuration
            Cargo body type
            GVWR
Where are we headed?
Crash Record Accuracy


   Hazmat Information Accuracy
    –   Evaluates the integrity/agreement of the hazmat
        information reported within a crash record
    –   Hazardous Material fields
            HM Placard
            HM Class Number
            HM Release
            HM 4 digit number
Where are we headed?
Crash Record Accuracy


   Vehicle Information Accuracy
    –   Evaluates the integrity/agreement of the vehicle
        information reported within a crash record
    –   Vehicle Information fields
            Vehicle configuration
            Cargo body type
Where are we headed?
Next Steps in Measure Development

   Perform analyses to determine the existing quality of
    data reported by the States in the areas of interest

   Develop potential criteria for ‘good’, ‘fair’ and ‘poor’
    performance

   Provide opportunity for States to give feedback on new
    measures

   Integrate new measures into SSDQ methodology
Where are we headed?
Development of SSDQ Crash Rating

      Crash Driver
                                                  Non Fatal Crash
      Identification         Fatal Crash
                                                  Completeness
      Completeness           Completeness
                                                          Crash
 Crash Vehicle
                                                          Timeliness
 Identification
 Completeness
                                 CRASH
                                 Overall
 Crash Hazmat                    Rating                Crash
 Accuracy                                              Accuracy

   Crash Vehicle
   Information Accuracy
                          Crash Reporting
                          Consistency Indicator
In conclusion

   We’ve made a lot of progress...
    –   SSDQ methodology shows improvement in the
        quality of data reported to MCMIS



   There are opportunities for improvement
    –   Develop additional measures for a more complete
        evaluation of the quality of data reported by the
        states
For more information or if you are
interested in providing input…
http://ai.fmcsa.dot.gov/DataQuality/dataquality.asp


                                                      Contact info:
                                                      Betsy Benkowski
                                                      FMCSA,
                                                      Analysis Division
                                                      202-366-5387

								
To top