Round Template - Excel

Document Sample
Round Template - Excel Powered By Docstoc
					    FileName:              Template_Round_Robin_File_Dec04.xls

                           To add additional points for analysis, select the set of 3 worksheets (Data Entry, Data
 Instructions:
                           Graph, and E(n)).
                           Then, select Edit, Move or Copy Sheet, check the box to "create a copy" and select (move
                           to end).
                           The tabs will automatically be named by adding a number and the graphs will reference
                           the correct data entry pages.

                           Use the "Report Checklist" tab to make sure the final report is complete.
                           The "Reference Values" tab contains the current instructions on selecting the "best"
                           reference values (as of 12/04).
                           Enter all calibration dates and lab IDs on the tab "Lab & Date" and the information will
                           automatically be entered on other sheets.

                           If you find errors or have suggestions on improvements, send an email to
                           georgia.harris@nist.gov or val.miller@nist.gov.




Revision Date     By     Comments
   12/22/2004 G. Harris Many cells are password protected. The password is "metrology".
                         Added P(n) to E(n) chart, & P(n) column in calculations. Edited formatting on "Bias from
      1/3/2005 V. Miller Accepted" column to generate --- when no lab data is present.
                         Modified the Bias column to reference the cell on that page rather than lab & date page.
      1/3/2005 G. Harris No entry on that page keeps "---".
                         Modified the calculated P(n) column in calculations to indicate "---" if there is no reported
                         value. This causes the En/Pn chart to not have a bogus value displayed on the chart.
                         Password protected the Report checklist, reference value pages as well as made
      1/4/2005 V. Miller formatting changes to enable filling in the lists in the spreadsheet.

      3/8/2005 G. Harris Fixed column K in data entry for - 2 s.d..; colored cells for data entry. Added protections.




 8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls File Doc Rev 1of 12                                              7/22/2011
                          PT/ILC Reporting Checklist – Form 2

PT/ILC Identification
Coordinator:
Analyst:
Date of Completion:
NIST Contact:
Artifact Owner:

Ensure that Final Report Contains the Following                                   Included? Y/N
                             Title Page or Introduction
General Description and title of the ILC
Names and affiliations of persons involved in design and conduct of PT/ILC
Date of issue of the report
Report number and clear identification of the PT/ILC
Dates (Time period of conduct of test from beginning to end)
RMAP group

                                            Who
Reference Laboratory
Pivot Laboratory
Participants (include address as appropriate)

                                       What and Why
Objectives
Parameter, Range, Uncertainty (e.g., mass, 1kg, best calibration)
Clear description of the items or materials used, including, where appropriate,
Details of the traceability and uncertainty of assigned values

                                            How
Summary of procedures used to design and implement the scheme (which may
include reference to a scheme protocol)
Procedures Used
Laboratory Equipment Identification (e.g., which balance, which standards, for
each lab

                                          Analysis
Summary of procedure used to establish any assigned value



8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xlsReport Checklist 2of 12                                   7/22/2011
Summary of procedures used to statistically analyze the data


                                     Tables & Graphs
Laboratory test results
Statistical data and summaries, including assigned values of artifact(s), and
Assigned values and summary statistics for test methods/procedures used by
Tables of Data, precision tests, and evaluation data
Graphs of data, standard value/uncertainty charges, Youden plots, misc. graphs

                                        Conclusions
Comments on participants' performance by the provider and technical advisers
Summarization of Results
Recommended Follow-up and corrective action (by analyst/by NIST)
Comments on any technical difficulties raised by participants
Evaluation of the responses of participants performing poorily (if feedback is
required)
Advice, where appropriate, on the interpretation of the statistical analysis

Return to NIST WMD For Archival – Copies and/or originals (electronic preferred) of:
Instructions
Schedules
Datasheets
Submitted Data
Analysis and electronic Documents/spreadsheets




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xlsReport Checklist 3of 12                        7/22/2011
Selecting a Reference Value for ILCs
Guidance Provided in 2000
Choosing an Accepted Reference Value and Accepted Reference Uncertainty
Objectives:
 Best value: most accurate and traceable value
 Ensure "traceability" is satisfied
 Determine if needed for accreditation proficiency tests

Options for the Accepted Reference Value (generally in order of preference; consider analysis of all):
1. NIST Value (depends on measurement area, level, and date of calibration), needs to be compared to
mean/adjusted mean and median.*
2. Mean, adjusted mean, or median - one point from each laboratory preferred, all ok.
3. Mean or median of some laboratory values: 1) labs working at the lowest uncertainty capability
levels; 2) accredited labs; 3) labs who all have recent calibrations of standards when they all agree well.
4. Pivot Lab Value(s).
5. Value provided by someone else…
*The NIST Mass Group has requested that we do not use "official calibration values" in ILC analyses
and is why we are working on the national Key Comparisons program in mass now.

Options for the Accepted Reference Uncertainty (matching number above):
1. NIST Reported Uncertainty (k=2).
2. Standard deviation or adjusted standard deviation of those points used to determine the reference
(mean, adjusted mean, or median) times two (k=2).
3. Standard deviation or adjusted standard deviation of those points used to determine the reference
times two (k=2).
4. Pivot Lab Reported Uncertainty.
5. Uncertainty reported by someone else.

Additional Guidance in 2003
Additional Objectives:
 Evaluate the stability of the artifact (see the Cal Lab paper by Jeff Gust which may have been
presented in Tampa).

Options for the Accepted Reference Value- Additional Considerations
 Look at the data and see what the data tell you instinctively.
 Use statistical tests and tools to evaluate shifts/drifts/instability where appropriate.
 Determine how well all of the options for selecting a reference value agree with each other (if the
median agrees with the mean, the mean of accredited labs, the mean of pivot labs, the mean of labs with
smaller uncertainties, it may not matter much which is selected.
 Determine when a “shift” change occurred and if the suspected “change” exceeds the standard
 Determine if “drift” is occurring and if the suspected “drift” on a trend line exceeds the standard
deviation among the laboratories.



8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls   Reference Values   4of 12                               7/22/2011
  Date of Test                     #                     Lab ID
                                   1
                                   2
                                   3
                                   4
                                   5
                                   6
                                   7
                                   8
                                   9
                                  10
                                  11
                                  12
                                  13
                                  14
                                  15
                                  16
                                  17
                                  18
                                  19
                                  20




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls Lab & Date   5 of 12     7/22/2011
Lab Codes for WMD Round Robins
   Lab Codes    Name                                    Region
      DR        Dominican Republic                      CaMAP
     INEN       Ecuador                                 CaMAP
      JBS       Jamaica Bureau of Standards             CaMAP
     SLBS       St Lucia Bureau of Standards            CaMAP
       AB       Abbott Laboratories                     MidMAP
      ANT       Antibus Scales and Systems              MidMAP
       CP       Consumer Power/Energy                   MidMAP
       EL       Eli Lilly                               MidMAP
      GRS       Grand Rapid Scale                       MidMAP
       3M       Minnesota Mining & Manufacturing        MidMAP
       NB       Northern Balance and Scales             MidMAP
     RLWS       Rice Lake Weighing Systems              MidMAP
     FGIS       USDA, Grain Inspection                  MidMAP
     WMD        NIST Weights & Measures Division        National
     EG&G       EG&G Mound                              NEMAP
      MC        Measurements Canada                     NEMAP
      MT        Mettler Toledo                          NEMAP
      NYC       New York City                           NEMAP
      OHA       Ohaus                                   NEMAP
      SER       Seraphin/Pemberton Industries           NEMAP
       TR       Troemner                                NEMAP
     WY-A       Wyeth Ayerst                            NEMAP
      DIT       Davis Inotek                            SEMAP
     Duke       Duke Energy, Duke Power                 SEMAP
      GAF       Georgia (State) Fuel Oil Lab            SEMAP
       HT       Hi-Tech                                 SEMAP
       LM       Lockheed Martin                         SEMAP
     ORMC       Oak Ridge Metrology Center              SEMAP
      PM        Phillip Morris                          SEMAP
     APSL       Redstone - Army Primary Stds Lab        SEMAP
     WSR        Westinghouse, Savannah River            SEMAP
      ALD       ACS Aldinger                            SWAP
       DI       Denver Instruments                      SWAP
     LANL       Los Alamos National Laboratory          SWAP
       TI       Texas Instruments                       SWAP
      HN        Huesser Neweigh                         WRAP




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls Lab & Date   6 of 12      7/22/2011
               Region:                                         SOP:                           Units
        Reporting Year:                              Accepted Value:                                       Tolerance:
         Round Robin:                         Unc of Accepted Value:
            Artifact ID:                                Description:

                                                                                            Bias from        E(n)             P(n)
   Date of Test        #        Lab ID          Reported Value          Uncertainty         Accepted       Pass < 1         Pass < 1
        ---              1        ---                                                           ---           ---              ---
        ---              2        ---                                                           ---           ---              ---
        ---              3        ---                                                           ---           ---              ---
        ---              4        ---                                                           ---           ---              ---
        ---              5        ---                                                           ---           ---              ---
        ---              6        ---                                                           ---           ---              ---
        ---              7        ---                                                           ---           ---              ---
        ---              8        ---                                                           ---           ---              ---
        ---              9        ---                                                           ---           ---              ---
        ---             10        ---                                                           ---           ---              ---
        ---             11        ---                                                           ---           ---              ---
        ---             12        ---                                                           ---           ---              ---
        ---             13        ---                                                           ---           ---              ---
        ---             14        ---                                                           ---           ---              ---
        ---             15        ---                                                           ---           ---              ---
        ---             16        ---                                                           ---           ---              ---
        ---             17        ---                                                           ---           ---              ---
        ---             18        ---                                                           ---           ---              ---
        ---             19        ---                                                           ---           ---              ---
        ---             20        ---                                                           ---           ---              ---

                             Initial Values
                                      Mean:         #DIV/0!             Do not change the initial values. Initial Values are used to
                                    Median:         #NUM!              assess the group distribution and evaluate initial choices for
                                                                       reference values.
                                       Max:                       0
                                       Min:                       0 E(n): Normalized Error; evaluates bias vs uncertainties.
                                     Range:                       0 P(n): Normalized Uncertainty; evaluates uncertainty vs
                             Std Deviation:         #DIV/0!         tolerance.


                        Adjusted Values
                                  Mean:             #DIV/0!         Do not include any values that FAIL E(n), P(n), or
                                Median:             #NUM!
                                                                    are outside 2 std dev from the initial median
                                   Max:                           0
                                    Min:                          0 value. Use for assessing and selecting a
                                 Range:                           0 reference value.
                           Std Deviation:           #DIV/0!

8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                           Data Entry     7 of 12                                               7/22/2011
    Accepted Reference Value:                                 Region, Parameter, Nominal, ID
    Accepted Reference Uncertainty:

           1


          0.9


          0.8


          0.7


          0.6
  Units




          0.5


          0.4


          0.3


          0.2


          0.1


           0
                ---   ---     ---    ---       ---    ---    ---      ---    ---       ---      ---    ---    ---   ---      ---     ---     ---     ---   ---   ---
                                                                                    Laboratory ID

                                           Reported Value                          Accepted Value:                        Accepted Value + 2 Adj SD
                                           Accepted Value -2 Adj SD                Accepted Value + 1/3 tol               Accepted value - 1/3 tol




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                                    Data Graph       8 of 12                                                             7/22/2011
                                                              Region, Parameter, Nominal,
                                                                       E(n), P(n)

                1.20




                1.00




                0.80
  Pass if < 1
  E(n), P(n)




                0.60




                0.40




                0.20




                0.00
                       ---   ---   ---     ---   ---   ---   ---   ---      ---      ---     ---     ---   ---     ---   ---   ---   ---   ---   ---   ---
                                                                                      Lab ID
                                                                            E(n)              P(n)         Limit




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                                 E(n)&P(n)         9 of 12                                                      7/22/2011
               Region:                                         SOP:                           Units
        Reporting Year:                              Accepted Value:                                       Tolerance:
         Round Robin:                         Unc of Accepted Value:
            Artifact ID:                                Description:

                                                                                          Bias from          E(n)             P(n)
   Date of Test        #        Lab ID          Reported Value          Uncertainty       Accepted         Pass < 1         Pass < 1
        ---              1        ---                                                         ---             ---              ---
        ---              2        ---                                                         ---             ---              ---
        ---              3        ---                                                         ---             ---              ---
        ---              4        ---                                                         ---             ---              ---
        ---              5        ---                                                         ---             ---              ---
        ---              6        ---                                                         ---             ---              ---
        ---              7        ---                                                         ---             ---              ---
        ---              8        ---                                                         ---             ---              ---
        ---              9        ---                                                         ---             ---              ---
        ---             10        ---                                                         ---             ---              ---
        ---             11        ---                                                         ---             ---              ---
        ---             12        ---                                                         ---             ---              ---
        ---             13        ---                                                         ---             ---              ---
        ---             14        ---                                                         ---             ---              ---
        ---             15        ---                                                         ---             ---              ---
        ---             16        ---                                                         ---             ---              ---
        ---             17        ---                                                         ---             ---              ---
        ---             18        ---                                                         ---             ---              ---
        ---             19        ---                                                         ---             ---              ---
        ---             20        ---                                                         ---             ---              ---

                             Initial Values
                                      Mean:         #DIV/0!             Do not change the initial values. Initial Values are used to
                                    Median:         #NUM!              assess the group distribution and evaluate initial choices for
                                                                       reference values.
                                       Max:                       0
                                       Min:                       0 E(n): Normalized Error; evaluates bias vs uncertainties.
                                     Range:                       0 P(n): Normalized Uncertainty; evaluates uncertainty vs
                             Std Deviation:         #DIV/0!         tolerance.


                        Adjusted Values
                                  Mean:             #DIV/0!         Do not include any values that FAIL E(n), P(n), or
                                Median:             #NUM!
                                                                    are outside 2 std dev from the initial median
                                   Max:                           0
                                    Min:                          0 value. Use for assessing and selecting a
                                 Range:                           0 reference value.
                           Std Deviation:           #DIV/0!

8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                         Data Entry (2)    10 of 12                                             7/22/2011
    Accepted Reference Value:                                 Region, Parameter, Nominal, ID
    Accepted Reference Uncertainty:

           1


          0.9


          0.8


          0.7


          0.6
  Units




          0.5


          0.4


          0.3


          0.2


          0.1


           0
                ---   ---     ---    ---       ---    ---    ---      ---      ---       ---    ---       ---   ---   ---      ---     ---     ---     ---   ---   ---
                                                                                      Laboratory ID

                                           Reported Value                            Accepted Value:                        Accepted Value + 2 Adj SD
                                           Accepted Value -2 Adj SD                  Accepted Value + 1/3 tol               Accepted value - 1/3 tol




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                                    Data Graph (2)     11 of 12                                                            7/22/2011
                                                              Region, Parameter, Nominal,
                                                                       E(n), P(n)

                1.20




                1.00




                0.80
  Pass if < 1
  E(n), P(n)




                0.60




                0.40




                0.20




                0.00
                       ---   ---   ---     ---   ---   ---   ---   ---   ---    ---    ---       ---   ---     ---   ---   ---   ---   ---   ---   ---
                                                                                   Lab ID
                                                                         E(n)           P(n)           Limit




8c9487b8-1f48-4e62-8c9c-6a698a9ac1df.xls                           E(n)&P(n) (2)      12 of 12                                                      7/22/2011

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:11
posted:7/22/2011
language:English
pages:12
Description: Round Template document sample