Docstoc

Penetration Testing

Document Sample
Penetration Testing Powered By Docstoc
					                                                           Essay 11


                             Penetration Testing
                                                        Clark Weissman



              7KH 7&% VKDOO EH IRXQG UHVLVWDQW WR SHQHWUDWLRQ

     ³ 'HSDUWPHQW RI 'HIHQVH ´7UXVWHG &RPSXWHU 6\VWHP (YDOXDWLRQ
     &ULWHULDµ 'R' 67' 'HFHPEHU  7KH 2UDQJH %RRN

      1HDU IODZOHVV SHQHWUDWLRQ WHVWLQJ LV D UHTXLUHPHQW IRU KLJKUDWHG
    VHFXUH V\VWHPV ³ WKRVH UDWHG DERYH % EDVHG RQ WKH 7UXVWHG
    &RPSXWHU 6\VWHP (YDOXDWLRQ &ULWHULD 7&6(& DQG LWV 7UXVWHG
    1HWZRUN DQG 'DWDEDVH ,QWHUSUHWDWLRQV 71, DQG 7', 8QOLNH VHFX
    ULW\ IXQFWLRQDO WHVWLQJ ZKLFK GHPRQVWUDWHV FRUUHFW EHKDYLRU RI WKH
    SURGXFW·V DGYHUWLVHG VHFXULW\ FRQWUROV SHQHWUDWLRQ WHVWLQJ LV D
    IRUP RI VWUHVV WHVWLQJ ZKLFK H[SRVHV ZHDNQHVVHV ³ WKDW LV IODZV
    ³ LQ WKH WUXVWHG FRPSXWLQJ EDVH 7&% 7KLV HVVD\ GHVFULEHV WKH
    )ODZ +\SRWKHVLV 0HWKRGRORJ\ )+0 WKH HDUOLHVW FRPSUHKHQVLYH
    DQG ZLGHO\ XVHG PHWKRG IRU FRQGXFWLQJ SHQHWUDWLRQV WHVWLQJ ,W
    UHYLHZV PRWLYDWLRQ IRU SHQHWUDWLRQ WHVWLQJ DQG SHQHWUDWLRQ WHVW
    SODQQLQJ ZKLFK HVWDEOLVKHV WKH JRDOV JURXQG UXOHV DQG UH
    VRXUFHV DYDLODEOH IRU WHVWLQJ 7KH 7&6(& GHILQHV ´IODZµ DV ´DQ HU
    URU RI FRPPLVVLRQ RPLVVLRQ RU RYHUVLJKW LQ D V\VWHP WKDW DOORZV
    SURWHFWLRQ PHFKDQLVPV WR EH E\SDVVHGµ 7KLV HVVD\ DPSOLILHV WKH
    GHILQLWLRQ RI D IODZ DV D GHPRQVWUDWHG XQVSHFLILHG FDSDELOLW\ WKDW
    FDQ EH H[SORLWHG WR YLRODWH VHFXULW\ SROLF\ 7KH HVVD\ SURYLGHV DQ
    RYHUYLHZ RI )+0 DQG LWV DQDORJ\ WR D KHXULVWLFEDVHG VWUDWHJ\
    JDPH
      7KH  PRVW SURGXFWLYH ZD\V WR JHQHUDWH K\SRWKHWLFDO IODZV DUH
    GHVFULEHG DV SDUW RI WKH PHWKRG DV DUH ZD\V WR FRQILUP WKHP $
    UHYLHZ RI WKH UHVXOWV DQG UHSUHVHQWDWLYH JHQHULF IODZV GLVFRYHUHG
    RYHU WKH SDVW  \HDUV LV SUHVHQWHG 7KH HVVD\ FRQFOXGHV ZLWK WKH
    DVVHVVPHQW WKDW )+0 LV DSSOLFDEOH WR WKH (XURSHDQ ,76(& DQG
    ZLWK VSHFXODWLRQV DERXW IXWXUH PHWKRGV RI SHQHWUDWLRQ DQDO\VLV
    XVLQJ IRUPDO PHWKRGV WKDW LV PDWKHPDWLFDOO\ VSHFLILHG GHVLJQ



3HQHWUDWLRQ 7HVWLQJ                                                       
   WKHRUHPV DQG SURRIV RI FRUUHFWQHVV RI WKH GHVLJQ 2QH SRVVLEOH
   GHYHORSPHQW FRXOG EH D ULJRURXV H[WHQVLRQ RI )+0 WR EH LQWH
   JUDWHG LQWR WKH GHYHORSPHQW SURFHVV 7KLV DSSURDFK KDV WKH SR
   WHQWLDO RI XQFRYHULQJ SUREOHPV HDUO\ LQ WKH GHVLJQ HQDEOLQJ
   LWHUDWLYH UHGHVLJQ

  $ VHFXULW\ WKUHDW H[LVWV ZKHQ WKHUH DUH WKH RSSRUWXQLW\ PRWLYDWLRQ
DQG WHFKQLFDO PHDQV WR DWWDFN WKH ZKHQ ZK\ DQG KRZ )+0 GHDOV RQO\
ZLWK WKH ´KRZµ GLPHQVLRQ RI WKUHDWV ,W LV D UHTXLUHPHQW IRU KLJKUDWHG
VHFXUH V\VWHPV IRU H[DPSOH 7&6(& UDWLQJV DERYH % WKDW SHQHWUDWLRQ
WHVWLQJ EH FRPSOHWHG ZLWKRXW GLVFRYHU\ RI VHFXULW\ IODZV LQ WKH HYDOXDWHG
SURGXFW DV SDUW RI D SURGXFW RU V\VWHP HYDOXDWLRQ >'2' 1&6&E
1&6&@ 8QOLNH VHFXULW\ IXQFWLRQDO WHVWLQJ ZKLFK GHPRQVWUDWHV FRUUHFW
EHKDYLRU RI WKH SURGXFW·V DGYHUWLVHG VHFXULW\ FRQWUROV SHQHWUDWLRQ WHVWLQJ
LV D IRUP RI VWUHVV WHVWLQJ ZKLFK H[SRVHV ZHDNQHVVHV RU IODZV LQ WKH
WUXVWHG FRPSXWLQJ EDVH 7&% ,W KDV EHHQ F\QLFDOO\ QRWHG WKDW VHFXULW\
IXQFWLRQDO WHVWLQJ GHPRQVWUDWHV WKH VHFXULW\ FRQWUROV IRU WKH ´JRRG JX\Vµ
ZKLOH SHQHWUDWLRQ WHVWLQJ GHPRQVWUDWHV WKH VHFXULW\ FRQWUROV IRU WKH ´EDG
JX\Vµ $OVR XQOLNH VHFXULW\ IXQFWLRQDO WHVWLQJ E\ WKH SURGXFW YHQGRU
SHQHWUDWLRQ WHVWLQJ LV WKH UHVSRQVLELOLW\ RI WKH SURGXFW HYDOXDWRUV +RZ
HYHU SURGXFW YHQGRUV ZRXOG EH LOO DGYLVHG WR LJQRUH WKHLU RZQ SHQHWUDWLRQ
WHVWLQJ DV SDUW RI WKH GHVLJQ WHVW DQG SUHSDUDWLRQ IRU D KLJKUDWHG VHFX
ULW\ SURGXFW HYDOXDWLRQ IRU VXFK YHQGRUV ZLOO VXUHO\ EH VXUSULVHG E\ XQ
DQWLFLSDWHG GHELOLWDWLQJ YXOQHUDELOLWLHV ORQJ DIWHU WKH GHYHORSPHQW SKDVH
ZKHQ UHSDLUV DUH LPSUDFWLFDO
  2I DOO WKH VHFXULW\ DVVXUDQFH PHWKRGV ³ LQFOXGLQJ OD\HUHG GHVLJQ
SURRI RI FRUUHFWQHVV DQG VRIWZDUH HQJLQHHULQJ HQYLURQPHQWV 6(( ³
RQO\ SHQHWUDWLRQ WHVWLQJ LV KROLVWLF LQ LWV IODZ DVVHVVPHQW ,W ILQGV IODZV LQ
DOO WKH 7&% HYLGHQFH SROLF\ VSHFLILFDWLRQ DUFKLWHFWXUH DVVXPSWLRQV
LQLWLDO FRQGLWLRQV LPSOHPHQWDWLRQ VRIWZDUH KDUGZDUH KXPDQ LQWHU
IDFHV FRQILJXUDWLRQ FRQWURO RSHUDWLRQ SURGXFW GLVWULEXWLRQ DQG GRFX
PHQWDWLRQ ,W LV D YDOXHG DVVXUDQFH DVVHVVPHQW WRRO
  7KLV HVVD\ LV LQ  SDUWV DQG GHVFULEHV D FRPSUHKHQVLYH PHWKRG IRU
FRQGXFWLQJ SHQHWUDWLRQ DQDO\VLV RI ZKLFK SHQHWUDWLRQ WHVWLQJ LV EXW RQH
DVSHFW 7KH SDUWV LQFOXGH EDFNJURXQG PRWLYDWLRQ WHVW SODQQLQJ WHVWLQJ
DQG WKH DQDO\VLV RI WKH WHVW UHVXOWV 7KH HVVD\ LV ODUJHO\ EDVHG RQ WKH
DXWKRU·V )ODZ +\SRWKHVLV 0HWKRGRORJ\ )+0 WKH HDUOLHVW DQG PRVW
ZLGHO\ XVHG DSSURDFK >:(,6@
  7KH ´%DFNJURXQGµ VHFWLRQ UHYLHZV WKH UHIHUHQFH PRQLWRU FRQFHSW RI
SROLF\ PHFKDQLVP DQG DVVXUDQFH WKDW IRUPV WKH EDVLV RI WKH 7&%
3HQHWUDWLRQ WHVWLQJ D SVHXGRHQHP\ DWWDFN LV RQH PHWKRG RI HYDOXDWLQJ
WKH VHFXULW\ VWUHQJWK RI WKH UHIHUHQFH PRQLWRU 7&% 7KH VHFWLRQ ´'HYHORS
D SHQHWUDWLRQ WHVW SODQµ HVWDEOLVKHV WKH JURXQG UXOHV OLPLWV DQG VFRSH RI
WKH WHVWLQJ 7KH WHVW WHDP LGHQWLILHV ZKDW LV WKH ´REMHFWµ EHLQJ WHVWHG DQG
ZKHQ WKH WHVWLQJ LV FRPSOHWH 7KH VHFWLRQ DGYDQFHV WKH LGHD WKDW WKH



                                                        ,QIRUPDWLRQ 6HFXULW\
WHVWV VHHN WR FRQILUP VHFXULW\ FODLPV RI WKH YHQGRU DQG WR VXSSRUW WKH
HYDOXDWLRQ FODVV UDWLQJ 7HVWLQJ LV QRW D FKDOOHQJH RU LQYLWDWLRQ WR WKH WHVW
WHDP WR ´FUDFNµ WKH V\VWHP DQG VWHDO VRPHWKLQJ RI YDOXH
  7KH VHFWLRQ ´)ODZ K\SRWKHVLV PHWKRGRORJ\ )+0 RYHUYLHZµ SURYLGHV D
WHFKQLFDO IRXQGDWLRQ IRU SHQHWUDWLRQ WHVWLQJ ,W HVWDEOLVKHV WKH LGHD WKDW D
VHFXULW\ IODZ LV DQ XQVSHFLILHG FDSDELOLW\ WKDW FDQ EH H[SORLWHG WR YLRODWH
VHFXULW\ SROLF\ ³ IRU H[DPSOH WR SHQHWUDWH WKH SURWHFWLRQ FRQWUROV
)LQGLQJ DQG DVVHVVLQJ IODZV LV D IRXUSKDVH SURFHVV RI IODZ JHQHUDWLRQ
IODZ FRQILUPDWLRQ IODZ JHQHUDOL]DWLRQ DQG IODZ HOLPLQDWLRQ 7KHVH
SKDVHV DUH FRYHUHG LQ VHSDUDWH VHFWLRQV 7KH VHFWLRQ ´)+0 H[SHULHQFHµ
SURYLGHV H[DPSOHV RI UHVXOWV RI DSSOLFDWLRQ RI WKH PHWKRG WR GR]HQV RI
V\VWHPV 6RPH FRVWV RI SHQHWUDWLRQ WHVWLQJ DUH DOVR GLVFXVVHG 7KH ILQDO
VHFWLRQ ´3HQHWUDWLRQ DQDO\VLV IRU WKH V DQG EH\RQGµ H[DPLQHV WKH
,76(& DQG ZKHUH )+0 FDQ EH DSSOLHG DQG ZRUN LQ IRUPDO PHWKRGV DQG
SURPLVLQJ IXWXUH DSSURDFKHV WR IODZ GHWHFWLRQ


%DFNJURXQG
  3HU WKH 7&6(& D 7&% LV WKH DPDOJDP RI KDUGZDUH VRIWZDUH IDFLOLWLHV
SURFHGXUHV DQG KXPDQ DFWLRQV WKDW FROOHFWLYHO\ SURYLGH WKH VHFXULW\ HQ
IRUFHPHQW PHFKDQLVP RI WKH UHIHUHQFH PRQLWRU >$1'(@ $ UHIHUHQFH
PRQLWRU PHGLDWHV HYHU\ DFFHVV WR VHQVLWLYH SURJUDPV DQG GDWD VHFXULW\
REMHFWV E\ XVHUV DQG WKHLU SURJUDPV VHFXULW\ VXEMHFWV ,W LV WKH VHFXULW\
SROLF\ PHFKDQLVP HTXLYDOHQW RI DEVWUDFW GDWDW\SH PDQDJHUV LQ VWURQJO\
W\SHG SURJUDPPLQJ ODQJXDJHV VXFK DV $OJRO 0RGXOD DQG $GD 7KH UHI
HUHQFH PRQLWRU VRIWZDUH LV SODFHG LQ LWV RZQ H[HFXWLRQ GRPDLQ WKH SULYL
OHJHG VXSHUYLVRU VWDWH RI WKH KDUGZDUH WR SURYLGH WDPSHU UHVLVWDQFH WR
XQWUXVWHG FRGH 7KH UHIHUHQFH PRQLWRU VRIWZDUH RIWHQ FDOOHG WKH VHFXULW\
NHUQHO LV VPDOO DQG VLPSOH HQRXJK LQ LWV DUFKLWHFWXUH WR HQDEOH LW WR EH
HYDOXDWHG IRU FRUUHFWQHVV ZLWK DVVXUDQFH WKDW RQO\ WKH DXWKRUL]HG VHFX
ULW\ SROLF\ LV HQIRUFHG DQG QHYHU E\SDVVHG 7KH VWUHQJWK RI WKLV WULDG RI
SROLF\ PHFKDQLVP DQG DVVXUDQFH RI WKH UHIHUHQFH PRQLWRU LV WKH EDVLV
IRU WKH HYDOXDWLRQ RI WKH 7&% 3HQHWUDWLRQ WHVWLQJ LV EXW RQH PHWKRG IRU
DVVHVVLQJ WKH VWUHQJWK RI D 7&%
  7UDGLWLRQDO PHWKRGV RI WHVWLQJ DQG UHSDLU DUH SRRU VWUDWHJLHV IRU VHFXU
LQJ 7&%V 6XFK VWUDWHJLHV OHDG WR JDPHV ELDVHG LQ IDYRU RI WKH KDFNHU
ZKR SRVVHVVHV PRGHUQ SRZHU WRROV WR DWWDFN DJLQJ FRPSXWHU V\VWHPV
7KH ´KDFNDQGSDWFKµ DSSURDFK WR DVVXUH VHFXUH V\VWHPV LV D ORVLQJ
PHWKRG EHFDXVH WKH KDFNHU QHHG ILQG RQO\ RQH IODZ ZKHUHDV WKH YHQGRU
PXVW ILQG DQG IL[ DOO WKH IODZV >6&+(@ )XUWKHUPRUH WKHUH DUH PDQ\
IODZ RSSRUWXQLWLHV ZLWK OLWWOH ULVN RI GHWHFWLRQ RU SXQLVKPHQW IRU WKH LQ
WHUORSHU 6R ZK\ ERWKHU ZLWK SHQHWUDWLRQ WHVWLQJ E\ )+0" %HFDXVH )+0
SHQHWUDWLRQ WHVWLQJ LV QRW KDFNDQGSDWFK EXW D FRPSUHKHQVLYH KROLVWLF
PHWKRG WR WHVW WKH FRPSOHWH LQWHJUDWHG RSHUDWLRQDO 7&% ³ KDUGZDUH
VRIWZDUH DQG SHRSOH ,W LV DQ HPSLULFDO GHVLJQ UHYLHZ DQG D FUHGLEOH



3HQHWUDWLRQ 7HVWLQJ                                                      
EULGJH EHWZHHQ DEVWUDFW GHVLJQ WKHRU\ DQG FRQFUHWH LPSOHPHQWDWLRQ DQG
RSHUDWLRQ SUDFWLFH ,W LV D SHHU UHYLHZ RI DOO WKH 7&% DVVXUDQFH HYLGHQFH
,W LV RQH RI PDQ\ PHWKRGV IRU VDWLVI\LQJ DVVXUDQFH UHTXLUHPHQWV ,W
ZRUNV ,W ILQGV IODZV %XW ZH PXVW QRW RYHUVWDWH LWV YDOXH 3HQHWUDWLRQ
WHVWLQJ FDQQRW SURYH RU HYHQ GHPRQVWUDWH WKDW D V\VWHP LV IODZOHVV ,W FDQ
SODFH D UHDVRQDEOH ERXQG RQ WKH NQRZOHGJH DQG ZRUN IDFWRU UHTXLUHG IRU
D SHQHWUDWRU WR VXFFHHG :LWK WKDW LQIRUPDWLRQ WRJHWKHU ZLWK FRXQWHU
PHDVXUHV ZH FDQ UHVWULFW WKH SHQHWUDWRU·V DFFHVV IUHHGRP EHORZ WKLV
ERXQG DQG WKHUHIRUH KDYH D GHJUHH RI DVVXUDQFH WR RSHUDWH WKH V\VWHP
VHFXUHO\ LQ D VSHFLILF WKUHDW HQYLURQPHQW >&6&@


'HYHORS D SHQHWUDWLRQ WHVW SODQ
  (VWDEOLVKLQJ WKH WHVW JURXQG UXOHV LV D SDUWLFXODUO\ LPSRUWDQW SDUW RI
SHQHWUDWLRQ DQDO\VLV 7KH UXOHV DUH FDSWXUHG LQ WKH SHQHWUDWLRQ WHVW SODQ
ZKLFK GHILQHV WKH WHVW REMHFWLYH WKH SURGXFW FRQILJXUDWLRQ WKH WHVW HQYL
URQPHQW WHVW UHVRXUFHV DQG VFKHGXOH ,W LV LPSRUWDQW WKDW SHQHWUDWLRQ
WHVWLQJ XVH HWKLFDO HYDOXDWRUV ZKR DUH QRQDQWDJRQLVWLF WRZDUG WKH YHQGRU
WR HQFRXUDJH FRRSHUDWLRQ WR SURWHFW SURSULHWDU\ LQIRUPDWLRQ DQG YHQGRU
LQYHVWPHQW DQG XOWLPDWHO\ WR \LHOG DQ LPSURYHG VHFXULW\ SURGXFW 7HVW
UHVXOWV DQG IODZV GLVFRYHUHG GXULQJ SHQHWUDWLRQ WHVWLQJ PXVW EH NHSW
VWULFWO\ SURSULHWDU\ DQG QRW EH PDGH SXEOLF E\ WKH WHVW WHDP

  (VWDEOLVK WHVWLQJ JRDO 7KHUH FDQ EH PDQ\ JRDOV IRU SHQHWUDWLRQ WHVW
LQJ LQFOXGLQJ VHFXULW\ DVVXUDQFH >'2'@ V\VWHP GHVLJQ UHVHDUFK
>.$5*@ DQG V\VWHPV WUDLQLQJ >+(%% :,/.@ )RU WKLV HVVD\
SHQHWUDWLRQ WHVWLQJ ZLOO IRFXV RQO\ RQ WKH JRDO RI JHQHUDWLQJ VXIILFLHQW HYL
GHQFH RI IODZOHVVQHVV WR KHOS REWDLQ SURGXFW FHUWLILFDWLRQ WR RSHUDWH DW D
% % RU $ VHFXULW\ DVVXUDQFH OHYHO
  7KH JURXQG UXOHV IRU WKH DQDO\VLV GHILQH VXFFHVVIXO FRPSOHWLRQ 7KH
DQDO\VLV LV VXFFHVVIXOO\ FRQFOXGHG ZKHQ

    D GHILQHG QXPEHU RI IODZV DUH IRXQG
    D VHW OHYHO RI SHQHWUDWLRQ WLPH KDV WUDQVSLUHG
    D GXPP\ WDUJHW REMHFW LV DFFHVVHG E\ XQDXWKRUL]HG PHDQV
    WKH VHFXULW\ SROLF\ LV YLRODWHG VXIILFLHQWO\ DQG E\SDVVHG RU
    WKH PRQH\ DQG UHVRXUFHV DUH H[KDXVWHG

  0RVW RIWHQ WKH ODVW FULWHULRQ HQGV WKH SHQHWUDWLRQ WHVW DIWHU D GHILQHG
OHYHO RI HIIRUW LV H[SHQGHG )RU VRPH V\VWHPV PXOWLSOH LQGHSHQGHQW
SHQHWUDWLRQ WHDPV DUH XVHG WR SURYLGH GLIIHUHQW SHUVSHFWLYHV DQG LQ
FUHDVHG FRQILGHQFH LQ WKH IODZOHVVQHVV RI WKH SURGXFW LI IHZ IODZV DUH
IRXQG $V D KROLVWLF DVVXUDQFH WHFKQRORJ\ SHQHWUDWLRQ WHVWLQJ LV EHVW
XVHG WR H[SORUH WKH EURDG FDSDELOLWLHV RI WKH REMHFW V\VWHP IRU IODZV
UDWKHU WKDQ WR FUHDWH D JDPLQJ VLWXDWLRQ EHWZHHQ WKH YHQGRU DQG WKH



                                                       ,QIRUPDWLRQ 6HFXULW\
SHQHWUDWLRQ WHDP RI WU\LQJ WR DFTXLUH DQ LGHQWLILHG SURWHFWHG REMHFW E\
XQDXWKRUL]HG PHDQV 'XPP\ WDUJHW DFTXLVLWLRQ SHQHWUDWLRQ JRDOV ZDVWH
HIIRUW E\ IRUFLQJ WKH WHVW WHDP WR SUHSDUH DQG GHEXJ D EUHDNLQ UDWKHU
WKDQ IRFXVLQJ WKHLU HQHUJ\ RQ SURYHQ PHWKRGV RI ILQGLQJ IODZV
   7KH UHIHUHQFH PRQLWRU GHILQHV D SHULPHWHUµ EHWZHHQ LWVHOI DQG XQ
WUXVWHG XVHU DSSOLFDWLRQ FRGH DQG EHWZHHQ GLIIHUHQW XVHU SURFHVVHV
)ODZV ZLWKLQ WKH DSSOLFDWLRQ FRGH KDYH QR LPSDFW RQ WKH 7&% DQG DUH RI
OLWWOH LQWHUHVW WR VHFXULW\ RU SHQHWUDWLRQ WHVWLQJ )ODZV LQWHUQDO WR WKH VH
FXULW\ NHUQHO DUH RI LQWHUHVW WR VHFXULW\ EXW WKH\ FDQQRW EH H[SORLWHG XQ
OHVV WKH VHFXULW\ SHULPHWHU LV EUHDFKHG ,Q LQWHUQDWLRQDO WUDYHO LW UHTXLUHV
SDVVSRUWV DQG YLVDV WR FRQWURO ERUGHU FURVVLQJV ,Q EDQNLQJ WXUQLQJ DF
FRXQW EDODQFHV LQWR FDVK LV D IRUP RI ERXQGDU\ FURVVLQJ FDOOHG ´FRQYHU
VLRQµ &RQWURO LV LPSRVHG DW WKH LQWHUIDFH 7KHUHIRUH PXFK RI SHQHWUDWLRQ
WHVWLQJ IRFXVHV RQ WKH GHVLJQ LPSOHPHQWDWLRQ DQG RSHUDWLRQDO LQWHJULW\
RI WKH VHFXULW\ SHULPHWHU WKH FRQWURO RI WKH ERXQGDU\ FURVVLQJV RI WKLV
FULWLFDO VHFXULW\ LQWHUIDFH

   'HILQH WKH REMHFW V\VWHP WR EH WHVWHG )+0 FDQ EH DSSOLHG WR PRVW
DQ\ V\VWHP ZKRVH GHYHORSHUV DUH LQWHUHVWHG LQ 7&6(& HYDOXDWLRQ +RZ
HYHU & & RU % FDQGLGDWH V\VWHPV DUH LQWHQGHG IRU EHQLJQ HQYLURQ
PHQWV SURWHFWHG E\ SK\VLFDO SHUVRQQHO SURFHGXUDO DQG IDFLOLW\ VHFXULW\
6\VWHPV LQ WKHVH EHQLJQ HYDOXDWLRQ FODVVHV DUH QRW GHVLJQHG WR UHVLVW
KRVWLOH DWWDFN DQG SHQHWUDWLRQ 6XFK DWWDFNV DUH DOZD\V OLNHO\ WR XQFRYHU
IODZV 7KH 7&6(& ZLVHO\ GRHV QRW UHTXLUH SHQHWUDWLRQ DQDO\VLV IRU WKHVH
V\VWHPV )'0 LV PRVW YDOXDEOH IRU WHVWLQJ VHFXULW\ UHVLVWDQFH WR DWWDFN RI
FDQGLGDWH V\VWHPV IRU HYDOXDWLRQ FODVVHV % % RU $ V\VWHPV GHVLJQHG
WR RSHUDWH LQ KRVWLOH HQYLURQPHQWV
   $ V\VWHP LQWHQGHG IRU 7&6(& HYDOXDWLRQ DW % RU KLJKHU LV GHOLYHUHG
ZLWK D FROOHFWLRQ RI PDWHULDO DQG GRFXPHQWDWLRQ WKDW VXSSRUWV WKH VHFX
ULW\ FODLP LQFOXGLQJ D VHFXULW\ SROLF\ PRGHO D GHVFULSWLYH WRS OHYHO VSHFL
ILFDWLRQ '7/6 D IRUPDO WRS OHYHO VSHFLILFDWLRQ )7/6 IRU $ HYDOXDWLRQV
FRGH FRUUHVSRQGHQFH PDWULFHV WR WKH '7/6 RU )7/6 DQG VHFXULW\ IXQF
WLRQDO WHVW UHVXOWV $OO WKH VRXUFH DQG REMHFW FRGH WKH GHVLJQ DQG WHVW
GRFXPHQWDWLRQ DQG WKH VHFXULW\ HYLGHQFH PXVW EH XQGHU FRQILJXUDWLRQ
PDQDJHPHQW FRQWURO IRU % % RU $ HYDOXDWLRQ FODVVHV 7KLV FRQWUROOHG
FROOHFWLRQ RI VHFXULW\ PDWHULDO ZLOO EH UHIHUUHG WR DV WKH VHFXULW\ ´HYL
GHQFHµ DQG GHILQHV WKH VHFXULW\ V\VWHP WR EH SHQHWUDWLRQ WHVWHG 1RW DOO
WKH HYLGHQFH ZLOO EH FRPSOHWH LI WKH SHQHWUDWLRQ WHVWLQJ LV SHUIRUPHG E\
WKH YHQGRU GXULQJ WKH GHYHORSPHQW SKDVH 7KH HYLGHQFH PXVW EH IUR]HQ
DQG UHPDLQ XQPRGLILHG GXULQJ WKH SHQHWUDWLRQ WHVWLQJ SHULRG WR DYRLG
WHVWLQJ D PRYLQJ WDUJHW
   ([SHULHQFH KDV VKRZQ WKDW SURELQJ IRU VHFXULW\ IODZV PD\ UHTXLUH V\V
WHP KDOWV DQG GXPSV E\ WKH SHQHWUDWLRQ WHDP :KHQ WHVWV VXFFHHG WKH\
\LHOG XQSUHGLFWDEOH UHVXOWV ³ IRU H[DPSOH XQFRQWUROOHG ILOH PRGLILFDWLRQ
RU GHOHWLRQ RU V\VWHP FUDVK ³ ZKLFK GLVUXSW QRUPDO RSHUDWLRQ 7KHUH



3HQHWUDWLRQ 7HVWLQJ                                                      
IRUH SHQHWUDWLRQ WHVWLQJ VKRXOG EH SHUIRUPHG LQ D FRQWUROOHG ODERUDWRU\
HQYLURQPHQW RQ D VWDQGDORQH FRS\ RI WKH WDUJHW V\VWHP WR DVVXUH QRQ
LQWHUIHUHQFH ZLWK UHDO XVHUV RI WKH V\VWHP
  :KHQ WKH REMHFW V\VWHP LV D QHWZRUN WKH 7&% LV GLVWULEXWHG LQ YDULRXV
FRPSRQHQWV WKH ZKROH FROOHFWLRQ RI ZKLFK LV FDOOHG WKH QHWZRUN 7&%
17&% $V QRWHG LQ WKH 71, SHQHWUDWLRQ WHVWLQJ PXVW EH DSSOLHG WR

    WKH FRPSRQHQWV RI WKH 17&% WKDW LV WKH SDUWLWLRQV RI WKH 17&%
      DQG
    WKH ZKROH LQWHJUDWHG QHWZRUN 17&% >1&6&D@

7KHUHIRUH WKH 71, 0DQGDWRU\ 0 $XGLW $ ,GHQWLILFDWLRQ    $XWKHQWLFD
WLRQ , DQG 'LVFUHWLRQDU\ ' 0$,' QHWZRUN FRPSRQHQWV PXVW EH
SHQHWUDWLRQ WHVWHG LQGLYLGXDOO\ DQG FROOHFWLYHO\ ³ LQGLYLGXDOO\ GXULQJ WKH
FRPSRQHQW HYDOXDWLRQ DQG FROOHFWLYHO\ GXULQJ WKH QHWZRUN HYDOXDWLRQ
  ,Q D VLPLODU PDQQHU D WUXVWHG DSSOLFDWLRQ IRU H[DPSOH D '%06 PXVW
EH SHQHWUDWLRQ WHVWHG LQGLYLGXDOO\ DV D FRPSRQHQW DQG FROOHFWLYHO\ ZLWK
WKH RSHUDWLQJ V\VWHP 7&% RQ ZKLFK LW GHSHQGV DFFRUGLQJ WR WKH ´HYDOXD
WLRQ E\ SDUWVµ FULWHULD RI WKH 7', >1&6&@

  3RVWXUH WKH SHQHWUDWRU :KHQ DQ DFWXDO WHVW LV UHTXLUHG WR FRQILUP D
IODZ D KRVW RI WHVW FRQGLWLRQV PXVW EH HVWDEOLVKHG ZKLFK GHULYH GLUHFWO\
IURP WKH WHVW REMHFWLYHV DQG WKH WHVW HQYLURQPHQW GHILQHG LQ WKH SODQ
7KHVH FRQGLWLRQV GHULYH IURP WKH VHFXULW\ WKUHDWV RI LQWHUHVW DQG WKH
SRVWXUH RI WKH ´VLPXODWHGµ DQWDJRQLVW DGRSWHG E\ WKH HYDOXDWRUV :LOO LW
EH DQ ´LQVLGH MREµ RU D ´EUHDNDQGHQWU\µ KDFNHU" 7KHVH DVVXPSWLRQV
GHPDQG GLIIHUHQW FRQGLWLRQV IRU WKH WHVW WHDP 7KH WHVW FRQGLWLRQV DUH GH
VFULEHG DV ´RSHQER[µ RU ´FORVHGER[µ WHVWLQJ FRUUHVSRQGLQJ WR ZKHWKHU
WKH WHVW WHDP FDQ SODFH DUELWUDU\ FRGH LQ WKH SURGXFW RSHQ ER[ RU QRW
FORVHG ER[ ,Q WKH ODWWHU FDVH WKH WHDP LV UHVWULFWHG WR H[WHUQDOO\ VWLPX
ODWHG IXQFWLRQDO WHVWLQJ 2SHQER[ SHQHWUDWLRQ WHVWLQJ LV DQDORJRXV WR
FRPSXWHU VRIWZDUH XQLW &68 WHVWLQJ ZKHUH LQWHUQDO FRGH LV DFFHVVLEOH
DQG FORVHGER[ SHQHWUDWLRQ WHVWLQJ LV DQDORJRXV WR FRPSXWHU VRIWZDUH
FRQILJXUDWLRQ LWHP &6&, LQWHJUDWLRQ WHVWLQJ ZKHUH FRGH PRGXOHV DUH DQ
LQWHJUDWHG FORVHG ZKROH 7KH 71, WHVWLQJ JXLGHOLQH FDOOV WKHVH ´ZKLWHER[µ
LQWHUQDO DQG ´EODFNER[µ IXQFWLRQDO WHVWLQJ UHVSHFWLYHO\ >1&6&E@
  ,Q RSHQER[ WHVWLQJ ZH DVVXPH WKH SHQHWUDWRU FDQ H[SORLW LQWHUQDO IODZV
ZLWKLQ WKH VHFXULW\ NHUQH DQG ZRUN EDFNZDUG WR ILQG IODZV LQ WKH VHFXULW\
SHULPHWHU WKDW PD\ DOORZ DFFHVV WR WKH LQWHUQDO IODZV ,Q WKH FDVH RI D
JHQHUDOSXUSRVH V\VWHP VXFK DV 8QL[ RSHQER[ WHVWLQJ LV WKH PRVW DS
SURSULDWH SRVWXUH )RU VSHFLDOSXUSRVH V\VWHPV VXFK DV QHWZRUN 17&%
FRPSRQHQWV ZKLFK SURKLELW XVHU FRGH IRU H[DPSOH ZKHUH FRGH LV LQ
520 FORVHGER[ SHQHWUDWLRQ WHVWLQJ E\ PHWKRGV H[WHUQDO WR WKH SURGXFW
LV DQDORJRXV WR HOHFWULFDO HQJLQHHULQJ ´EODFNER[µ WHVWLQJ ,Q FORVHGER[
WHVWLQJ WKH SHQHWUDWRU LV FOHDUO\ VHHNLQJ IODZV LQ WKH VHFXULW\ SHULPHWHU



                                                       ,QIRUPDWLRQ 6HFXULW\
DQG H[SORLWLQJ IODZV LQ WKH LQWHUIDFH FRQWURO GRFXPHQW VSHFLILFDWLRQV
,&' 2SHQER[ WHVWLQJ RI WKH 17&% LV VWLOO D WHVW UHTXLUHPHQW WR GHWHU
PLQH WKH YXOQHUDELOLW\ RI WKH QHWZRUN WR 7URMDQ KRUVH RU YLUDO DWWDFNV

  )L[ SHQHWUDWLRQ DQDO\VLV UHVRXUFHV ,W ZDV EHOLHYHG WKDW ILQGLQJ IODZV
LQ 26 965 ZRXOG EH GLIILFXOW >0&3+@ +RZHYHU DQRWKHU VWXG\
FODLPHG

    7KH DXWKRUV ZHUH DEOH XVLQJ WKH 6'& )+0 WR GLVFRYHU RYHU
    WZHQW\ VXFK ´H[SRVXUHVµ LQ OHVV WKDQ  PDQKRXUV DQG KDYH
    FRQWLQXHG WR JHQHUDWH ´H[SRVXUHVµ DW WKH UDWH RI RQH FRQILUPHG
    IODZ K\SRWKHVLV SHU KRXU SHU SHQHWUDWRU 2QO\ WKH OLPLWDWLRQV RI
    WLPH DYDLODEOH WR WKH VWXG\ JRYHUQHG WKH WRWDO QXPEHU RI IODZV
    SUHVHQWHG >*$/,@

  3HQHWUDWLRQ DQDO\VLV LV DQ RSHQHQGHG ODERULQWHQVLYH PHWKRGRORJ\
VHHNLQJ IODZV ZLWKRXW OLPLW 7KH WHVWLQJ PXVW EH ERXQG LQ VRPH PDQQHU
XVXDOO\ E\ OLPLWLQJ ODERU KRXUV 6PDOO WHDPV RI DERXW IRXU SHRSOH DUH
PRVW SURGXFWLYH ,QWHUHVWLQJO\ SHQHWUDWLRQ WHVWLQJ LV GHVWUXFWLYH WHVWLQJ
,W LV LQWHQVH GHWDLOHG ZRUN WKDW EXUQV RXW WHDP PHPEHUV LI IUHTXHQW UR
WDWLRQ RI WKH HYDOXDWRUV LV QRW SUDFWLFHG ([SHULHQFH VKRZV WKH SURGXF
WLYLW\ RI WKH WHVW WHDP IDOOV RII DIWHU DERXW VL[ PRQWKV 7KHUHIRUH D
SHQHWUDWLRQ WHVW E\ IRXU SHRSOH IRU QR PRUH WKDQ VL[ PRQWKV ³  SHU
VRQPRQWKV ³ LV RSWLPDO 7KH WHVW WHDP PXVW LQFOXGH SHRSOH NQRZOHGJH
DEOH LQ WKH WDUJHW V\VWHP ZLWK VHFXULW\ DQG SHQHWUDWLRQ WHVWLQJ H[SHUWLVH
0XFK WLPH LV VSHQW SHUXVLQJ WKH VHFXULW\ HYLGHQFH +RZHYHU WKHUH PXVW
EH OLEHUDO DFFHVV WR WKH WDUJHW V\VWHP WR SUHSDUH DQG UXQ OLYH WHVWV 7KH
WHDP QHHGV DFFHVV WR DOO WKH 7&% FUHDWLRQ WRROV ³ FRPSLOHUV HGLWRUV
FRQILJXUDWLRQ PDQDJHPHQW V\VWHP ZRUG SURFHVVRUV ³ DQG D GDWDEDVH
PDQDJHPHQW V\VWHP WR LQYHQWRU\ WKHLU GDWDEDVH RI SRWHQWLDO IODZV DQG WR
VWRUH WKHLU DVVHVVPHQWV RI WKH IODZV


)ODZ K\SRWKHVLV PHWKRGRORJ\ )+0 RYHUYLHZ
  &20386(&·V FRPSXWHU VHFXULW\·V UDLVRQ G·rWUH LV WR DXWRPDWH PDQ\
RI WKH VHFXULW\ IXQFWLRQV WUDGLWLRQDOO\ HQIRUFHG E\ IDOOLEOH KXPDQ RYHU
VLJKW ,Q WKHRU\ D WUXVWHG V\VWHP VKRXOG SHUIRUP DV LWV VHFXULW\ VSHFLIL
FDWLRQV GHILQH DQG GR QRWKLQJ PRUH ,Q SUDFWLFH PRVW V\VWHPV IDLO WR
SHUIRUP DV VSHFLILHG DQGRU GR PRUH WKDQ LV VSHFLILHG 3HQHWUDWLRQ DQDO\
VLV LV RQH PHWKRG RI GLVFRYHULQJ WKHVH GLVFUHSDQFLHV

  (YLGHQFH LPSOLFDWLRQ FKDLQ )RU KLJKUDWHG WUXVWHG V\VWHPV WKH WUXVW
HYLGHQFH PXVW VKRZ WKDW WKHRU\ DQG SUDFWLFH DJUHH ³ WKDW WKH ´HYLGHQFH
LPSOLFDWLRQ FKDLQµ LV FRUUHFWO\ VDWLVILHG DW HDFK VWHS 7KH LPSOLFDWLRQ
FKDLQ RI HYLGHQFH VKRZV



3HQHWUDWLRQ 7HVWLQJ                                                      
    WKH RSHUDWLRQ RI WKH WDUJHW V\VWHP LV FRPSOLDQW ZLWK KDUGZDUH DQG
      VRIWZDUH GHVLJQ DQG KXPDQ EHKDYLRU
    WKRVH HOHPHQWV FRPSO\ ZLWK WKH ´FRUUHFWµ VSHFLILFDWLRQV
    WKH VSHFLILFDWLRQV VDWLVI\ WKH VHFXULW\ SROLF\ H[FOXVLYHO\ DQG
    WKH SROLF\ PHHWV RSHUDWLRQDO UHTXLUHPHQWV

  7KH 7&6(& UHTXLUHV HYLGHQFH WKDW HDFK VWHS LQ WKH LPSOLFDWLRQ FKDLQ LV
FRUUHFWO\ VDWLVILHG E\ YDULRXV WHFKQLTXHV LQFOXGLQJ KXPDQ IDFLOLW\ PDQ
DJHPHQW DQG ORJLQ SURFHGXUHV DXGLW WUDLOV VHFXULW\ RIILFHU RYHUVLJKW
DXWRPDWLF PRQLWRULQJ DQG DODUPV FRGHWRVSHFLILFDWLRQ FRUUHVSRQGHQFHV
WHVW UHVXOWV SHHU UHYLHZ PDWKHPDWLFDO SURRI PRGHOWRUHDOLW\ FRUUHVSRQ
GHQFH DQG RWKHU PHWKRGV 3HQHWUDWLRQ DQDO\VLV LV D GLVFLSOLQHG PHWKRG
RI H[DPLQLQJ ZHDNQHVVHV RU IDLOXUHV LQ WKH LPSOLFDWLRQ FKDLQ
  (VVHQWLDOO\ WKH PHWKRG VHHNV FRXQWHUDUJXPHQWV WR WKH ´WUXWKµ DVVHUWHG
E\ WKH HYLGHQFH ³ WKDW LV LW VHHNV WR HVWDEOLVK WKH HYLGHQFH LV IDOVH RU
LQFRPSOHWH $ IODZ LV VXFK D FRXQWHUDUJXPHQW $ IODZ LV D GHPRQVWUDWHG
XQGRFXPHQWHG FDSDELOLW\ WKDW FDQ EH H[SORLWHG WR YLRODWH VRPH DVSHFW RI
WKH VHFXULW\ SROLF\
  7KH HPSKDVLV RI )+0 LV RQ ILQGLQJ WKHVH IODZV ,W LV QRW RQ EXLOGLQJ
GHPRQVWUDWLRQV RI WKHLU H[SORLWDWLRQ WKRXJK VXFK H[DPSOHV PD\ KDYH
PHULW LQ VRPH FDVHV ([SORLWDWLRQ GHPRQVWUDWLRQV FRQVXPH YDOXDEOH UH
VRXUFHV WKDW FDQ EHWWHU EH DSSOLHG WR IXUWKHU IODZ DVVHVVPHQW RI WKH LP
SOLFDWLRQ FKDLQ

  7KH LQGXFWLRQ K\SRWKHVLV $W WKH KHDUW RI WKH 7&6(& LV PDWKHPDWLFDO
LQGXFWLRQ VRPHWLPHV FDOOHG WKH LQGXFWLRQ K\SRWKHVLV ,W LV WKH WKHRUHWLFDO
EDVLV RI 7&6(& VHFXULW\ DQG DUJXHV WKDW

    LI WKH 7&% VWDUWV RSHUDWLRQ LQ D VHFXUH VWDWH DQG
    WKH 7&% FKDQJHV VWDWH E\ H[HFXWLRQ IURP D FORVHG VHW RI WUDQVIRUPV
      WKDW LV IXQFWLRQV DQG
    HDFK WUDQVIRUP SUHVHUYHV GHILQHG VHFXULW\ SURSHUWLHV
    WKHQ E\ PDWKHPDWLFDO LQGXFWLRQ DOO VWDWHV RI WKH 7&% DUH VHFXUH

  )LQGLQJ IODZV EHJLQV ZLWK ILQGLQJ ZHDNQHVVHV LQ LPSOHPHQWDWLRQ RI WKLV
SURWHFWLRQ WKHRU\ ³ SROLF\ PRGHO DUFKLWHFWXUH )7/6'7/6 FRGH DQG
RSHUDWLRQ 7KH HYLGHQFH LPSOLFDWLRQ FKDLQ RI WKH SUHYLRXV VHFWLRQ IRUPV
WKH EDVLV RI WKH IODZ VHDUFK IRU YLRODWLRQV RI WKH LQGXFWLRQ K\SRWKHVLV $V
H[DPSOHV IDOVH FOHDUDQFHV DQG SHUPLVVLRQV YRLG LQLWLDO FRQGLWLRQV UXOH
 ERJXV FRGH IRU H[DPSOH D 7URMDQ KRUVH RU YLUXV YLRODWHV WKH FORVHG
VHW UXOH  DQG D ODUJH FRYHUW FKDQQH GRHV QRW SUHVHUYH WKH LQIRUPDWLRQ
FRQWDLQPHQW VHFXULW\ SURSHUWLHV RI IXQFWLRQV UXOH 

  6WDJHV RI WKH )ODZ +\SRWKHVLV 0HWKRGRORJ\ )+0 )+0 FRQVLVWV RI
IRXU VWDJHV



                                                     ,QIRUPDWLRQ 6HFXULW\
     )ODZ JHQHUDWLRQ GHYHORSV DQ LQYHQWRU\ RI VXVSHFWHG IODZV
     )ODZ FRQILUPDWLRQ DVVHVVHV HDFK IODZ K\SRWKHVLV DV WUXH IDOVH RU
       XQWHVWHG
     )ODZ JHQHUDOL]DWLRQ DQDO\]HV WKH JHQHUDOLW\ RI WKH XQGHUO\LQJ VHFX
       ULW\ ZHDNQHVV UHSUHVHQWHG E\ HDFK FRQILUPHG IODZ
     )ODZ HOLPLQDWLRQ UHFRPPHQGV IODZ UHSDLU RU WKH XVH RI H[WHUQDO
       FRQWUROV WR PDQDJH ULVNV DVVRFLDWHG ZLWK UHVLGXDO IODZV
7KHVH VWDJHV DUH VKRZQ LQ )LJXUH 




                               Figure 1. FHM stages.

  )+0 FDQ EH OLNHQHG WR D FRPSXWHU VWUDWHJ\ JDPH ,Q DUWLILFLDO LQWHOOL
JHQFH $, JDPH VRIWZDUH WKHUH LV D ERG\ RI ORJLF WKDW JHQHUDWHV ´SODXVL
EOH PRYHVµ ZKLFK REH\ WKH OHJDO FRQVWUDLQWV RI WKH JDPH ³ IRU H[DPSOH LW
HQVXUHV D FKHVV SDZQ QHYHU PRYHV EDFNZDUG ,Q OLNH IDVKLRQ SHQHWUD
WLRQ WHVWLQJ QHHGV IRU IODZ JHQHUDWLRQ D ´SODXVLEOH IODZ JHQHUDWRUµ )ODZ
ILQGLQJ EHJLQV ZLWK WKH HYLGHQFH LPSOLFDWLRQ FKDLQ RXU H[SHULHQFH RI VH



3HQHWUDWLRQ 7HVWLQJ                                                   
FXULW\ IDLOXUHV LQ WKH UHDVRQLQJ FKDLQ LQ RWKHU V\VWHPV DQG WKHLU SRWHQ
WLDO IRU H[LVWHQFH LQ WKH WDUJHW V\VWHP 7KH VHFXULW\ HYLGHQFH IRU WKH WDUJHW
V\VWHP LV WKH SULQFLSDO VRXUFH IRU JHQHUDWLQJ QHZ IODZ K\SRWKHVHV
  &RQWLQXLQJ RXU $, JDPH DQDORJ\ WKHUH LV D ERG\ RI KHXULVWLF UXOHV WKH
JDPH XVHV WR GLVWLQJXLVK JRRG SODXVLEOH PRYHV IURP SRRU RQHV /LNHZLVH
LQ SHQHWUDWLRQ WHVWLQJ IODZ FRQILUPDWLRQ WKHUH LV KXPDQ MXGJPHQW ³ D
´FHUHEUDO ILOWHUµ ³ WKDW HYDOXDWHV DQG UDWHV HDFK SURVSHFWLYH IODZ LQ WHUPV
RI LWV H[LVWHQFH DQG KRZ VLJQLILFDQWO\ LW YLRODWHV WKH VHFXULW\ SROLF\ )LO
WHULQJ IODZV IRU FRQILUPDWLRQ LQYROYHV GHVN FKHFNLQJ RI FRGH VSHFLILFD
WLRQV DQG GRFXPHQWDWLRQ HYLGHQFH DV ZHOO DV OLYH WHVWLQJ
  7KH IODZ JHQHUDOL]DWLRQ VWDJH RI SHQHWUDWLRQ WHVWLQJ JLYHV DQ DVVHVVPHQW
RI RXU UHVXOWV LQ SURJUHVV WKH JDPH DQDORJ\ RI ´ZLQQLQJµ RU LPSURYLQJ
JDPH SRVLWLRQ )ODZ JHQHUDOL]DWLRQ DVVHVVHV FRQILUPHG IODZV VHHNLQJ
UHDVRQV ZK\ WKH\ H[LVW )RU H[DPSOH LQ WKH SHQHWUDWLRQ WHVWLQJ RI 26
96 >/,1'@ D VLPSOH FRGLQJ HUURU ZDV WUDFHG WR D OLEUDU\ PDFUR DQG
PXOWLSOH LQVWDQWLDWLRQV RI WKH IODZ LQ WKH FRGH ,QGXFWLYH UHDVRQLQJ RQ WKH
FDXVH RI FRQILUPHG IODZV FDQ OHDG WR QHZ IODZV JHQHUDWRUV IRU VWLOO PRUH
ZHDNQHVVHV
  7KH IODZ HOLPLQDWLRQ VWDJH FRQVLGHUV UHVXOWV RI WKH JHQHUDOL]DWLRQ VWDJH
DQG UHFRPPHQGV ZD\V WR UHSDLU IODZV ,PSOHPHQWDWLRQ IODZV DUH JHQHU
DOO\ HDVLHU WR UHSDLU WKDQ GHVLJQ IODZV 6RPH IODZV PD\ QRW EH SUDFWLFDO WR
UHSDLU VORZ FRYHUW WLPLQJ FKDQQHO IODZV PD\ EH WROHUDEOH IRU H[DPSOH
7KHVH IODZV UHPDLQ LQ WKH V\VWHP DV UHVLGXDO IODZV DQG SODFH WKH RSHUD
WLRQDO HQYLURQPHQW DW ULVN +RZHYHU H[WHUQDO FRXQWHUPHDVXUHV FDQ EH
UHFRPPHQGHG WR WKH DSSURYLQJ DXWKRULW\ IRU PDQDJLQJ WKHVH ULVNV E\
ORZHULQJ WKH 7&6(& 5LVN ,QGH[ >&6&@ IRU H[DPSOH


)ODZ JHQHUDWLRQ
  )ODZ JHQHUDWLRQ EHJLQV ZLWK D SHULRG RI VWXG\ RI WKH HYLGHQFH WR SURYLGH
D EDVLV IRU FRPPRQ XQGHUVWDQGLQJ RI WKH REMHFW V\VWHP (DUO\ LQ WKH HI
IRUW WKHUH LV DQ LQWHQVLYH ´DWWDFNWKHV\VWHPµ VHVVLRQ RI WHDP EUDLQ
VWRUPLQJ 7DUJHW V\VWHP H[SHUWLVH PXVW EH UHSUHVHQWHG LQ WKH DWWDFN
VHVVLRQV (DFK DVSHFW RI WKH V\VWHP GHVLJQ LV UHYLHZHG LQ VXIILFLHQW GHSWK
GXULQJ WKH VHVVLRQ IRU D UHDVRQDEOH PRGHO RI WKH V\VWHP DQG SURWHFWLRQ
PHFKDQLVPV WR EH XQGHUVWRRG DQG FKDOOHQJHG 7KH YHQGRU·V HYDOXDWLRQ
HYLGHQFH LV DYDLODEOH IRU LQGHSWK UHIHUHQFH E\ WKH WHDP )ODZV DUH K\
SRWKHVL]HG GXULQJ WKHVH UHYLHZV &ULWLFDO VHFXULW\ GHVLJQ FRQVLGHUDWLRQV
DUH WKH EDVLV IRU WKH SHQHWUDWLRQ WHDP·V SURELQJ RI WKH WDUJHW V\VWHP·V
GHIHQVHV 7KHVH GHVLJQ FRQVLGHUDWLRQV EHFRPH WKH ´SODXVLEOH PRYH JHQ
HUDWRUVµ RI WKH IODZ JHQHUDWLRQ SKDVH 7KH PRVW SURGXFWLYH ´WRS µ JHQ
HUDWRUV DUH WKH IROORZLQJ

    3DVW H[SHULHQFH ZLWK IODZV LQ RWKHU VLPLODU V\VWHPV
    $PELJXRXV XQFOHDU DUFKLWHFWXUH DQG GHVLJQ



                                                       ,QIRUPDWLRQ 6HFXULW\
      &LUFXPYHQWLRQE\SDVV RI ´RPQLVFLHQWµ VHFXULW\ FRQWUROV
      ,QFRPSOHWH GHVLJQ RI LQWHUIDFHV DQG LPSOLFLW VKDULQJ
      'HYLDWLRQV IURP WKH SURWHFWLRQ SROLF\ DQG PRGHO
      'HYLDWLRQV IURP LQLWLDO FRQGLWLRQV DQG DVVXPSWLRQV
      6\VWHP DQRPDOLHV DQG VSHFLDO SUHFDXWLRQV
      2SHUDWLRQDO SUDFWLFHV SURKLELWLRQV DQG VSRRIV
      'HYHORSPHQW HQYLURQPHQW SUDFWLFHV DQG SURKLELWLRQV
     ,PSOHPHQWDWLRQ HUURUV

  (DFK FDQGLGDWH IODZ LV GRFXPHQWHG RQ D IODZ K\SRWKHVLV VKHHW )+6
ZKLFK FRQWDLQV D GHVFULSWLRQ RI WKH IODZ VSHFXODWLRQ 7KH WRWDO VHW RI )+6
EHFRPHV WKH IODZ GDWDEDVH WKDW JXLGHV DQG GRFXPHQWV WKH SHQHWUDWLRQ
DQDO\VLV

  3DVW H[SHULHQFH 7KH OLWHUDWXUH LV ILOOHG ZLWK H[DPSOHV RI VXFFHVVIXO
SHQHWUDWLRQ DWWDFNV RQ FRPSXWHU V\VWHPV >$%%2 $77$ %(/$
%,6% %,6+ *$/, *$/, *$5) .$5* 0&3+ 3$5.
6'&@ 7KHUH LV DOVR D ERG\ RI SHQHWUDWLRQ H[SHULHQFH WKDW LV YHQGRU
SURSULHWDU\ RU FODVVLILHG >%8// /,1'D 3+,/ 6'&@ $OWKRXJK
JHQHUDO DFFHVV WR WKLV SDVW H[SHULHQFH LV RIWHQ UHVWULFWHG VXFK H[SHULHQFH
LV DPRQJ WKH EHVW VWDUWLQJ SRLQWV IRU IODZ JHQHUDWLRQ

  8QFOHDU GHVLJQ 7KH GHVLJQ PXVW FOHDUO\ GHILQH WKH VHFXULW\ SHULPHWHU
RI WKH 7&% +RZ DUH ERXQGDU\ FURVVLQJV PHGLDWHG" :KHUH DUH WKH VHFX
ULW\ DWWULEXWHV ³ SHUPLVVLRQV FODVVLILFDWLRQV ,'V ODEHOV NH\V DQG VR RQ
³ REWDLQHG VWRUHG SURWHFWHG DFFHVVHG DQG XSGDWHG" :KDW LV WKH GLYL
VLRQ RI ODERU DPRQJ KDUGZDUH VRIWZDUH DQG KXPDQ HOHPHQWV RI WKH
7&%" $QG KRZ DUH DOO WKH P\ULDG RWKHU VHFXUH GHVLJQ LVVXHV GHVFULEHG
>*$66@" ,I WKH VHFXUH GHVLJQ FDQQRW EH FOHDUO\ GHVFULEHG LW SUREDEO\
KDV KROHV 7KH WHDP ZLOO UDSLGO\ DUULYH DW FRQVHQVXV E\ WKHLU SURELQJ DQG
XQFRYHU QXPHURXV IODZV DQG DUHDV IRU LQGHSWK H[DPLQDWLRQ SDUWLFXODUO\
ZHDNQHVVHV LQ WKH HYLGHQFH LPSOLFDWLRQ FKDLQ

  &LUFXPYHQW FRQWURO :KDW FRPHV WR PLQG LV $WODV GRZQ RQ RQH NQHH
KROGLQJ XS WKH ZRUOG 7KH DQWKURSRPRUSKLF YLHZ RI 7&% GHVLJQ JLYHV WKH
QXPHURXV SURWHFWLRQ FRQWURO VWUXFWXUHV RPQLVFLHQFH LQ WKHLU FULWLFDO $W
ODQWHDQ UROH RI VXSSRUWLQJ WKH VHFXUH GHVLJQ ,I VXFK FRQWURO FDQ EH FLU
FXPYHQWHG WKH VHFXULW\ FDQ EH EUHDFKHG 7KH VHFXULW\ DUFKLWHFWXUH
HYLGHQFH PXVW VKRZ QRQFLUFXPYHQWLRQ RU E\SDVV RI VHFXULW\ FRQWUROV
7KH DWWDFN VHVVLRQV ZLOO UDSLGO\ LGHQWLI\ WKHVH RPQLVFLHQW REMHFWV EH WKH\
SDVVZRUG FKHFNHUV ODEHO FKHFNHUV ,2 GULYHUV RU PHPRU\ PDSV $
PHWKRG RI GHWHUPLQLQJ WKHLU YXOQHUDELOLW\ WR DWWDFN LV WR EXLOG D ´GHSHQG
HQF\ JUDSKµ RI VXERUGLQDWH FRQWURO REMHFWV RQ ZKLFK WKH RPQLVFLHQW RQHV
GHSHQG (DFK QRGH LQ WKH JUDSK LV H[DPLQHG WR XQGHUVWDQG LWV SURWHFWLRQ
VWUXFWXUH DQG YXOQHUDELOLW\ WR EHLQJ FLUFXPYHQWHG VSRRIHG GLVDEOHG OLHG



3HQHWUDWLRQ 7HVWLQJ                                                     
WR RU PRGLILHG ,I WKH VHFXULW\ GHVLJQ LV ZHDN RU IODZHG FRQWURO FDQ EH
E\SDVVHG 7KH SHQHWUDWLRQ WHVWLQJ RI 26 965 >6'&@ JLYHV D GHWDLOHG
H[DPSOH RI WKH XVH RI GHSHQGHQF\ JUDSKV WR GHWHUPLQH WKH YXOQHUDELOLW\
RI 96 WR XQDXWKRUL]HG DFFHVV WR MRE GDWD VHWV YLUWXDO PHPRU\ DQG
SDVVZRUG SURWHFWLRQ FRQWURO REMHFWV

  ,QFRPSOHWH LQWHUIDFH GHVLJQ ,QWHUIDFHV DUH ULIH ZLWK IODZ SRWHQWLDO
:KHUH WZR GLIIHUHQW HOHPHQWV RI WKH DUFKLWHFWXUH LQWHUIDFH WKHUH LV D SR
WHQWLDO IRU LQFRPSOHWH GHVLJQ 7KLV LV RIWHQ WKH FDVH EHFDXVH KXPDQ ZRUN
DVVLJQPHQWV VHOGRP JLYH DQ\RQH UHVSRQVLELOLW\ IRU GHVLJQLQJ WKH LQWHU
IDFH $OWKRXJK PRGHUQ PHWKRGRORJLHV IRU V\VWHP GHVLJQ VWUHVV LQWHUIDFH
FRQWURO GRFXPHQWV ,&' WKHVH WHQG WR EH IRU LQWHUIDFHV DPRQJ OLNH HOH
PHQWV ³ IRU H[DPSOH KDUGZDUHKDUGZDUH LQWHUIDFHV DQG VRIWZDUH
VRIWZDUH SURWRFROV 7KH GLVFLSOLQH IRU VSHFLI\LQJ LQWHUIDFHV DPRQJ XQOLNH
HOHPHQWV LV OHVV ZHOO HVWDEOLVKHG +DUGZDUHVRIWZDUH VRIWZDUHKXPDQ
KXPDQKDUGZDUH       KDUGZDUHSHULSKHUDO      DQG    RSHUDWLQJ   V\VWHP
DSSOLFDWLRQ LQWHUIDFHV FDQ KDYH LQFRPSOHWH FDVH DQDO\VHV )RU H[DPSOH
WKH XVHURSHUDWRU LQWHUIDFH WR WKH 7&% PXVW GHDO ZLWK DOO WKH FRPELQD
WLRQV RI KXPDQ FRPPDQGV DQG GDWD YDOXHV WR DYRLG RSHUDWRU VSRRILQJ E\
DQ XQDXWKRUL]HG XVHU UHTXHVW 2SHUDWLQJ SURFHGXUHV PD\ EH KDUGZDUH
FRQILJXUDWLRQ GHSHQGHQW )RU H[DPSOH ERRWLQJ WKH V\VWHP IURP WKH VWDQ
GDUG GULYH PD\ FKDQJH LI WKH FRQILJXUDWLRQ RI WKH VWDQGDUG GULYH LV
FKDQJHG $OO WKH YDULRXV HUURU VWDWHV RI WKHVH LQWHUIDFHV PD\ QRW KDYH
EHHQ FRQVLGHUHG
  ,PSOLFLW VKDULQJ LV QRZ D FODVVLFDO VRXUFH RI LQFRPSOHWH GHVLJQ IODZV
6KDULQJ IODZV XVXDOO\ PDQLIHVW WKHPVHOYHV DV IODZV LQ VKDUHG PHPRU\ RU
VKDUHG YDULDEOHV EHWZHHQ WKH 7&% DQG WKH XVHU SURFHVVHV GXULQJ SD
UDPHWHU SDVVLQJ VWDWH YDULDEOHV FRQWH[W VWRUDJH VHWWLQJ VWDWXV YDULDEOHV
UHDGLQJ DQG ZULWLQJ VHPDSKRUHV DFFHVVLQJ EXIIHUV FRQWUROOLQJ SHULSKHUDO
GHYLFHV DQG JOREDO V\VWHP GDWD DFFHVV ³ IRU H[DPSOH FORFN GDWH DQG
SXEOLF DQQRXQFHPHQWV &DUHIXO GHVLJQ RI WKHVH LQWHUIDFHV LV UHTXLUHG WR
UHPRYH V\VWHP GDWD IURP XVHU PHPRU\

  3ROLF\ DQG PRGHO GHYLDWLRQV )RU % DQG KLJKHU HYDOXDWLRQ FODVVHV
WKH VHFXULW\ HYLGHQFH LQFOXGHV D IRUPDO VHFXULW\ SROLF\ DQG D PRGHO RI
KRZ WKH WDUJHW V\VWHP PHHWV WKH SROLF\ 6XEMHFWV DQG REMHFWV DUH GHILQHG
7KH UXOHV RI DFFHVV DUH VSHFLILHG )RU ORZHU HYDOXDWLRQ FODVVHV WKH SROLF\
DQG PRGHO DUH OHVV ZHOO VWDWHG DQG LQ WKH HDUO\ \HDUV RI SHQHWUDWLRQ
WHVWLQJ UHTXLUHG WKH SHQHWUDWLRQ WHDP WR FRQVWUXFW RU GHILQH WKH SROLF\
DQG PRGHO GXULQJ WKH DWWDFN VHVVLRQV +RZHYHU SHQHWUDWLRQ WHVWLQJ LV
QRW UHTXLUHG IRU WKHVH FODVVHV WRGD\
  &RQVLGHU WKH DGHTXDF\ RI WKH SROLF\ DQG WKH PRGHO IRU WKH WDUJHW V\V
WHP ,V WKH PRGHO FRPSOHWH" ,V WKH SROLF\ FRUUHFW" $UH WKHUH SROLFLHV IRU
PDQGDWRU\ DQG GLVFUHWLRQDU\ DFFHVV FRQWURO 0$& DQG '$& LGHQWLILFD
WLRQ DQG DXWKHQWLFDWLRQ , $ DXGLW WUXVWHG SDWK DQG FRPPXQLFDWLRQV



                                                     ,QIRUPDWLRQ 6HFXULW\
VHFXULW\" ([DPLQH WKH VHFXULW\ DUFKLWHFWXUH DQG WKH 7&% GHVLJQ WR VHH LI
WKHUH DUH GHYLDWLRQV IURP WKH VWDWHG SROLF\ RU PRGHO )RU H[DPSOH DUH
WKHUH XVHUYLVLEOH REMHFWV WKDW DUH QRW GHILQHG LQ WKH PRGHO VXFK DV EXII
HUV DQG TXHXHV" 2PQLVFLHQW FRQWURO REMHFWV DV GHVFULEHG LQ WKH HDUOLHU
VHFWLRQ ´&LUFXPYHQW FRQWUROµ VKRXOG FHUWDLQO\ EH UHSUHVHQWHG $UH WKHUH
GHYLDWLRQV LQ WKH LPSOHPHQWDWLRQ RI WKH SROLF\ DQG PRGHO" 7KLV FRQVLG
HUDWLRQ UHFHLYHV JUHDWHU HPSKDVLV GXULQJ IODZ FRQILUPDWLRQ KRZHYHU
WKHUH PD\ EH UHDVRQV WR JHQHUDWH LPSOHPHQWDWLRQ IODZV DW WKLV WLPH

  ,QLWLDO FRQGLWLRQV $VVXPSWLRQV DERXQG LQ VHFXUH V\VWHP GHVLJQ EXW
DUH QRW GRFXPHQWHG ZHOO H[FHSW LQ HYDOXDWLRQ FODVV $ ZKHUH IRUPDO
VSHFLILFDWLRQV UHTXLUH HQWU\ DQG H[LW DVVHUWLRQV WR FRQGLWLRQ WKH VWDWH
PDFKLQH WUDQVIRUPV )RU DOO RWKHU HYDOXDWLRQ FODVVHV WKH DVVXPSWLRQV
DQG LQLWLDO FRQGLWLRQV DUH RIWHQ EXULHG LQ WKLFN GHVLJQ GRFXPHQWDWLRQ LI
WKH\ DUH GRFXPHQWHG DW DOO ,I WKHVH DVVXPSWLRQV FDQ EH PDGH LQYDOLG E\
WKH XVHU RU LI LQ WKH LPSOHPHQWDWLRQ UHDOLW\ WKH LQLWLDO FRQGLWLRQV DUH GLI
IHUHQW IURP WKH GHVLJQ DVVXPSWLRQV WKH SROLF\ DQG PRGHO PD\ EH LQYDOLG
DQG GHVLJQ IODZV VKRXOG H[LVW 7KH LQGXFWLRQ K\SRWKHVLV SUHVHQWHG HDUOLHU
EHJLQV ZLWK ´VWDUWV RSHUDWLRQ LQ D VHFXUH VWDWHµ ,QLWLDO FRQGLWLRQV GHWHU
PLQH WKH VWDUWLQJ VHFXUH VWDWH ,I WKH DFWXDO LQLWLDO FRQGLWLRQV DUH RWKHU
WKDQ DV DVVXPHG LQ WKH GHVLJQ DWWDFNV ZLOO VXFFHHG
  7KH ZKROH UDQJH RI VHFXULW\ SURILOHV DQG DGPLQLVWUDWLYH VHFXULW\ GDWD RQ
XVHU ,'V FOHDUDQFHV SDVVZRUGV DQG SHUPLVVLRQV 0$& DQG '$& GH
ILQHV WKH ´FXUUHQW DFFHVVµ DQG ´DFFHVV PDWUL[µ RI WKH %HOO/D3DGXOD SROLF\
PRGHO >%(//@ 7KHVH GDWD DUH LQLWLDO FRQGLWLRQV 7KHLU FRUUHFW LQLWLDOL
]DWLRQ LV D WHVWDEOH K\SRWKHVLV 2WKHU DVVXPSWLRQV DQG LQLWLDO FRQGLWLRQV
QHHG WR EH HVWDEOLVKHG DQG WHVWHG E\ SHQHWUDWLRQ DQDO\VLV LQFOXGLQJ WKH
FRPSXWHU KDUGZDUH FRQILJXUDWLRQ VRIWZDUH FRQILJXUDWLRQ IDFLOLW\ RSHU
DWLQJ PRGH SHULRGV SURFHVVLQJ FRPSDUWPHQWHG V\VWHP KLJK 0/6 RS
HUDWRU UROHV XVHU , $ SDUDPHWHUV VXEMHFWREMHFW VHQVLWLYLW\ ODEHOV
V\VWHP VHFXULW\ UDQJH '$& SHUPLVVLRQV DXGLW IRUPDWV V\VWHP UHDGLQHVV
VWDWXV DQG PRUH

  6\VWHP DQRPDOLHV (YHU\ V\VWHP LV GLIIHUHQW 'LIIHUHQFHV WKDW PD\
KDYH VHFXULW\ UDPLILFDWLRQV DUH RI SDUWLFXODU LQWHUHVW 7KH ,%0 3URJUDP
6WDWXV :RUG 36: LPSOHPHQWV VWDWXV FRGHV IRU WHVWLQJ E\ FRQGLWLRQDO
LQVWUXFWLRQV XQOLNH WKH 8QLYDF  ZKLFK KDV GLUHFW FRQGLWLRQDO
EUDQFKLQJ LQVWUXFWLRQV 7KH ,%0 DSSURDFK DOORZV FRQGLWLRQDO LQVWUXF
WLRQV WR EHKDYH DV QRQFRQGLWLRQDO LQVWUXFWLRQV LI WKH SURJUDPPHU DYRLGV
FKHFNLQJ WKH 36: >6'&@ 7KDW LV DQ DQRPDO\ 7KH %XUURXJKV %
 FRPSXWHU VHULHV FRPSLOHU VRIWZDUH KDV SULYLOHJH WR VHW KDUGZDUH WDJ
ELWV WKDW GHILQH ´FDSDELOLWLHVµ PDQ\ RI ZKLFK DUH VHFXULW\ VHQVLWLYH VXFK
DV ZULWH SHUPLVVLRQ 7KH 0DVWHU &RQWURO 3URJUDP 0&3 FKHFNV WKH WDJ
ELW IRU SHUPLVVLRQ YDOLGLW\ 8VHU FRGH GRHV QRW KDYH WKLV SULYLOHJH &RGH
LPSRUWV FDQ FLUFXPYHQW VXFK FKHFNV >:,/.@ 7KDW LV DQ DQRPDO\ 7KH



3HQHWUDWLRQ 7HVWLQJ                                                      
,%0  ,2 FKDQQHO SURJUDPV DUH XVHU SURJUDPV WKDW FDQ DFFHVV UHDO
PHPRU\ YLD WKH ´9LUWXDO      5HDOµ FRPPDQG ZLWKRXW D KDUGZDUH PHPRU\
SURWHFW IDXOW >%(/$@ 7KDW·V DQ DQRPDO\ 1HDUO\ HYHU\ VRIWZDUH SURGXFW
KDV FOHDUO\ VWDWHG OLPLWV DQG SURKLELWLRQV RQ XVH RI LWV IHDWXUHV EXW IHZ
GHILQH ZKDW RFFXUV LI D SURKLELWLRQ LV LJQRUHG :KDW KDSSHQV ZKHQ DQ
LGHQWLILHU JUHDWHU WKDQ HLJKW FKDUDFWHUV LV XVHG" ,V WKH LGHQWLILHU WUXQ
FDWHG IURP WKH OHIW ULJKW RU PLGGOH RU LV LW MXVW LJQRUHG" $QRPDORXV EH
KDYLRU PD\ QRW EH VHFXULW\SUHVHUYLQJ IXQFWLRQDOLW\ SHU WKH LQGXFWLRQ
K\SRWKHVLV WKHRU\ 7KLV EHKDYLRU FDQ EH H[SORLWHG

  2SHUDWLRQDO SUDFWLFHV 7KH FRPSOHWH V\VWHP FRPHV WRJHWKHU GXULQJ
RSHUDWLRQ ZKHQ PDQ\ IODZV UHYHDO WKHPVHOYHV 2I SDUWLFXODU LQWHUHVW DUH
WKH PDQPDFKLQH UHODWLRQVKLS WKH FRQILJXUDWLRQ DVVXPSWLRQV DQG HUURU
UHFRYHU\ $ ZHOOGHVLJQHG 7&% ZLOO KDYH WKH V\VWHP ERRW SURFHVV SURJUHVV
LQ VWDJHV RI LQFUHDVLQJ RSHUDWLQJ V\VWHP FDSDELOLW\ (DFK VWDJH ZLOO FKHFN
LWVHOI WR HQVXUH LW EHJLQV DQG HQGV LQ D VHFXUH VWDWH ,I WKHUH LV QHHG IRU
KXPDQ LQWHUYHQWLRQ WR ORDG VHFXULW\ SDUDPHWHUV WKH KXPDQ PXVW EH
LGHQWLILHG DXWKHQWLFDWHG DQG DXWKRUL]HG IRU NQRZQ DFWLRQV 7KH SHQH
WUDWRU PXVW VHH LI WKH ERRW SURFHVV SURJUHVVHV FRUUHFWO\ )RU H[DPSOH
KRZ LV WKH VHFXULW\ RIILFHUDGPLQLVWUDWRU DXWKHQWLFDWHG" ,I YLD SDVVZRUGV
KRZ GLG WKH\ JHW ORDGHG RU EXLOW LQWR WKH LQLWLDO ERRW ORDG" :KHUH GRHV WKH
RSHUDWRU REWDLQ WKH PDVWHU ERRW ORDG" )URP D WDSH RU GLVN OLEUDU\" ,V WKH
SK\VLFDO PHGLD SURWHFWHG IURP XQDXWKRUL]HG DFFHVV SURGXFW VXEVWLWX
WLRQ RU ODEHO VZLWFKLQJ" ,I WKH VHFXULW\ RIILFHU ORDGV RU HQWHUV RQOLQH
SHUPLVVLRQV WR LQLWLDOL]H WKH VHFXULW\ SDUDPHWHUV RI WKH V\VWHP KRZ GRHV
WKH VHFXULW\ RIILFHU DXWKHQWLFDWH WKH GDWD" ,I XVHUV VHQG RSHUDWRU UHTXHVWV
WR PRXQW WDSHV RU GLVNV SULQW ILOHV RU H[HFXWH D P\ULDG RI RWKHU VHFXULW\
VHQVLWLYH DFWLRQV KRZ GRHV WKH 7&% SURWHFW WKH RSHUDWRU IURP VSRRIV WR
WDNH XQDXWKRUL]HG DFWLRQ" ,I WKH V\VWHP FUDVKHV GRHV WKH V\VWHP UHERRW
IROORZ D SURFHVV VLPLODU WR WKH LQLWLDO ´FROGµ ERRW" ,I WKHUH LV D ´ZDUPµ ERRW
PRGH ³ D VKRUWFXW ERRW WKDW VDOYDJHV SDUW RI WKH V\VWHP VWDWH ³ GRHV
WKH VHFXULW\ RIILFHU KDYH D UROH LQ WKH ERRW WR HQVXUH WKH V\VWHP EHJLQV LQ
D VHFXUH VWDWH" +RZ LV WKH DVVXUDQFH GHWHUPLQHG"
  $ FRPPRQ LQLWLDOL]DWLRQ IODZ RFFXUV ZKHQ WKH V\VWHP LV VKLSSHG IURP
WKH YHQGRU ZLWK WKH ´WUDLQLQJ ZKHHOVµ VWLOO RQ >672/@ 7KLV FODVV RI IODZ
KDV EHHQ NQRZQ WR LQFOXGH WUDLQLQJ ILOHV WKDW SURYLGH ,'SDVVZRUG
DXWKRUL]DWLRQV WR XVHUV VR WKH\ PD\ WUDLQ IRU MREV DV VHFXULW\ RIILFHUV
V\VWHP DGPLQLVWUDWRUV GDWDEDVH FRQWUROOHUV DQG V\VWHP RSHUDWRUV
7KHVH ILOHV ZHUH QRW UHPRYHG E\ JRRG V\VWHP RSHUDWLRQDO SUDFWLFH SHU WKH
7UXVWHG )DFLOLW\ 0DQXDO 7)0 DQG FDQ EH XVHG E\ XQDXWKRUL]HG SDUWLHV
WR FLUFXPYHQW VHFXULW\ FRQWUROV

  7KH GHYHORSPHQW HQYLURQPHQW )ODZV PD\ EH LQWURGXFHG E\ EDG
SUDFWLFHV LQ WKH VHFXULW\ NHUQHO7&% GHYHORSPHQW HQYLURQPHQW $ VLPSOH
H[DPSOH LV WKH FRQGLWLRQDO FRPSLODWLRQ ZKLFK JHQHUDWHV VSHFLDO FRGH IRU



                                                        ,QIRUPDWLRQ 6HFXULW\
GHEXJJLQJ ,I WKH UHOHDVHG FRGH LV QRW UHFRPSLOHG WR UHPRYH WKH GHEXJJLQJ
´KRRNVµ WKH RSHUDWLRQDO V\VWHP FRGH YLRODWHV WKH FORVHG VHW UXOH  DQG
WKH VHFXUH WUDQVIRUP UXOH  RI WKH LQGXFWLRQ K\SRWKHVLV VLPLODU WR D
WUDSGRRU E\SDVV RI VHFXULW\ FRQWUROV
   /DUJH XQWUXVWHG UHXVH DQG UXQWLPH OLEUDULHV DUH SURSHUWLHV RI PDQ\
SURJUDPPLQJ HQYLURQPHQWV 7KH 7&% PD\ EH EXLOW XVLQJ FRGH IURP WKH
OLEUDU\ ZKLFK ILQGV LWV ZD\ LQWR RSHUDWLRQDO XVH $OO NLQGV RI VHFXULW\
IODZV PD\ REWDLQ IURP VXFK HQYLURQPHQWV ,I WKH OLEUDULHV DUH QRW VHFX
ULW\ VHQVLWLYH WKH\ FDQ EH VHDUFKHG IRU IODZV WKDW DUH H[SORLWDEOH LQ WKH
RSHUDWLRQDO 7&% ,I WKH SHQHWUDWLRQ WHDP FDQ VXEVWLWXWH LWV RZQ FRGH LQ
WKH OLEUDULHV HYHQ PRUH VRSKLVWLFDWHG IODZV FDQ EH FUHDWHG 5XQWLPH
OLQNHUV DQG ORDGHUV KDYH VLPLODU SURSHUWLHV RI DSSHQGLQJ XQHYDOXDWHG
FRGH WR WKH WUXVWHG REMHFW FRGH EHLQJ ORDGHG WR HQDEOH FRGHRSHUDWLQJ
V\VWHP FRPPXQLFDWLRQ ,I DFFHVV WR VXFK WRROV LV XQSURWHFWHG VLPLODU
FRGHVXEVWLWXWLRQ DWWDFNV DUH SRVVLEOH
   $ FODVVLF ZD\ WR DWWDFN DQ RSHUDWLRQDO V\VWHP LV WR DWWDFN LWV GHYHORS
PHQW HQYLURQPHQW SODQW ERJXV FRGH LQ WKH VRXUFH ILOHV DQG ZDLW IRU WKH
QRUPDO VRIWZDUH XSGDWH PDLQWHQDQFH SURFHGXUHV WR LQVWDOO \RXU XQDX
WKRUL]HG FRGH LQWR WKH RSHUDWLRQDO V\VWHP REMHFW FRGH ,I WKH GHYHORSPHQW
DQG RSHUDWLRQDO V\VWHP DUH WKH VDPH WKHQ WKH SHQHWUDWLRQ WHDP PXVW
PRXQW DQ DWWDFN RQ WKH GHYHORSPHQW HQYLURQPHQW ILUVW SDUWLFXODUO\ WKH
V\VWHP FRQILJXUDWLRQ ILOHV )ODZV IRXQG WKHUH UHODWH GLUHFWO\ WR WKH RSHUD
WLRQDO V\VWHP WKH VRXUFH ILOHV RI ZKLFK DUH WKHQ DFFHVVLEOH DQG PRGLIL
DEOH E\ WKH SHQHWUDWRU ZLWKRXW DXWKRUL]DWLRQ 6XEVWLWXWH FRQILJXUDWLRQ
ILOHV JLYH WKH SHQHWUDWRU D KLJKSUREDELOLW\ DWWDFN DQG HVVHQWLDO FRQWURO RI
WKH 7&%

  ,PSOHPHQWDWLRQ HUURUV ,Q DQ\ V\VWHP EXLOW E\ KXPDQV WKHUH ZLOO EH
HUURUV RI RPLVVLRQ DQG FRPPLVVLRQ 7KLV LV QRW D SURPLVLQJ FODVV RI IODZV
WR H[SORUH DV WKHUH LV QR ORJLF WR WKHP 0DQ\ DUH MXVW W\SRV ,PSOHPHQ
WDWLRQ HUURUV WKDW FDQ EH DQDO\]HG DUH WKRVH RI WKH ,)7+(1(/6( FRQGL
WLRQDO IRUP 2IWHQ D SURJUDPPHU IDLOV WR GHVLJQ RU LPSOHPHQW DOO WKH
FRQGLWLRQDO FDVHV ,QFRPSOHWH FDVH DQDO\VLV PD\ RFFXU LI WKH FRGH ORJLF
DVVXPHV VRPH RI WKH SUHGLFDWHV DUH SHUIRUPHG HDUOLHU 0RVW RIWHQ LP
SOHPHQWDWLRQ IODZV DUH MXVW FRGLQJ HUURUV
  2WKHU DUHDV IRU LQYHVWLJDWLRQ DUH PDFURV DQG RWKHU FRGH JHQHUDWRUV ,I
WKH RULJLQDO PDFUR LV FRGHG LQFRUUHFWO\ WKH HUURU FRGH ZLOO EH SURSDJDWHG
LQ PDQ\ GLIIHUHQW SDUWV RI WKH V\VWHP 6LPLODUO\ LI GDWD GHFODUDWLRQV DUH
LQFRUUHFW WKH\ ZLOO DIIHFW GLIIHUHQW SDUWV RI WKH FRGH ,QFRUUHFW FRGH VH
TXHQFHV VKRXOG EH WUDFHG EDFN WR DXWRPDWLF VRXUFH FRGH JHQHUDWRUV WR
VHH LI WKH FRGH HUURU DSSHDUV LQ PXOWLSOH SDUWV RI WKH 7&%
  6RPHWLPHV WKHUH DUH HUURUV LQ WKH GHYHORSPHQW WRROV WKDW JHQHUDWH EDG
FRGH )HZ FRQILJXUDWLRQ PDQDJHPHQW WRROV SURYLGH D WUXVWHG FRGH SHGL
JUHH RU KLVWRU\ RI DOO WKH HGLWRU FRPSLOHU DQG OLQNHU WRROV WKDW WRXFK WKH
FRGH 7KHUHIRUH DQ HUURU LQ WKHVH WRROV ZKLFK EHFRPHV NQRZQ ODWH LQ WKH



3HQHWUDWLRQ 7HVWLQJ                                                     
GHYHORSPHQW F\FOH DQG LV IL[HG PD\ SHUVLVW LQ VRPH HDUOLHU JHQHUDWHG
PRGXOHV WKDW DUH QRW UHJHQHUDWHG 7KH SHQHWUDWLRQ WHDP PD\ ILQG LW
IUXLWIXO WR LQWHUYLHZ WKH GHYHORSPHQW WHDP IRU VXFK FDVHV

  )ODZ K\SRWKHVLV VKHHWV )+0 FDQGLGDWH IODZV DUH GRFXPHQWHG RQ IODZ
K\SRWKHVLV VKHHWV )+6 RQH SDJH UHFRUG SHU IODZ $Q )+6 LV LQWHQGHG
WR EH FRQFLVH DQG HDV\ WR XVH WKURXJKRXW WKH SHQHWUDWLRQ WHVWLQJ 7KH
)+6 FRQWDLQV VHYHQ ILHOGV

    D IODZ QDPH IRU LGHQWLILFDWLRQ
    D EULHI GHVFULSWLRQ RI WKH IODZ YXOQHUDELOLW\ VSHFXODWLRQ
    D ORFDOL]DWLRQ UHIHUHQFH RI WKH IODZ WR D SDUW RI WKH V\VWHP RU PRG
      XOH
    DQ DVVHVVPHQW RI WKH SUREDELOLW\ RI WKH IODZ EHLQJ FRQILUPHG
    DQ HVWLPDWH RI WKH GDPDJH LPSDFW RI WKH IODZ RQ WKH SURWHFWLRQ RI
      WKH V\VWHP LI FRQILUPHG
    DQ HVWLPDWH RI WKH HIIRUWZRUN IDFWRU QHHGHG WR FRQILUP D IODZ DQG
    D GHVFULSWLRQ RI WKH DWWDFN DQG UHVXOW

   3UREDELOLWLHV IRU ILHOGV   DQG  DUH PHDVXUHG RQ D VFDOH RI KLJK +
PHGLXP 0 RU ORZ / 7KH FRPELQHG DVVHVVPHQW RI ++ +0 +/ 0+
 // \LHOGV DQ RYHUDOO VFDOH RI QLQH IRU UDQNLQJ )+6 7KH UDQNLQJ LV
YDOXDEOH LQ DOORFDWLQJ UHVRXUFHV GXULQJ WKH IODZ FRQILUPDWLRQ SKDVH RI
SHQHWUDWLRQ DQDO\VLV 7KH )+6 GRFXPHQWV DQ HVWLPDWH RI WKH ZRUN UH
TXLUHG WR GHPRQVWUDWH D IODZ +LJK ZRUNIDFWRU IODZV ³ IRU H[DPSOH
FUDFNLQJ HQFU\SWLRQ FRGHV ³ DUH JLYHQ ORZHU SULRULW\ HYHQ LI WKH IODZ LV
UDQNHG ++ $Q )+6 KDV D VHFWLRQ IRU GHVFULELQJ WKH UHVXOWV REWDLQHG
IURP WKH IODZ FRQILUPDWLRQ SKDVH 7KH WRWDO VHW RI )+6 EHFRPHV WKH IODZ
GDWDEDVH WKDW JXLGHV DQG GRFXPHQWV WKH SHQHWUDWLRQ DQDO\VLV 7KH )+6
FDQ EH PHFKDQL]HG ZLWK WRRO VXSSRUW ³ IRU H[DPSOH D ZRUG SURFHVVRU RU
D '%06 ³ WR SHUPLW IOH[LEOH VRUWV DQG VHDUFKHV EDVHG RQ NH\ ILHOGV RI DQ
)+6 GDWDEDVH RI KXQGUHGV RI UHFRUGV


)ODZ FRQILUPDWLRQ
  &RQGXFWLQJ WKH DFWXDO SHQHWUDWLRQ WHVW LV SDUW RI WKH WHVWLQJ SURFHGXUH
GHYHORSHG LQ WKH SODQ 7KH EXON RI WKH WHVWLQJ VKRXOG EH E\ ´*HGDQNHQµ
H[SHULPHQWV WKRXJKW H[SHULPHQWV WKDW FRQILUP K\SRWKHVL]HG IODZV LQ
WKH SURGXFW E\ H[DPLQDWLRQ RI WKH SURGXFW·V GRFXPHQWDWLRQ DQG FRGH
WKDW LV WKH VHFXULW\ HYLGHQFH 7KHUH DUH WKUHH VWHSV WR WKH IODZ FRQILUPD
WLRQ VWDJH IODZ SULRULWL]DWLRQ DQG DVVLJQPHQW GHVN FKHFNLQJ DQG OLYH
WHVWLQJ

  )ODZ SULRULWL]DWLRQ DQG DVVLJQPHQW 7KH IODZ K\SRWKHVLV VKHHWV UHS
UHVHQW D FRPSUHKHQVLYH LQYHQWRU\ RI SRWHQWLDO IODZV 6RUWHG E\ WKH SURE



                                                      ,QIRUPDWLRQ 6HFXULW\
DELOLW\ RI H[LVWHQFH SD\RII GDPDJH LPSDFW LI FRQILUPHG ZRUN IDFWRU WR
FRQILUP DQG DUHD RI WKH V\VWHP GHVLJQ WKH\ SURYLGH D UDQNLQJ RI SRWHQ
WLDO IODZV IRU HDFK GHVLJQ DUHD IURP KLJK SUREDELOLW\KLJK SD\RII ++ WR
ORZ SUREDELOLW\ORZ SD\RII // 8VXDOO\ RQO\ KLJK DQG PHGLXP UDQNV DUH
VWXGLHG 7HDP PHPEHUV GLYLGH WKH UDQN OLVWV DPRQJ WKHPVHOYHV EDVHG RQ
H[SHUWLVH LQ WKH GLIIHUHQW V\VWHP GHVLJQ DUHDV 7KH\ PRYH RXW DV LQGL
YLGXDOV RQ WKHLU OLVWV $W GDLO\ WHDP PHHWLQJV WKH\ VKDUH RQH DQRWKHU·V
SURJUHVV DQG ILQGLQJV 0DQDJHPHQW PD\ UHDOORFDWH VWDII DQG )+6 WR EDO
DQFH WKH ZRUN ORDG 2IWHQ FRQILUPHG IODZV UDLVH WKH SULRULW\ RI RWKHU )+6
RU SURYLGH WKH DQDO\VWV ZLWK LQVLJKW WR JHQHUDWH QHZ )+6

  'HVN FKHFNLQJ 7KH SHQHWUDWRU DQDO\VW VWXGLHV WKH )+6 DQG WKH 7&%
HYLGHQFH &RGH PRGHOV FRGH FRUUHVSRQGHQFH PDSV RU GHSHQGHQF\
JUDSKV DUH H[DPLQHG WR VHH LI WKH IODZ H[LVWV 7KH DQDO\VW PXVW EH IOH[LEOH
LQ FRQVLGHULQJ DOWHUQDWLYHV EXW FRQFHQWUDWH RQ ZKDW H[LVWV LQ WKH DFWXDO
FRGH DQG RWKHU HYLGHQFH $QDO\VWV XVH FRGH ZDONWKURXJKV SULRU WHVW UH
VXOWV WKHLU RZQ LQVLJKWV DQG FRQYHUVDWLRQV ZLWK RWKHU WHDP PHPEHUV WR
UHDFK FRQFOXVLRQV DERXW WKH OLNHOLKRRG RI WKH IODZ·V H[LVWHQFH
  5HVXOWV DUH GRFXPHQWHG RQ WKH )+6 &RQILUPHG IODZV DUH IODJJHG LQ WKH
GDWDEDVH IRU ODWHU H[DPLQDWLRQ $Q DQDO\VW VSHQGV D IHZ GD\V DW PRVW
RQ HDFK IODZ 7KH GHVN FKHFNLQJ FRQWLQXHV IRU ZHHNV DQG SRVVLEO\ D IHZ
PRQWKV \LHOGLQJ DQ )+6 SURGXFWLYLW\ UDWH RI  WR  )+6 SHU SHUVRQ
PRQWK 7KH ZRUN LV WHGLRXV DQG GHWDLOHG DQG UHTXLUHV GHVWUXFWLYH
WKLQNLQJ 2FFDVLRQDOO\ DQ )+6 LV RI VXIILFLHQW FRPSOH[LW\ DQG LQWHUHVW WR
ZDUUDQW D OLYH WHVW EXW WKH LQYHVWPHQW LQ WKH WHVWLQJ SURFHVV ZLOO ORZHU
SURGXFWLYLW\

   /LYH WHVWLQJ 7HVW FDVH GHVLJQ FRGLQJ DQG H[HFXWLRQ DUH H[SHQVLYH VR
OLYH WHVWLQJ LV QRW WKH SUHIHUUHG )+6 HYDOXDWLRQ PHWKRG +RZHYHU WHVWLQJ
LV RIWHQ WKH IDVWHVW ZD\ WR FRQILUP FRPSOH[ RU WLPHGHSHQGHQW IODZV ,Q
SHQHWUDWLRQ WHVWLQJ OLYH WHVWV DUH VLPLODU WR FRPSXWHU VRIWZDUH FRQILJXUD
WLRQ LWHP &6&, IXQFWLRQDO WHVWV ZLWK WKH )+6 DFWLQJ DV WKH
GLVIXQFWLRQDO VSHFLILFDWLRQ IRU WKH WHVW 7KHUH LV OLWWOH XQLTXH DERXW WKHVH
WHVWV H[FHSW WKH\ PD\ EH GHVWUXFWLYH RI WKH V\VWHP $YRLG UXQQLQJ WKHP
RQ WKH RSHUDWLRQDO V\VWHP VLQFH WKH\ FDQ KDYH XQSUHGLFWDEOH UHVXOWV
$OVR WKH WHVWLQJ LV WR FRQILUP WKH IODZ QRW WR H[SORLW LW 7HVW FRGH VKRXOG
EH D QDUURZO\ IRFXVHG E\ WKH )+6 TXLFN RQHVKRW URXWLQH 7KLV ZLOO EH
HDVLHU WR ZULWH LI WKHUH LV D ULFK OLEUDU\ RI GHEXJ DQG GLDJQRVWLF URXWLQHV


)ODZ JHQHUDOL]DWLRQ
  :KHQ WKH WHDP DVVHPEOHV IRU WKH GDLO\ PHHWLQJ WKH FRQILUPHG IODZV RI
WKH GD\ DUH EULHIHG DQG H[DPLQHG (DFK WHDP PHPEHU FRQVLGHUV WKH SRV
VLELOLW\ WKDW WKH IODZ PLJKW H[LVW LQ KLV DUHD DQG ZKHWKHU WKH WHVW WHFK
QLTXH DQG FRGH FDQ EH XVHG RQ KLV )+6 2IWHQ D FRQILUPHG IODZ KDV RQO\



3HQHWUDWLRQ 7HVWLQJ                                                       
PHGLXP SD\RII YDOXH EXW FDQ EH XVHG ZLWK RWKHU FRQILUPHG IODZV WR \LHOG
D KLJK SD\RII 7KLV VWULQJLQJ RI IODZV WRJHWKHU LV FDOOHG ´EHDGLQJµ DQG KDV
OHG WR PDQ\ XQXVXDO KLJKSD\RII SHQHWUDWLRQV
  'HGXFWLYH WKLQNLQJ FRQILUPV D IODZ ,QGXFWLYH WKLQNLQJ WDNHV D VSHFLILF
IODZ WR D PRUH JHQHUDO FODVV RI IODZV 7KH WHDP H[DPLQHV WKH EDVLF WHFK
QRORJ\ XSRQ ZKLFK HDFK FRQILUPHG IODZ LV EDVHG WR VHH LI WKH IODZ LV D
PHPEHU RI D ODUJHU FODVV RI IODZV %\ WKLV JHQHUDOL]DWLRQ RI WKH IODZ RQH
PD\ ILQG RWKHU LQVWDQFHV RI WKH ZHDNQHVV RU JDLQ QHZ LQVLJKW RQ FRXQ
WHUPHDVXUHV ,QGXFWLYH WKLQNLQJ SURFHHGV VLPXOWDQHRXVO\ ZLWK GHGXFWLYH
WKLQNLQJ RI QHZ LQVWDQFHV RI WKH IODZ VR WKDW WKH IODZ EHFRPHV D QHZ
IODZ K\SRWKHVLV JHQHUDWRU 6RPH FODVVLF IODZV ZHUH GLVFRYHUHG E\ WKLV
LQGXFWLRQ ³ IRU H[DPSOH SDUDPHWHU SDVVLQJ E\ UHIHUHQFH >/,1'
6'&@ SLHFHZLVH GHFRPSRVLWLRQ RI SDVVZRUGV >7$1(@ SXQV LQ ,2
FKDQQHO SURJUDPV >$77$ 3+,/@ DQG WLPHRIFKHFNWRWLPHRIXVH
72&7728 ZLQGRZV >/,1'@ 7KHVH DUH GHVFULEHG LQ WKH XSFRPLQJ VHF
WLRQ ´)+0 H[SHULHQFHµ


)ODZ HOLPLQDWLRQ
   ([SHUWV KDYH DUJXHG WKH IXWLOLW\ RI SHQHWUDWHDQGSDWFK DQG KDFNDQG
SDWFK PHWKRGV RI LPSURYLQJ WKH WUXVW RI D 7&% IRU VXEVWDQWLDO UHDVRQV
WKDW UHGXFH WR WKH WUDGLWLRQDO SRVLWLRQ WKDW \RX PXVW GHVLJQ VHFXULW\
TXDOLW\ SHUIRUPDQFH DQG VR RQ LQWR WKH V\VWHP DQG QRW DGG LW RQ
>6&+(@ +RZHYHU PRVW KXPDQ SURJUHVV LV PDGH LQ LQFUHPHQWDO IRU
ZDUG VWHSV 3URGXFWV LPSURYH ZLWK QHZ UHOHDVHV DQG QHZ YHUVLRQV WKDW
IL[ IODZV E\ SDWFKLQJ ZRUNDURXQGV DQG UHGHVLJQ
   7KH 7&6(& UHTXLUHV WKDW DOO NQRZQ IODZV EH UHSDLUHG 7KH HYDOXDWRUV
FDQ VXJJHVW WR WKH YHQGRU UHSDLU RI VLPSOH LPSOHPHQWDWLRQ DQG FRGLQJ
HUURUV RU UHFRPPHQG NQRZQ JHQHULF GHVLJQ IODZ FRXQWHUPHDVXUHV $IWHU
UHSDLU WKH V\VWHP PXVW EH UHHYDOXDWHG WR FRQILUP WKH IODZV ZHUH IL[HG
DQG WR HQVXUH QR QHZ IODZV ZHUH LQWURGXFHG 5HHYDOXDWLRQ LV D FRPSOHWH
UHSHWLWLRQ RI WKH SHQHWUDWLRQ WHVWLQJ SURFHVV +RZHYHU DSSOLFDWLRQ RI WKH
5DWLQJV DQG 0DLQWHQDQFH 3URFHVV 5$03 >1&6&D@ WR % DQG EHWWHU
HYDOXDWLRQV PD\ EH D SRVVLEOH PHWKRG WR DYRLG WRWDO UHSHWLWLRQ 7KLV
VSHFXODWLRQ KDV EHHQ WULHG RQ WKH % HYDOXDWLRQ RI WUXVWHG ;HQL[ SRUWHG
WR QHZ KDUGZDUH SODWIRUPV >0&$8@ ,W LV LPSUDFWLFDO IRU WKH YHQGRU WR
IL[ VRPH IODZV 7KHVH UHVLGXDO IODZV ZLOO UHVXOW LQ D ORZHU FODVV UDWLQJ
+RZHYHU WKH XVLQJ DJHQF\ FDQ SUHSDUH D ULVN DQDO\VLV WKDW VKRZV WKH
'$$ 'HVLJQDWHG $SSURYLQJ $XWKRULW\ DOWHUQDWLYH VHFXULW\ PHDVXUHV WR
FRXQWHU WKH UHVLGXDO IODZV


)+0 H[SHULHQFH
  )+0 KDV EHHQ D FRVWHIIHFWLYH PHWKRG RI VHFXULW\ V\VWHP DVVXUDQFH DV
VHVVPHQW IRU RYHU WZHQW\ \HDUV 8QOLNH RWKHU DVVXUDQFH PHWKRGV ZKLFK



                                                     ,QIRUPDWLRQ 6HFXULW\
IRFXV RQ QDUURZHU REMHFWLYHV IRU H[DPSOH IRUPDO FRUUHFWQHVV SURRIV RI
GHVLJQ RU ULVN DVVHVVPHQW FRVWV RI IDLOXUHV )+0 VHHNV VHFXULW\ IODZV LQ
WKH RYHUDOO RSHUDWLRQ RI D V\VWHP GXH WR SROLF\ VSHFLILFDWLRQ GHVLJQ LP
SOHPHQWDWLRQ DQGRU RSHUDWLRQDO HUURUV ,W LV D FRPSOHWH V\VWHPV DQDO\
VLV PHWKRG WKDW XQFRYHUV IODZV LQWURGXFHG LQWR WKH V\VWHP DW DQ\ VWDJH
RI WKH SURGXFW OLIH F\FOH

  )+0 PDQDJHPHQW H[SHULHQFH 0DQDJHPHQW PRGHOV DQG ZRUN EUHDN
GRZQ VWUXFWXUHV :%6 RI WDVNV VFKHGXOHV DQG ODERU ORDGLQJV WR SHUIRUP
W\SLFDO SHQHWUDWLRQ WHVWLQJ DUH DYDLODEOH LQ WKH OLWHUDWXUH >58%
:(,6D@ )RU ZHDN V\VWHPV LQ WKH 7&6(& & WR % FODVVHV H[SHULHQFH
SUHGLFWV D W\SLFDO SHQHWUDWLRQ WHDP RI IRXU SHRSOH RSHUDWLQJ IRU VL[
PRQWKV ZLOO JHQHUDWH DERXW  )+6 DQG DVVHVV DERXW  RI WKH KLJK
HVW SULRULW\ 6RPH  WR  RI WKHVH ZLOO EH FRQILUPHG IODZV 7KDW \LHOGV
D SURGXFWLYLW\ UDWH RI RQH IODZ IRU HYHU\ RQH WR WZR SHUVRQZHHNV RI HIIRUW
6WURQJHU V\VWHPV LQ WKH 7&6(& % WR $ FODVVHV E\ GHILQLWLRQ PXVW EH
IODZOHVV +RZHYHU HYHQ WKHVH V\VWHPV KDYH IODZV ³ IDU IHZHU RI FRXUVH
EHFDXVH RI WKH JUHDWHU DWWHQWLRQ WR VHFXUH V\VWHP GHYHORSPHQW 6XFK
IODZV DUH UHSDLUHG DXGLWHG RU FRQVLGHUHG DQ DFFHSWDEOH ULVN +LJKHU IODZ
UDWHV PD\ VLJQDO D OHVVHU HYDOXDWLRQ FODVV WKDQ % LV ZDUUDQWHG IRU WKH
WDUJHW V\VWHP

  9XOQHUDELOLW\ FODVVHV RI IODZV &RQILUPHG IODZV DUH VRUWHG LQWR YXOQHU
DELOLW\ FODVVHV

     IODZ JLYHV WRWDO FRQWURO RI WKH 7&%V\VWHP 7&
     VHFXULW\ SROLF\ YLRODWLRQ 39
     GHQLDO RI VHUYLFH '6
     LQVWDOODWLRQ GHSHQGHQW ,1 DQG
     KDUPOHVV +

7KHVH YXOQHUDELOLW\ FODVVHV DUH EDVHG RQ WKH GHJUHH RI XQDXWKRUL]HG FRQ
WURO RI WKH V\VWHP SHUPLWWHG E\ WKH IODZ ³ WKDW LV GDPDJH H[WHQW 7KH
JUHDWHVW YXOQHUDELOLW\ LV 7&% FDSWXUH WKH PDFKLQH LV XQGHU WRWDO FRQWURO
RI WKH LQWHUORSHU 7& ³ WRWDO FRQWURO ³ IODZV )ODZV WKDW SHUPLW OHVVHU
FRQWURO DUH XQLQWHQWLRQDO XQGRFXPHQWHG FDSDELOLWLHV WKDW YLRODWH WKH
SROLF\ PRGHO EXW GR QRW DOORZ WRWDO FRQWURO 39 ³ SROLF\ YLRODWLRQ ³
IODZV 'HQLDO RI VHUYLFH IODZV SHUPLW WKH SHQHWUDWRU WR GHJUDGH LQGLYLGXDO
DQG V\VWHP SHUIRUPDQFH EXW GR QRW YLRODWH WKH FRQILGHQWLDOLW\ VHFXULW\
SROLF\ '6 ³ GHQLDO RI VHUYLFH ³ IODZV ,QVWDOODWLRQGHSHQGHQW IODZV DUH
ZHDNQHVVHV LQ WKH 7&% WKDW REWDLQ IURP ORFDO LQLWLDOL]DWLRQ RI WKH V\VWHP
VXFK DV D SRRU SDVVZRUG DOJRULWKP ,1 ³ LQVWDOODWLRQGHSHQGHQW ³
IODZV /DVW WKHUH DUH IODZV WKDW DUH KDUPOHVV LQ WKH VHQVH WKDW WKH\ YLR
ODWH SROLF\ LQ D PLQRU ZD\ RU DUH LPSOHPHQWDWLRQ EXJV WKDW FDXVH QR RE




3HQHWUDWLRQ 7HVWLQJ                                                     
YLRXV GDPDJH + ³ KDUPOHVV ³ IODZV 7KHVH FRGHV ZLOO FDWHJRUL]H IODZV
SUHVHQWHG LQ VXEVHTXHQW VHFWLRQV

  3HQHWUDWLRQ UHVXOWV ([DPSOH JHQHULF DWWDFN PHWKRGV 7KLV VHFWLRQ
SUHVHQWV D UHSUHVHQWDWLYH FROOHFWLRQ RI DWWDFN PHWKRGV IRXQG HIIHFWLYH LQ
ILQGLQJ IODZV E\ WKH LQQRYDWLYH DQG VNLOOHG SHQHWUDWLRQ WHDPV XVLQJ )+0
$Q H[WHQVLYH WD[RQRP\ RI IODZV LV LQ SUHSDUDWLRQ E\ 15/ 1DYDO 5HVHDUFK
/DERUDWRU\ >%8//@

  :HDN LGHQWLILFDWLRQDXWKHQWLFDWLRQ 3DVVZRUGV DUH WKH FKHDSHVW IRUP RI
DXWKHQWLFDWLRQ :HDN SDVVZRUGV KRZHYHU DUH TXLWH H[SHQVLYH DOORZLQJ
WKH SHQHWUDWRU WR LPSHUVRQDWH NH\ VHFXULW\ DGPLQLVWUDWRUV WR JDLQ WRWDO
FRQWURO RI WKH 7&% 7& IODZ ,Q RQH V\VWHP D ZHDN SDVVZRUG SURWHFWHG
WKH SDVVZRUG ILOH LWVHOI 7KH SDVVZRUG ZDV D VKRUW (QJOLVK ZRUG WKDW WRRN
EXW D IHZ KRXUV RI WULDO DQG HUURU WR FUDFN $ PRGHUQ IRUP RI WKLV DWWDFN
RQ WKH 8QL[ SDVVZRUG ILOH LV HPERGLHG LQ D SURJUDP FDOOHG &UDFN ZKLFK
UXQV IRU GD\V DV D EDFNJURXQG WDVN JHQHUDWLQJ SRSXODU FDQGLGDWH SDVV
ZRUGV DQG WU\LQJ WKHP IRU FRQILUPDWLRQ >08))D@ 6LQFH PRVW SDVVZRUGV
DUH LQLWLDOL]HG E\ V\VWHP DGPLQLVWUDWLRQ WKLV LV DQ H[DPSOH RI DQ RSHUD
WLRQDO IODZ DQG DQ LQLWLDOFRQGLWLRQ ,1 IODZ
  2Q WKH '(& 3'3 DQG PDQ\ FRQWHPSRUDU\ PDFKLQHV WKHUH DUH SRZ
HUIXO VWULQJ FRPSDUH LQVWUXFWLRQV XVHG WR FRPSDUH VWRUHG YHUVXV HQWHUHG
SDVVZRUGV 7KHVH DUUD\ LQVWUXFWLRQV ZRUN OLNH '2:+,/( ORRSV XQWLO WKH
FKDUDFWHUE\FKDUDFWHU FRPSDUH IDLOV RU WKH SDVVZRUG VWULQJ HQGV ,W ZDV
GLVFRYHUHG LQ WKH 7HQH[ RSHUDWLQJ V\VWHP WKDW WKH LQVWUXFWLRQ DOVR IDLOHG
ZKHQ D SDJH IDXOW RFFXUUHG 7KLV WXUQHG D QHDW ELQDU\ SDVVZRUG SUHGL
FDWH ³ \HVQR ³ LQWR D WULQDU\ GHFLVLRQ FRQGLWLRQ ³ \HVQRPD\EH ³
WKDW HQDEOHG SLHFHZLVH FRQVWUXFWLRQ RI DQ\ SDVVZRUG LQ D PDWWHU RI VHF
RQGV ,Q WKLV FDVH WKH IODZ ZDV D ZHDN SDVVZRUG FKHFNLQJ URXWLQH WKDW
SHUPLWWHG WKH XVHU WR SRVLWLRQ WKH FDQGLGDWH SDVVZRUG DFURVV SDJH
ERXQGDULHV >7$1(@ 7KLV LV DQ H[DPSOH RI D KDUGZDUH DQRPDO\ DQG DQ
LPSOLFLW PHPRU\ VKDULQJ 7& IODZ
  2Q WKH ,%0 2696 5 DQG VLPLODU YLQWDJH RSHUDWLQJ V\VWHPV ILOHV RU
GDWD VHWV DUH SURWHFWHG E\ SDVVZRUG :KHQ WKH XVHU LV DEVHQW GXULQJ
EDWFK SURFHVVLQJ VXUUHQGHUHG SDVVZRUGV IRU WKH ILOH DUH SODFHG LQ WKH
-RE &RQWURO /DQJXDJH -&/ ORDG GHFN DQG TXHXH ILOH IRU FRPPDQG WR WKH
EDWFK SURFHVV 7KH -&/ TXHXH LV DQ XQSURWHFWHG GDWDEDVH ZKLFK LV
UHDGDEOH E\ DQ\ XVHU SURFHVV WKXV SHUPLWWLQJ WKHIW RI SDVVZRUGV 7KLV LV
DQ H[DPSOH RI D EDGO\ GHVLJQHG XVHUV\VWHP LQWHUIDFH ZKHUH V\VWHP GDWD
LV SODFHG LQ WKH XVHU·V DGGUHVV VSDFH >0&3+ 6'& 6'&@ ,W LV DOVR
DQ H[DPSOH RI EDG VHFXULW\ SROLF\ D SROLF\ YLRODWLRQ 39 IODZ
  ,Q PRVW V\VWHPV WKH XVHU ORJV LQWR D ZHOOGHVLJQHG SDVVZRUG DXWKHQWL
FDWLRQ PHFKDQLVP +RZHYHU WKH V\VWHP QHYHU DXWKHQWLFDWHV LWVHOI WR WKH
XVHU 7KLV ODFN RI PXWXDO DXWKHQWLFDWLRQ SHUPLWV XVHUV WR EH VSRRIHG LQWR
VXUUHQGHULQJ WKHLU SDVVZRUGV WR D ERJXV ORJLQ VLPXODWLRQ SURJUDP OHIW



                                                    ,QIRUPDWLRQ 6HFXULW\
UXQQLQJ RQ D YDFDQW SXEOLF WHUPLQDO 7KLV VSRRI KDV EHHQ DURXQG IRUHYHU
DQG LV VWLOO HIIHFWLYH ,W LV DQ H[DPSOH RI D SRRU XVHUV\VWHP LQWHUIDFH WKDW
\LHOGV D SROLF\ YLRODWLRQ 39 IODZ 0XWXDO DXWKHQWLFDWLRQ LV D QHFHVVLW\ LQ
WKH PRGHUQ ZRUOG RI GLVWULEXWHG FRPSXWLQJ ZKHUH QXPHURXV QHWZRUN
VHUYHUV KDQGOH ILOHV PDLO SULQWLQJ PDQDJHPHQW URXWLQJ JDWHZD\V WR
RWKHU QHWZRUNV DQG VSHFLDOL]HG VHUYLFHV IRU XVHUV RQ WKH QHW :LWKRXW LW
VXFK VHUYLFHV ZLOO VXUHO\ EH VSRRIHG PRGLILHG DQGRU IDOVLILHG 1HZ
VPDUW FDUG , $ V\VWHPV SURYLGH PXWXDO DXWKHQWLFDWLRQ E\ XVH RI SXEOLF
NH\ FU\SWRJUDSK\ >.5$-@

  6HFXULW\ SHULPHWHU LQILOWUDWLRQ 8QWUXVWHG FRGH PXVW EH FRQILQHG DQG
SHUPLWWHG WR FDOO WKH 7&% RQO\ LQ D SUHVFULEHG PDQQHU IRU VHFXUH DFFHVV
WR QHHGHG V\VWHP VHUYLFHV >/$03@ 7KHVH ERXQGDU\ FURVVLQJV RI WKH
VHFXULW\ SHULPHWHU DUH RIWHQ SRRUO\ GHVLJQHG DQG UHVXOW LQ ´LQILOWUDWLRQµ
IODZV $ FODVVLF H[DPSOH RI WKLV LV WKH XQFRQWUROOHG FKDQQHO SURJUDP RI
WKH ,%0  6LQFH FKDQQHO SURJUDPV DUH DOORZHG WR EH VHOIPRGLI\LQJ WR
SHUPLW VFDWWHU UHDGV DQG ZULWHV DQG WKH XVHU FDQ WXUQ RII PHPRU\ PDS
SLQJ IRU H[DPSOH 9LUWXDO      5HDO LW LV SRVVLEOH WR ZULWH LQWR SURWHFWHG
V\VWHP PHPRU\ DQG PRGLI\ FRGH DQGRU SURFHVV PDQDJHPHQW GDWD $W
WHPSWV WR HOLPLQDWH WKHVH SUREOHPV E\ VWDWLF DQDO\VLV RI WKH FKDQQHO SUR
JUDPV LQ 90 IDLOHG WR SUHYHQW FOHYHU ´SXQVµ LQ WKH FRGH IURP
FRQWLQXHG H[SORLWDWLRQ >$77$ %(/$ 3+,/@
  $QRWKHU H[DPSOH RI SRRU FRQILQHPHQW LV WKH +RQH\ZHOO +,6  *&26
VXVSHQG IHDWXUH ,W DOORZV D XVHU WR IUHH]H DQ LQWHUDFWLYH VHVVLRQ IRU D
OXQFK EUHDN RU ORQJHU VXVSHQVLRQ DQG UHVXPH ODWHU E\ WKDZLQJ WKH SUR
JUDP 7KH GHVLJQ IODZ VWRUHV WKH IUR]HQ LPDJH LQ WKH XVHU·V ILOH VSDFH LQ
FOXGLQJ DOO WKH VHQVLWLYH V\VWHP FRQWH[W QHHGHG WR UHVWDUW WKH FRGH ,W LV D
VLPSOH SURFHVV IRU D XVHU WR HGLW WKH IUR]HQ LPDJH ILOH DQG PRGLI\ WKH
FRQWH[W GDWD VXFK WKDW WKH UHVWDUWHG SURJUDP UXQV LQ V\VWHP VWDWH ZLWK
WRWDO FRQWURO RI WKH 7&% 7& IODZ 7KLV LV \HW DQRWKHU H[DPSOH RI DQ LP
SOLHG PHPRU\ VKDULQJ IODZ
  $PRQJ WKH PRVW VRSKLVWLFDWHG SHQHWUDWLRQV LV WKH OHJHQGDU\ EUHDNSRLQW
DWWDFN RI /LQGH DQG 3KLOOLSV >$77$ 3+,/@ ,W LV DQ H[FHOOHQW H[DPSOH
RI D EHDGLQJ DWWDFN :KHQ D XVHU SODQWV D EUHDNSRLQW LQ KLV XVHU FRGH
WKH V\VWHP UHSODFHV WKH XVHU FRGH DW WKH EUHDNSRLQW ZLWK D EUDQFK LQ
VWUXFWLRQ WR WKH V\VWHP 7KH V\VWHP·V EUHDNSRLQW URXWLQH VDYHV WKH XVHU
FRGH LQ D V\VWHP VDYH DUHD /DWHU ZKHQ WKH EUHDNSRLQW LV UHPRYHG WKH
XVHU FRGH LV UHVWRUHG 7KH EUHDNSRLQW IHDWXUH KHOSV WKH SHQHWUDWRU SODQW
FRGH LQ WKH V\VWHP LWVHOI ³ WKDW LV WKH UHSODFHG XVHU FRGH ³ DQ H[DPSOH
RI D KDUPOHVV + IODZ ,W ZDV REVHUYHG WKDW DQRWKHU H[LVWLQJ KDUPOHVV
IODZ D PRYH VWULQJ HUURU H[LW OHIW WKH DGGUHVV RI WKH V\VWHP PHPRU\
PDS UDWKHU WKDQ WKH DGGUHVV RI WKH VWULQJ XSRQ HUURU UHWXUQ ,W ZDV
SRVVLEOH WR LQGXFH WKH VWULQJ IODZ E\ UHIHUHQFH WR DQ XQDYDLODEOH PHPRU\
SDJH ³ WKDW LV D SDJH IDXOW $ WKLUG KDUPOHVV IODZ DOORZHG FRQWURO WR UH




3HQHWUDWLRQ 7HVWLQJ                                                      
WXUQ WR WKH FDOOHU ZKLOH WKH VWULQJ PRYH ZDV LQ SURJUHVV LQ WKH FDOOHG SUR
JUDP
  7KH SHQHWUDWRUV VHW XS WKH EHDG DWWDFN E\ SODQWLQJ D EUHDNSRLQW DW D
FDUHIXOO\ SUHSDUHG LQVWUXFWLRQ RQ WKH VDPH SDJH DV D VWULQJ PRYH FRP
PDQG 7KH\ FDUHIXOO\ VHOHFWHG D VWULQJ WKDW FURVVHG D SDJH ERXQGDU\
7KH\ H[HFXWHG WKH VWULQJ PRYH DQG XSRQ UHJDLQLQJ FRQWURO UHOHDVHG WKH
SDJH FRQWDLQLQJ WKH HQG RI WKH ORQJ VWULQJ 7KDW FDXVHG D SDJH IDXOW ZKHQ
WKH VWULQJ PRYH FURVVHG WKH SDJH ERXQGDU\ DW ZKLFK WLPH WKH EUHDNSRLQW
ZDV UHPRYHG ,Q UHVWRULQJ WKH SUHEUHDNSRLQW XVHU FRGH WKH V\VWHP UH
WULHYHG WKH VDYHG XVHU FRGH EXW HUURQHRXVO\ ZURWH WKH XVHU FRGH LQWR
SURWHFWHG V\VWHP PHPRU\ VSHFLILFDOO\ WKH V\VWHP SDJH PDS 7KLV XQ
DXWKRUL]HG V\VWHP PRGLILFDWLRQ ZDV SRVVLEOH EHFDXVH D KDUGZDUH GHVLJQ
IODZ LQ WKH SDJH IDXOW HUURU UHWXUQ OHIW WKH SDJH DGGUHVV RI WKH V\VWHP
PHPRU\ PDS QRW WKH SDJH DGGUHVV RI WKH RULJLQDO XVHU·V VWULQJ 7KH DW
WDFN KDG VXFFHVVIXOO\ PRGLILHG WKH V\VWHP PDS SODFLQJ XVHU GDWD LQ WKH
V\VWHP LQWHUUXSW YHFWRU WDEOH 7KH DWWDFN JDYH DUELWUDU\ FRQWURO RI WKH
7&% ³ DQRWKHU VXEWOH IODZ LQ LPSOLFLW PHPRU\ VKDULQJ D 7& IODZ

   ,QFRPSOHWH FKHFNLQJ ,PSRUWV DQG H[SRUWV WKDW FURVV WKH VHFXULW\ SH
ULPHWHU SHU WKH 7&6(& DUH HLWKHU ODEHO FKHFNHG RU XVH LPSOLFLW ODEHOV IRU
WKH ,2 FKDQQHO XVHG /RWV RI IODZV RFFXU ZKHQ ODEHOV DUH QRW XVHG RU DUH
XVHG LQFRQVLVWHQWO\ $QRWKHU DWWDFN H[SORLWV LQWHURSHUDELOLW\ EHWZHHQ
V\VWHPV WKDW XVH GLIIHUHQW ODEHO VHPDQWLFV 7KH 'HIHQVH 'DWD 1HWZRUN
''1 HPSOR\V WKH VWDQGDUG ,3 GDWDJUDP 5HYLVHG ,QWHUQHW 3URWRFRO 6HFX
ULW\ 2SWLRQ 5,362 VHFXULW\ VHQVLWLYLW\ ODEHO >5)&@ ,W GLIIHUV IURP
HPHUJLQJ FRPPHUFLDO VWDQGDUGV +HUH LV D VLWXDWLRQ ULSH IRU D IXWXUH VH
FXULW\ ,1 IODZ
   $UUD\ERXQGV RYHUIORZ LV D SDUWLFXODUO\ QDVW\ IODZ DQG TXLWH SHUYDVLYH
DQG GLIILFXOW WR FRXQWHU 7KH IODZ PDQLIHVWV LWVHOI LQ V\VWHP RSHUDWLRQ EXW
LWV FDXVH LV XVXDOO\ WUDFHG WR WKH GHYHORSPHQW FRPSLOHU·V IDLOXUH WR JHQHU
DWH FRGH IRU G\QDPLF DUUD\ERXQGV FKHFNLQJ :KHQ WKH DUUD\ ERXQG LV
H[FHHGHG WKH FRGH RU GDWD SDUDPHWHUV DGMDFHQW WR WKH DUUD\ DUH RYHU
ZULWWHQ DQG PRGLILHG ,Q RQH FDVH WKH XVHUHQWHUHG SDVVZRUG ZDV VWRUHG
DGMDFHQW WR WKH V\VWHPVWRUHG SDVVZRUG VR WKH WZR VWULQJV DUUD\V FRXOG
EH UDSLGO\ FRPSDUHG +RZHYHU WKHUH ZDV QR ERXQGV FKHFNLQJ 7KH XVHU
VLPSO\ HQWHUHG D PD[LPXPVL]H SDVVZRUG WZLFH VR WKDW LW RYHUIORZHG WKH
XVHU DUUD\ LQWR WKH V\VWHP DUUD\ FUHDWLQJ D SDVVZRUG PDWFK >%,6+@ D
FHUWDLQ 7& IODZ
   ,QFRPSOHWH FDVH DQDO\VLV OHDGV WR IODZV (LWKHU WKH GHVLJQ VSHFLILFDWLRQ
KDV QRW FRQVLGHUHG DOO WKH FRQGLWLRQV RI DQ ,)7+(1(/6( IRUP RU WKH
SURJUDPPHU JRRIHG ,Q HLWKHU HYHQW WKH SHQHWUDWRU FUHDWHV WKH PLVVLQJ
FRQGLWLRQ DQG IRUFHV WKH FRGH WR LJQRUH WKH FRQVHTXHQFHV RIWHQ FUHDWLQJ
DQ H[SORLWDEOH VWDWH D 39 IODZ 7KH ,%0 36: IODZ PHQWLRQHG LQ WKH HDU
OLHU VHFWLRQ ´6\VWHP DQRPDOLHVµ LV DQ H[DPSOH




                                                      ,QIRUPDWLRQ 6HFXULW\
   7KH ,%0  LQWURGXFHG WKH 3URJUDP 6WDWXV :RUG 36: ZKLFK FRQ
WDLQHG D VWDWXV FRQGLWLRQ FRGH IRU WKH PDFKLQH LQVWUXFWLRQV WKDW KDYH
FRQGLWLRQDO H[HFXWLRQ PRGHV 0DQ\ SURJUDPPHUV LJQRUH WKH 36: VWDWXV
FRGH DQG DVVXPH WKH H[HFXWLRQ UHVXOW RI WKH LQVWUXFWLRQ 7KLV LV SRRU
FRGLQJ SUDFWLFH EXW D VXUSULVLQJO\ IUHTXHQW RFFXUUHQFH >%8//@ 2IWHQ
WKH SURJUDPPHU EHOLHYHV WKDW SULRU FKHFNV ILOWHU WKH FRQGLWLRQV EHIRUH WKH
LQVWUXFWLRQ H[HFXWLRQ DQG WKDW WKH GDWD FDQQRW FDXVH WKH XQDQWLFLSDWHG
FRQGLWLRQ WKXV LJQRULQJ WKH FRQGLWLRQ FRGH 7KH SHQHWUDWRU PXVW ILQG DQ
RSSRUWXQLW\ WR UHVHW WKH SDUDPHWHUV DIWHU WKH ILOWHU FKHFNV EXW EHIRUH WKH
FRQGLWLRQDO FRGH H[HFXWLRQ WLPHRIFKHFNWRWLPHRIXVH 72&7728 DW
WDFNV DUH H[DFWO\ ZKDW·V QHHGHG IRU SHQHWUDWLRQ
   $ 72&7728 IODZ LV OLNH D GDQJOLQJ SDUWLFLSOH JUDPPDWLFDO IODZ LQ (QJ
OLVK 7KH FKHFN FRGH LV GLVWDQW IURP WKH XVLQJ FRGH HQDEOLQJ LQWHUYHQLQJ
FRGH WR FKDQJH WKH WHVWHG SDUDPHWHUV DQG FDXVH WKH XVH FRGH WR WDNH LQ
FRUUHFW SROLF\YLRODWLQJ DFWLRQV D 39 IODZ 7KH DWWDFN LV D IRUP RI VOHLJKW
RI KDQG 7KH SHQHWUDWRU VHWV XS D SHUIHFWO\ LQQRFHQW DQG FRUUHFW SURJUDP
SRVVLEO\ DQ H[LVWLQJ DSSOLFDWLRQ SURJUDP DQG WKURXJK PXOWLWDVNLQJ RU
PXOWLSURFHVVLQJ KDV DQRWKHU SURJUDP PRGLI\ WKH SDUDPHWHUV GXULQJ WKH
LQWHUYDO EHWZHHQ FKHFN DQG XVH 7KH LQWHUYDO PD\ EH VPDOO QHFHVVLWDWLQJ
FDUHIXO WLPLQJ RI WKH DWWDFN 7KH IODZ LV ERWK DQ LPSOLFLW PHPRU\ VKDULQJ
HUURU DQG D SURFHVV V\QFKURQL]DWLRQ SUREOHP 7KH VROXWLRQ LV QRW WR SODFH
V\VWHP SDUDPHWHUV LQ XVHU PHPRU\ DQGRU SURKLELW LQWHUUXSWLELOLW\ RI
´FULWLFDO UHJLRQµ FRGH >/,1' 0&3+ 3+,/@
   5HDGEHIRUHZULWH IODZV DUH UHVLGXH FRQWURO IODZV %HJLQQLQJ ZLWK
7&6(& & FODVV V\VWHPV DOO UHXVHG REMHFWV PXVW EH FOHDQHG EHIRUH UH
XVH 7KLV LV UHTXLUHG DV D FRXQWHUPHDVXUH WR WKH LQDGHTXDWH UHVLGXH
FRQWURO LQ HDUOLHU V\VWHPV +RZHYHU WKH IODZ SHUVLVWV LQ PRGHUQ GUHVV
:KHQ GLVN ILOHV DUH GHOHWHG RQO\ WKH QDPH LQ WKH ILOH FDWDORJ LV HUDVHG
7KH GDWD UHFRUGV DUH DGGHG WR IUHH VWRUDJH IRU ODWHU DOORFDWLRQ 7R LQFUHDVH
SHUIRUPDQFH WKHVH XVHG UHFRUGV DUH FOHDUHG RQ UHDOORFDWLRQ LI DW DOO QRW
RQ GHDOORFDWLRQ 7KDW PHDQV WKH GDWD UHFRUGV FRQWDLQ UHVLGXH RI SRVVLEO\
VHQVLWLYH PDWHULDO ,I WKH ILOH PHPRU\ LV DOORFDWHG DQG UHDG EHIRUH GDWD LV
ZULWWHQ WKH UHVLGXH LV DFFHVVLEOH $ SROLF\ RI ZULWHEHIRUHUHDG FRXQWHUV
WKLV IODZ EXW VXFK D SROLF\ PD\ QRW H[LVW RU PD\ EH SRRUO\ LPSOHPHQWHG
7KLV IODZ DOVR DSSHDUV ZLWK PDLQ PHPRU\ DOORFDWLRQ DQG JDUEDJH FROOHF
WLRQ VFKHPHV ,Q RQH H[DPSOH WKH UHOHYDQW DOSKDEHWLFDO SDVVZRUG UHFRUGV
ZHUH UHDG LQWR PHPRU\ IURP GLVN IRU WKH ORJLQ SDVVZRUG FRPSDUH $IWHU
WKH FRPSDUH WKH PHPRU\ ZDV OHIW XQFKDQJHG 8VLQJ RWKHU DWWDFNV VXFK
DV WKH DUUD\ERXQGV RYHUIORZ GHVFULEHG DERYH WKDW UHVLGXH PHPRU\
FRXOG EH UHDG DQG SDVVZRUGV VFDYHQJHG %\ FDUHIXOO\ VWHSSLQJ WKURXJK
WKH DOSKDEHW WKH FRPSOHWH SDVVZRUG ILOH FRXOG EH UHFUHDWHG D 7& IODZ
>/,1'D@

  3ODQWLQJ ERJXV FRGH 7KH PRVW YLUXOHQW IODZV DUH FUHDWHG E\ WKH SHQH
WUDWRU LQVHUWLQJ ERJXV FRGH LQWR WKH 7&% D 7& IODZ %RJXV FRGH LQFOXGHV



3HQHWUDWLRQ 7HVWLQJ                                                       
DOO IRUPV RI XQDXWKRUL]HG VRIWZDUH 7URMDQ KRUVHV WUDS GRRUV YLUXVHV
ERPEV DQG ZRUPV )XQGDPHQWDOO\ IODZV WKDW DGPLW ERJXV FRGH DUH
IODZV LQ WKH FRQILJXUDWLRQ FRQWURO RI WKH 7&% 7KH IODZ PD\ RFFXU DQ\
WLPH WKURXJKRXW WKH OLIH F\FOH RI WKH 7&% :KHQ GHYHORSPHQW WRROV DUH
XQFRQWUROOHG ERJXV FRGH FDQ EH LPEHGGHG LQ WKH WRROV DQG WKHQ LQWR WKH
7&% .HQ 7KRPSVRQ·V $&0 7XULQJ /HFWXUH DSWO\ GRFXPHQWHG VXFK DQ
DWWDFN >7+20@ %XW WKHUH DUH HDVLHU PHWKRGV ³ IRU H[DPSOH SODQWLQJ
ERJXV FRGH LQ WKH UXQWLPH SDFNDJH RI WKH PRVW SRSXODU FRPSLOHU DQGRU
HGLWRU 5HFHQW DWWDFNV RQ WKH ,QWHUQHW ZHUH H[SORLWDWLRQV RI SRRU FRQILJX
UDWLRQ FRQWURO .QRZQ IODZV LQ 8QL[ ZHUH QRW IL[HG ZLWK WKH IUHH YHQGRU
SDWFKHV 7KH KDFNHU XVHG WKH IODZV WR REWDLQ XQDXWKRUL]HG DFFHVV
>63$)D@
  $PRQJ WKH PRUH FRORUIXO DWWDFNV DJDLQVW KXPDQ IUDLOW\ LQ FRQWUROOLQJ
ERJXV FRGH LV WKH 6DQWD &ODXV DWWDFN ,W LV D FODVVLF H[DPSOH RI DQ XQ
DXWKRUL]HG FRGH LPSRUW DFKLHYHG E\ VSRRILQJ WKH KXPDQ RSHUDWRU RI D
VHFXUH V\VWHP $ SHQHWUDWRU SUHSDUHG DQ DWWUDFWLYH SURJUDP IRU WKH FRP
SXWHU RSHUDWRU ZKR DOZD\V UDQ ZLWK V\VWHP SULYLOHJHV 7KH SURJUDP
SULQWHG D SLFWXUH RQ WKH KLJKVSHHG SULQWHU RI 6DQWD DQG KLV UHLQGHHU ³
WKH NLQG \RX DOZD\V VHH SRVWHG DW &KULVWPDV LQ DQG DERXW WKH FRPSXWHU
IDFLOLW\ +RZHYHU WKHUH ZDV D 7URMDQ KRUVH PL[HG LQ ZLWK 'DQFHU
3UDQFHU DQG IULHQGV WKDW PRGLILHG WKH RSHUDWLQJ V\VWHP WR DOORZ XQGH
WHFWHG DFFHVV IRU WKH LQWHUORSHU %HIRUH \RX EHOLWWOH WKH FRPSXWHU RSHUD
WRU·V IROO\ FRQVLGHU \RXU RZQ XVH RI ´IUHHZDUHµ SURJUDPV GRZQORDGHG
IURP \RXU IDYRULWH EXOOHWLQ ERDUG 7KHUH DUH DV PDQ\ XVHU DQG RSHUDWRU
VSRRIV DV WKHUH DUH JXOOLEOH SHRSOH ORRNLQJ IRU ´JDLQ ZLWKRXW SDLQµ (WHUQDO
YLJLODQFH LV WKH SULFH RI IUHHGRP IURP VSRRI DWWDFNV $OVR LPSURYHG UROH
DXWKRUL]DWLRQ FRQWUROV FDQ OLPLW WKH GDPDJH SURSDJDWLRQ RI VXFK IODZV
IURP KXPDQ IRLEOHV


3HQHWUDWLRQ DQDO\VLV IRU WKH V DQG EH\RQG
  7KLV HVVD\ FRQFOXGHV ZLWK VSHFXODWLRQV RQ IXWXUH GLUHFWLRQV RI SHQHWUD
WLRQ DQDO\VLV 7KH DVVXPSWLRQ LV WKDW WKH EDWWOH EHWZHHQ WKH 7&% GHYHO
RSHU RU RSHUDWRU DQG WKH KDFNHU ZLOO FRQWLQXH XQDEDWHG %HWWHU OHJDO
SURWHFWLRQ IRU XVHUV ZLOO DOZD\V WUDLO WHFKQRORJ\ DQG WKH WHFKQRORJ\ ZLOO
LPSURYH IRU ERWK DQWDJRQLVWV ,W ZLOO EH FRQWLQXRXV GLJLWDO HOHFWURQLF
ZDUIDUH DPRQJ VHFXULW\ PHDVXUHV KDFNHU DWWDFNV XVHU FRXQWHUPHD
VXUHV DQG VHFXULW\ FRXQWHUFRXQWHUPHDVXUHV SHUSHWXDO RIIHQVH DJDLQVW
GHIHQVH
  7KH GHIHQVH GHYHORSHUV RI 7&%V DUH XVLQJ EHWWHU PHWKRGV RI GHVLJQLQJ
DQG LPSOHPHQWLQJ WUXVWHG V\VWHPV /HVVRQV DUH EHLQJ OHDUQHG IURP SDVW
SHQHWUDWLRQV ERWK WHVWV DQG UHDO DWWDFNV 7KH JHQHULF IODZV DUH OHDGLQJ WR
EHWWHU XQGHUVWDQGLQJ RI VHFXULW\ SROLF\ IRU FRQILGHQWLDOLW\ LQWHJULW\ DQG
VHUYLFH DYDLODELOLW\ DQG RI WKH FRQILQHPHQW RI RYHUW DQG FRYHUW FKDQQHOV
ZKHQ VKDULQJ FRPPRQ PHFKDQLVPV LQ WUXVWHG V\VWHPV 7KLV XQGHU



                                                      ,QIRUPDWLRQ 6HFXULW\
VWDQGLQJ LV EHLQJ FDSWXUHG LQ LPSURYHG PDFKLQH DUFKLWHFWXUHV ZLWK VHJ
UHJDWHG SULYLOHJH GRPDLQV RU SURWHFWLRQ ULQJV WR UHLQIRUFH VHFXULW\ SH
ULPHWHUV DQG ERXQGDU\ FURVVLQJV ,PSURYHG KDUGZDUH VXSSRUWV VDIH DQG
UDSLG FRQWH[W VZLWFKLQJ DQG REMHFW YLUWXDOL]DWLRQ &U\SWRJUDSK\ LV SOD\LQJ
D ODUJHU UROH LQ FRQILGHQWLDOLW\ LQWHJULW\ DQG DXWKHQWLFDWLRQ FRQWUROV
&RPSXWHUV DUH JHWWLQJ IDVWHU DQG FKHDSHU VR WKDW VHFXULW\ PHFKDQLVPV
ZLOO EH KDUGZDUHULFK DQG QRW OLPLW SHUIRUPDQFH LQ VHFXUH VROXWLRQV
6RIWZDUH LV LPSURYLQJ LQ TXDOLW\ WRROV GHYHORSPHQW HQYLURQPHQWV WHVW
LQJ VWDQGDUGV DQG IRUPDOLVP

  $SSOLFDELOLW\ RI )+0 WR ,76(& ,W KDV EHHQ TXHVWLRQHG ZKHWKHU SHQH
WUDWLRQ WHVWLQJ KDV PHDQLQJ IRU D 7DUJHW RI (YDOXDWLRQ 72( RI WKH (XUR
SHDQ ,QIRUPDWLRQ 7HFKQRORJ\ 6HFXULW\ (YDOXDWLRQ &ULWHULD ,76(& VLQFH
´SHQHWUDWLRQ WHVWLQJµ RU LWV HTXLYDOHQW QHYHU DSSHDU LQ WKH FULWHULD
>,76(@ )RU PRVW RI WKH UHDVRQV H[SUHVVHG HDUOLHU LQ WKLV HVVD\ SHQH
WUDWLRQ WHVWLQJ ZLOO EH UHTXLUHG IRU ,76(& KLJKDVVXUDQFH HYDOXDWLRQV
+RZHYHU WKH ,76(& LV GLIIHUHQW IURP WKH 7&6(& DQG WKH 7&6(& LQWHU
SUHWDWLRQV 7KH DSSOLFDELOLW\ RI )+0 WR ,76(& IRU WKH V LV GLVFXVVHG
KHUH
  $ 72( LV HLWKHU D VHFXULW\ SURGXFW RU D V\VWHP WR EH HYDOXDWHG 3HQH
WUDWLRQ WHVWLQJ RI D 72( LV FRPSDUDEOH LQ VFRSH WR SHQHWUDWLRQ WHVWLQJ LQ
DFFRUGDQFH ZLWK WKH 7&6(& +RZHYHU D 72(·V HYDOXDWLRQ FULWHULD FRQVLVW
RI WZRWXSOHV )L (M )L LV RQH RI  VHFXULW\ IXQFWLRQDOLW\ FODVVHV DQG (M
LV RQH RI VHYHQ LQGHSHQGHQW HYDOXDWLRQ OHYHOV 7R PDWFK WKH 7&6(&
FODVVHV RI )+0 LQWHUHVW ZH KDYH WKH WZRWXSOHV ) ( ) ( DQG
) ( ZKLFK FRUUHVSRQG WR % % DQG $ UHVSHFWLYHO\ 7KH ILUVW ILYH
IXQFWLRQDO FODVVHV RI WKH ,76(& ) WKURXJK ) PDWFK WKH VL[ IXQFWLRQDO
FODVVHV RI WKH 7&6(& & WKURXJK $ ZLWK ) IXQFWLRQDOLW\ WKH VDPH IRU
% DQG $
  7KH VHYHQ ,76(& HYDOXDWLRQ FODVVHV DUH DSSOLHG WR WKH 72( 'HYHORS
PHQW 3URFHVV '3 'HYHORSPHQW (QYLURQPHQW '( DQG 2SHUDWLRQDO (Q
YLURQPHQW 2( HDFK RI ZKLFK LV IXUWKHU GLYLGHG DV IROORZV

  ‡   '3 5HTXLUHPHQWV DUFKLWHFWXUDO GHVLJQ GHWDLOHG GHVLJQ LPSOH
      PHQWDWLRQ
  ‡   '( &RQILJXUDWLRQ FRQWURO SURJUDPPLQJ ODQJXDJHV DQG FRPSLOHUV
      GHYHORSHU VHFXULW\
  ‡   2( 'HOLYHU\ DQG FRQILJXUDWLRQ VHWXS DQG RSHUDWLRQ

  7KH ,76(& LV VR QHZ WKHUH LV QR SUDFWLFDO H[SHULHQFH WR GUDZ IURP LQ
ORRNLQJ DW WKH DSSOLFDELOLW\ RI )+0 VR ZH ORRN PRUH FORVHO\ DW WKH WH[W
$OWKRXJK SHQHWUDWLRQ WHVWLQJ LV QRW PHQWLRQHG WHVWLQJ LV ZLGHO\ UHIHU
HQFHG SDUWLFXODUO\ IRU WKH HYDOXDWRU WR SHUIRUP ´KLV RZQ WHVWV WR FKHFN
WKH FRPSUHKHQVLYHQHVV DQG DFFXUDF\ RI WKH VSRQVRU WHVWLQJ DQG DOVR WR
DGGUHVV DQ\ SRLQWV RI DSSDUHQW LQFRQVLVWHQF\ RU HUURU IRXQG LQ WKH UH



3HQHWUDWLRQ 7HVWLQJ                                                       
VXOWV RI WKH VSRQVRU·V WHVWLQJµ >,76(@ 7HVWLQJ IRU HUURUV DQG YXOQHU
DELOLWLHV LV UHTXLUHG HYHQ DW HYDOXDWLRQ FODVV ( UHWHVWLQJ RI FRUUHFWHG
IODZV LV UHTXLUHG DW ( LQGHSHQGHQW YXOQHUDELOLW\ DQDO\VLV LV QHHGHG DW
( DQG DOO WKHVH UHTXLUHPHQWV DUH FXPXODWLYH ZLWK KLJKHU HYDOXDWLRQ
FODVVHV 7KHVH WHVW UHTXLUHPHQWV DUH TXLWH VLPLODU WR WKRVH DGGUHVVHG E\
WKH )+0 GHVFULEHG LQ WKLV HVVD\
  $VVXUDQFH RI D 72( LV GLYLGHG LQ WKH ,76(& EHWZHHQ FRUUHFWQHVV DQG
HIIHFWLYHQHVV &RUUHFWQHVV LV EDVHG RQ WKH VHYHQ HYDOXDWLRQ FODVVHV ( WR
( (IIHFWLYHQHVV RI D 72( LQYROYHV D QXPEHU RI FRQVLGHUDWLRQV WKH VXLW
DELOLW\ RI WKH VHFXULW\ IXQFWLRQDOLW\ IRU WKH SURSRVHG HQYLURQPHQW DQDOR
JRXV WR WKH 7&6(& HQYLURQPHQW JXLGHOLQHV >&6&@ ZKHWKHU WKH
IXQFWLRQDOLW\ \LHOGV D VRXQG VHFXULW\ DUFKLWHFWXUH HDVH RI XVH RI VHFXULW\
IXQFWLRQV DVVHVVPHQW RI WKH VHFXULW\ YXOQHUDELOLWLHV GXULQJ GHYHORSPHQW
DQG RSHUDWLRQ DQG WKH VWUHQJWK RI WKH VHFXULW\ PHFKDQLVPV WR UHVLVW DW
WDFN $OO WKHVH LWHPV DUH ´JHQHUDWRUVµ LQ )+0 VHH WKH HDUOLHU VHFWLRQ
´)ODZ JHQHUDWLRQµ
  7KH )+0 GHSHQGV RQ GLVFRYHULQJ IDLOXUHV LQ WKH HYLGHQFH LPSOLFDWLRQ
FKDLQ VWDUWLQJ ZLWK D VHFXULW\ SROLF\ VHH WKH HDUOLHU VHFWLRQ ´(YLGHQFH
LPSOLFDWLRQ FKDLQµ 7KH DSSOLFDWLRQ RI )+0 WR D 72( ZRXOG UHTXLUH D
VLPLODU SURFHGXUH $ 72( KDV D KLHUDUFK\ RI VHFXULW\ SROLFLHV D 6\VWHP
6HFXULW\ 3ROLF\ 663 D 6\VWHP (OHFWURQLF ,QIRUPDWLRQ 6HFXULW\ 3ROLF\
6(,63 DQG D 6HFXULW\ 3ROLF\ 0RGHO 630 FRUUHVSRQGLQJ WR VHFXULW\
REMHFWLYHV GHWDLOHG VHFXULW\ HQIRUFHPHQW PHFKDQLVPV DQG D VHPLIRUPDO
SROLF\ PRGHO UHVSHFWLYHO\ 7KHVH SROLFLHV DUH WLHG WR WKH IXQFWLRQDO FODVVHV
DQG IRUP WKH EDVLV IRU WKH FRUUHFWQHVV FULWHULD IRU WHVWLQJ 7RJHWKHU ZLWK
WKH HYDOXDWLRQ FODVVHV DQ HYLGHQFH LPSOLFDWLRQ FKDLQ LV IRUPHG IRU D VSH
FLILF 72( DQG )+0 FDQ EH VXFFHVVIXOO\ DSSOLHG
  ,Q FRQFOXVLRQ )+0 VKRXOG EH HTXDOO\ DV DSSOLFDEOH WR ,76(& DV WR
7&6(&71,7', HYDOXDWLRQV 8QGHU ERWK VHWV RI FULWHULD WKH PRVW VLJ
QLILFDQW RSHQ TXHVWLRQ LV +RZ DUH HYDOXDWRUV WR MXGJH WKH VHFXULW\ RI D
V\VWHP FRPSRVHG RI LQGLYLGXDOO\ HYDOXDWHG FRPSRQHQWV" 7KH FRPSRV
DELOLW\ FRQWURYHUV\ LV EH\RQG WKH VFRSH RI WKLV HVVD\ +RZHYHU )+0 LV
DSSOLFDEOH WR VXFK FRPSRVHG V\VWHPV DQG PD\ EH SDUW RI WKH FRQWUR
YHUV\·V UHVROXWLRQ

  )RUPDO PHWKRGV RI SHQHWUDWLRQ WHVWLQJ )RUPDO PHWKRGV XVH ULJRURXV
PDWKHPDWLFDO VSHFLILFDWLRQV RI WKH 7&% GHVLJQ WKDW LV )7/6 DVVXPS
WLRQV LQLWLDO FRQGLWLRQV DQG FRUUHFWQHVV FULWHULD )RUPDO WRROV WDNH WKHVH
VSHFLILFDWLRQV DQG JHQHUDWH FRUUHFWQHVV WKHRUHPV DQG SURRIV RI WKH WKHR
UHPV DQG WKH GHVLJQ WKH\ SRUWUD\ ,W LV KRSHG WKDW WKHVH IRUPDO PHWKRGV
FDQ DFKLHYH VLPLODU VXFFHVV DW WKH OHYHO RI FRGH SURRIV $ QHZ IRUP RI
SHQHWUDWLRQ DQDO\VLV LV LQ SURJUHVV ZLWK QHZ 7&% GHVLJQV ³ ULJRURXV
IRUPDO PRGHOV RI WKH 7&% 7KHVH PRGHOV GHVFULEH WKH 7&% EHKDYLRU DV
VWDWH PDFKLQHV VWDWHWUDQVLWLRQ UXOHV VHFXULW\ LQYDULDQWV LQLWLDO FRQGL
WLRQV DQG WKHRUHPV WKDW PXVW EH SURYHQ 3HQHWUDWLRQ DQDO\VLV LV DOPRVW



                                                       ,QIRUPDWLRQ 6HFXULW\
LQVHSDUDEOH IURP WKH IRUPDO GHVLJQ SURFHVV SURGXFLQJ FRQMHFWXUHV RI
IODZV ZLWK WKH PRGHO DQG WU\LQJ WR SURYH WKHP DV WKHRUHPV 7KLV LV D ULJ
RURXV H[WHQVLRQ RI )+0 ,I VXFFHVVIXO WKH FRUUHFWQHVV SURRI YHUVXV IODZ
FRQMHFWXUH SURRI EHFRPHV SDUW RI WKH GHVLJQ SURFHVV DQG XQFRYHUV SURE
OHPV HDUO\ LQ WKH GHVLJQ HQDEOLQJ LWHUDWLYH UHGHVLJQ ³ XQOLNH )+0
ZKLFK RIWHQ FRPHV WRR ODWH LQ WKH GHYHORSPHQW F\FOH WR SHUPLW PRUH WKDQ
KDFNDQGSDWFK
  5HFHQW ZRUN E\ *XSWD DQG *OLJRU VXJJHVWV D WKHRU\ RI SHQHWUDWLRQ
UHVLVWDQW V\VWHPV 7KH\ FODLP WKHLU PHWKRG LV ´D V\VWHPDWLF DSSURDFK WR
SHQHWUDWLRQ DQDO\VLVµ WKDW ´HQDEOHV WKH YHULILFDWLRQ RI SHQHWUDWLRQ
UHVLVWDQFH SURSHUWLHV DQG LV DPHQDEOH WR DXWRPDWLRQµ >*837$
*837$@ 7KH\ VSHFLI\ D IRUPDO VHW RI GHVLJQ SURSHUWLHV WKDW FKDUDFWHU
L]H UHVLVWDQFH WR SHQHWUDWLRQ LQ WKH VDPH IUDPHZRUN XVHG WR VSHFLI\ WKH
VHFXULW\ SROLF\ HQIRUFHPHQW PRGHO ³ D VHW RI GHVLJQ SURSHUWLHV D VHW RI
PDFKLQH VWDWHV VWDWH LQYDULDQWV DQG D VHW RI UXOHV IRU DQDO\VLV RI SHQH
WUDWLRQ YXOQHUDELOLW\ )LYH SHQHWUDWLRQUHVLVWDQFH SURSHUWLHV DUH GH
VFULEHG

     V\VWHP LVRODWLRQ WDPSHUSURRIQHVV
     V\VWHP QRQFLUFXPYHQWDELOLW\ QR E\SDVV
     FRQVLVWHQF\ RI V\VWHP JOREDO YDULDEOHV DQG REMHFWV
     WLPLQJ FRQVLVWHQF\ RI FRQGLWLRQ YDOLGDWLRQ FKHFNV DQG
     HOLPLQDWLRQ RI XQGHVLUDEOH V\VWHPXVHU GHSHQGHQFLHV

   *XSWD DQG *OLJRU FRQWHQG V\VWHP IODZV ´DUH FDXVHG E\ LQFRUUHFW LP
SOHPHQWDWLRQ RI WKH SHQHWUDWLRQUHVLVWDQFH SURSHUWLHV >WKDW@ FDQ EH LGHQ
WLILHG LQ V\VWHP HJ 7&% VRXUFH FRGH DV SDWWHUQV RI LQFRUUHFWDEVHQW
YDOLGDWLRQFKHFN VWDWHPHQWV RU LQWHJUDWHG IORZV WKDW YLRODWH WKH LQWHQGHG
GHVLJQ RU FRGH VSHFLILFDWLRQVµ 7KH\ IXUWKHU LOOXVWUDWH KRZ WKH PRGHO FDQ
EH XVHG WR LPSOHPHQW DXWRPDWHG WRROV IRU SHQHWUDWLRQ DQDO\VLV 7KH\ GH
VFULEH DQ $XWRPDWHG 3HQHWUDWLRQ $QDO\VLV $3$ WRRO DQG WKHLU H[SHUL
PHQWV ZLWK LW RQ 6HFXUH ;HQL[ VRXUFH FRGH (DUO\ UHVXOWV IURP WKLV ZRUN
LQGLFDWH WKDW SHQHWUDWLRQ UHVLVWDQFH GHSHQGV RQ PDQ\ SURSHUWLHV EH\RQG
WKH UHIHUHQFH PRQLWRU LQFOXGLQJ WKH GHYHORSPHQW DQG SURJUDPPLQJ HQYL
URQPHQW ZKLFK LV FKDUDFWHUL]HG DV WKH HYLGHQFH LPSOLFDWLRQ FKDLQ HDUOLHU
LQ WKLV HVVD\ $OWKRXJK OLPLWHG RQO\ WR VRIWZDUH DQDO\VLV RI DWWDFNV RQ WKH
7&% IURP XQWUXVWHG XVHU FRGH DQG OHDYLQJ VLJQLILFDQW RWKHU V\VWHP DYH
QXHV IRU DWWDFN WKH ZRUN PD\ SDYH WKH ZD\ IRU QHZ DSSURDFKHV WR
EXLOGLQJ DQG WHVWLQJ WUXVWHG V\VWHPV DQG WLS WKH EDODQFH LQ IDYRU RI WKH
´JRRG JX\Vµ

  $XWRPDWHG DLGV (DUOLHU LQ WKH LQIDQF\ RI SHQHWUDWLRQ WHVWLQJ LW ZDV
EHOLHYHG WKDW IODZV ZRXOG IDOO LQWR UHFRJQL]DEOH SDWWHUQV DQG WRROV FRXOG
EH EXLOW WR VHHN RXW WKHVH JHQHULF SDWWHUQV GXULQJ SHQHWUDWLRQ WHVWLQJ
>$%%2 &$5/ +2// 75$7@ 8QIRUWXQDWHO\ WKH ODUJH QXPEHU



3HQHWUDWLRQ 7HVWLQJ                                                    
RI GLIIHUHQW SURFHVVRUV RSHUDWLQJ V\VWHPV DQG SURJUDPPLQJ ODQJXDJHV
XVHG WR EXLOG 7&%V ZLWK WKHLU GLIIHUHQW V\QWD[ DQG VHPDQWLFV PDGH LW
GLIILFXOW DQG LPSUDFWLFDO WR DSSO\ VXFK SDWWHUQPDWFKLQJ WRROV WR SHQH
WUDWLRQ WHVWLQJ ,W LV FRVWO\ WR SRUW RU UHLPSOHPHQW WKH WRROV IRU HDFK QHZ
HQYLURQPHQW DQG GLIIHUHQW SURJUDPPLQJ ODQJXDJH $OVR WKH IODZ SDWWHUQV
WHQGHG WR EH V\VWHP VSHFLILF
   $V PRGHUQ VHFXUH V\VWHPV IRFXV RQ D IHZ RSHUDWLQJ V\VWHP VWDQGDUGV
IRU H[DPSOH 8QL[ DQG 06'26 DQG IHZHU SURJUDPPLQJ ODQJXDJHV $GD
DQG & DQG PRUH PDWXUH H[SHUW V\VWHPV EHFRPH DYDLODEOH IXWXUH SHQH
WUDWLRQ WHVWLQJ WRRO LQLWLDWLYHV WR FDSWXUH IODZ SDWWHUQV PD\ EH PRUH VXF
FHVVIXO $ IHZ VSHFLILF H[DPSOHV RI WKLV WUHQG DUH EHJLQQLQJ WR DSSHDU
DQWLYLUXV WRROV IRU WKH SRSXODU ZRUNVWDWLRQV DQG 3&V 8QL[ VHFXULW\ WHVW
WRROV >)$50D 08))D@ LQWUXVLRQ GHWHFWLRQ PRQLWRUV >'(11
60$+ %$8( ',$6 /817 :,1.@ DQG IRUPDO VSHFLILFDWLRQ
SURRI WRROV >.(00@ IORZ DQDO\]HUV >(&.0 .5$0@ DQG V\PEROLF
H[HFXWLRQ WRROV >(&.0 :+((@




                                                     ,QIRUPDWLRQ 6HFXULW\
3HQHWUDWLRQ 7HVWLQJ   
3HQHWUDWLRQ 7HVWLQJ   

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:2
posted:10/20/2011
language:English
pages:31