Title: Tester: Product: Focus: Revisions:
DATA AGGREGATION TOOL Acceptance Criteria Dong Tran OCS Oasis Data Aggregation Tool Does tool perform minimum functionality necessary to synchronize multiple databases across a network or standalone via zip disks?
Test Assumptions: Windows 95 and Windows 98 only.
Functional Area
DB Patch
ID DBP001 DBP002 DBP003 DBP004 DBP005 DBP006 EAD001 EAD002
Spec ID
Business Rule Verify change to structure of table in Home Office Master propagates down to all replicas. Verify no changes at replicated table allowed to any replica that is not a Home Office Master DB. Verify deleting table at Home Office Master propagates down to all replicas. Verify unable to delete replicated table at all replicas that are not Home Office Master DB. Verify add new table at Home Office Master propagates new table down to all replicas. Verify add new table at Home Office Master propagates all subsequent changes in new table down to all replicas. Verify OASIS Repair & Compact Utility still works on replica database at Client site Verify OASIS Backup & Restore Utilities still work on replica database at Client site Verify OASIS Delete utility still works on replica database at Client site Verify OASIS Export utility still works on replica database at Client site Verify OASIS Run Reports still works on replica database at Client site Verify OASIS View/Edit Assessment still works on replica database at Client site Verify OASIS New Assessment still works on replica database at Client site Verify Import App still works on replica database at Client site Verify Verification DLL still works on replica database at Client site Verify DAT exclusive use check prevents other users from accessing system while DAT is processing Verify DATType can be switched between "Client", "Server", and "" (nothing) Verify PathDesignMasterRoot cleared for auto-prompt, or reset manually Verify LastAgencyID default at New Site Setup Wizard Verify PathXferLoc_NET_nnnnnn_zzz default for transfer out of brand new Network replica, and default for all upload and download synchronizations P/F P P P P P P P P P P F F F P P P P P P P
EAD003 External App EAD004 Dependencies EAD005 EAD006 EAD007 EAD008 EAD009 MUS001 INI001 INI002 INI003 INI004 INI File Tests
Multi-User Stability
Functional Area INI File Tests
ID INI005 INI006 INI007 INI008 INI009 BIZ001 BIZ002 BIZ003 BIZ004 BIZ005 BIZ006 BIZ007 BIZ008 BIZ009
Spec ID
Business Rule Verify PathClientRoot can be switched to nothing, or to bogus path without breaking the DAT Client Verify FileNameClient can be switched to nothing, or to bogus path without breaking the DAT Client Verify ClientAgencyID can be saved, re-used, and altered Verify ClientSiteID can be saved, re-used, and altered Verify FileXFer setting can be saved, re-used and altered Verify ability to enter data at multiple client sites and aggregate back up to central master database Verify contents of central master database must be able to be passed back down to client sites Verify ability to setup local NET replica for use as reporting mdb at Home Office Master (server) Verify ability not synchronize tables flagged as "N" in Replicate Actions table Verify ability to Upload & Download multiple sites in a row Verify ability to perform external operation between Upload and Download, and confirm changes are incorporated in Download back Verify Network replicas are transported one time to the Net drop point, and then only synchronized (up or down) thereafter Verify that Standalone replicas work by creating a transport replica which becomes the new OCSOASIS.mdb file during the initial Download from Server, Download from Client. Verify that Standalone replicas continue uploads and downloads by synchronizing and transfering (in and out) against a Full replica that lives on zip disk, exchanging changes between the Client and Server Verify that a laptop can be setup as a Network replica and uploads/downloads occur when attached to LAN (network) Verify Wizards are easy to use at Home Office Master Wizard Verify Wizards are easy to use at New Site Setup Wizard Verify Wizards are easy to use at Upload/Download Wizards Verify Wizards are easy to use at Setup Agency Site Wizard Verify all other forms and dialogs are easy to use/comprehend Verify NET site performance of 1,000 changed assessments at Client Upload to HOM in under 2-3 minutes; and then Download back to other full replicas in similar time frame Verify Standalone site performance of 1,000 changed assessments at Client Upload to HOM in under 5-6 minutes; and then Download back to other full replicas in similar time frame Verify ability to make a Full NET replica on HOM computer and use as a backup Verify that multiple synchronizations over time (of thousands of records changing) does not excessively bloat the replica mdb Do a quick test to see if existing Backup/Restore operations still work on replica mdb. If not, suggest stop using that feature. Verify /UPLOAD parm will force an upload event to occur for all Agency Sites Verify /DOWNLOAD parm will force an upload event to occur for all Agency Sites P/F P P P P P P P P P P P P P P P P P P P P P P P P P P P
Business Rules BIZ010 BIZ011 BIZ012 BIZ013 BIZ014 BIZ015 BIZ016 BIZ017 BIZ018 BIZ019 BIZ020 CMDLN001 Command Line Parameters CMDLN002
Functional Area ID Command Line Parameters CMDLN003 CMDLN004 CMDLN005 CONF001 CONF002 Setup CONF003 Configurations CONF004 CONF005 CONF006 GUI001 GUI002 GUI004 GUI005 GUI006 GUI007 GUI008 GUI009 GUI010 GUI011 GUI012 GUI013 GUI014 GUI015 GUI016 User Interface GUI017 GUI018 GUI019 GUI020 GUI021 GUI022 GUI023 GUI024 GUI025 GUI026 GUI027 GUI028
Spec ID
Business Rule Verify /NET parm (appended to /DOWNLOAD or /UPLOAD) will force only Networked Sites to be processed Verify /SITE aaaaaa sss parm will force only specific site to be processed Verify /NOCOMPACT parm skips the compaction after every upload or download Verify ability to network multiple OCS-OASIS apps to single NET replica mdb that is Full or Partial Verify ability to network multiple OCS-OASIS apps to single Standalone replica mdb Verify Networked replica moves data Verify Standalone replica moves data Verify Networked Laptop Sites Verify Standalone Laptop Sites P/F P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P P
D1 D1 MB1 F1B F1C D2 D3 D4 D4 MB4 F3B F3C F3C F3C F3D F3E F3E F3E F3F
Verify Initial Logon Form, DAT Client button Verify Initial Logon Form, DAT Server button Verify Setup Home Office Master Database Message Box Verify browse button for Source Database dumps selection into text box Verify browse button for Target Database dumps selection into text box Verify View:Site History loads up Notepad with event log text file Verify View:Options DAT Server pops up Options dialog so can change paths, etc. Verify Help:About DAT Server Parms are correct Verify Help:About DAT Client Parms are correct Verify Tech Support Phone Number at Message Box from Help:About Verify Max Length Agency ID @ New Agency Site Wizard, Step 2 Verify SiteID is locked @ New Agency Site Wizard, Step 3 Verify Max Length Site ID @ New Agency Site Wizard, Step 3 Verify SiteID "Unlock" override enables editing SiteID @ New Agency Site Wizard, Step 3 Verify Synchronization Type option buttons work Verify ability to create Net site with filter = "Non-Filtered Partial Replica" Verify ability to create Net site with filter = "Filtered Partial Replica" Verify ability to create Net site with filter = "Full Replica" Verify Transfer Location path Verify Wizard's Cancel button Verify Wizard's Back button Verify Wizard's Next button Verify Wizard's Finish button Verify First Time Setup Client Message Box Verify Max Length Agency ID @ Setup Client Site Wizard, Step 2 Verify Max Length Site ID @ Setup Client Site Wizard, Step 3 Verify Auto-Setup AgencyID & SiteID via Browse button on Step 2
MB5 F6B F6C F6C
Functional Area
ID GUI029 GUI030 GUI031 BUG026
Spec Business Rule ID F6D Verify Client Database Location selection D6 Verify Change Client Database at Client Options Dialog D6 Verify Change Transfer Location at Client Options Dialog Verify Exclusivity Check at every Upload/Download Verify auto-click Download following New Site Setup wizard execution Verify that Temp tables marked for *no* synchronization do not generate conflict files Verify tables added to Home Office Master are automatically setup for Synchronization
P/F P P P P P P P
BUG065 Bug Additions BUG069 BUG070
87 Pass 3 Fail Untested 90 Total
ID
DBP001 DBP002 DBP003 DBP004 DBP005 DBP006
Details Alter Field Type, Field Size, and Field Name of various fields in Home Office Master table. All changes should be propagated to the replica next time a download occurs. Attempt to alter Field Type, Field Size, or Field Name of any replicable table in a NET replica, or Standalone replica. Create Full Replica on Network. Delete one replicated table at Home Office Master. Download HOM changes to Net replica. Check to ensure that table has been deleted on networked replica. Should not be able to delete any replicated tables at replica mdb. Create Full Replica on Network. Add one table at Home Office Master. Download HOM changes to Net replica. Check to ensure that table has been added on networked replica. (Note current bug is that table added defaulted replicable property = No….need to parse and set to yes every download synchronize.) Using table added above, make changes to data and see if propagates down to replicas.
EAD001
Create Full Replica on Network. Point client OASIS app to new Client NET replica mdb file. Run OASIS. Click Utilities button. Click Repair and Compact.
EAD002
EAD003 EAD004 EAD005 EAD006 EAD007 EAD008 EAD009 MUS001
Create Full Replica on Network. Point client OASIS app to new Client NET replica mdb file. Run OASIS. Click Utilities button. Click Backup button and follow instructions. Exit OASIS, put in a BLANK OCS-OASIS mdb file (ensure all data gone) and re-run OASIS. Click Utilities button. Click Restore button and follow instructions. All data should be restored over top of blank database. Not as important if it fails because clients should stop using these utilities and use the DAT instead. Create Full Replica on Network. Point client OASIS app to new Client NET replica mdb file. Run OASIS. Click Utilities button. Click Delete Assessment. Choose assessment and follow instructions. When done deleting, perfom and Upload at the HOM. Expected Results: record should be deleted both from Client site, and from Home Office Master (due to upload). Create Full Replica on Network. Point client OASIS app to new Client NET replica mdb file. Run OASIS. Click Utilities button. Click Export button. Follow instructions (try a few variations of this test case via options at this step). Expected Results are that records meeting criteria selected in Export Tool will be placed in HCFA formatted text file. Run OASIS app against Network replica. Click Run Reports button. Run one of each report. Use same database before converted to replica and print out same reports. Compare both batches of reports to ensure they are identical. Run OASIS app against Network replica. Click View/Edit Assessment. Select patient. Enter or edit data. Click Verify Assessment. Print Verification, etc. Run OASIS app against Network replica. Click New Assessment. Enter or edit data. Click Verify Assessment. Print Verification, etc. Run Import app on Client replica mdb. Try a few variations (whatever is available). May be redundant because Import Tool uses this DLL. Included here just to ensure it gets tested. Run multiple OASIS apps against same client database. Then, attempt to upload the data while the OASIS apps are running reports, doing data entry and verification, etc.
INI001 INI002 INI003 INI004
Changing to "Server" will force DAT Server to come up (New Site Setup button present). Changing to "Client" will force DAT Client to come up (*no* New Site Setup button present). Changing to "" will force the Logon dialog box to popup, prompting user for Server or Client install type. Change INI setting for this parm to "" or bogus path and the app should prompt user to either create a new Home Office Master database, or pick the new (moved) location of the Home Office Master database. Note that you can also test by physically renaming the directory or mdb name and then running the app (it will recognize that Home Office Master has moved and prompt accordingly). Change this parm to a new Agency ID. Run DAT server. Click Add New Site. Goto Agency ID step and verify default value is new value entered at INI file. This is the one item in Options form that will be used the most; changing the default transfer paths of Network replicas, and the zip drive location for Standalone replicas.
ID
INI005 INI006 INI007 INI008 INI009 BIZ001 Similar to prevoius Acc.Crit.; however filename is altered to execute test.
Details Go into INI and change parm to "" or bogus entry; or rename the directory in which database exists. Next, run the DAT Client and look for it to prompt you for location of Client DB Path.
Setup Standalone DAT Client site (part of setup is question regarding AgencyID). Exit app then re-run and perform Download to confirm AgencyID is pulled from INI file (where just saved by setup wizard). Similar to prevoius Acc.Crit.; however SiteID is altered to execute test. Setup Standalone DAT Client site (part of setup is question regarding XferLocation). Exit app then re-run and perform Download to confirm XferLocation is pulled from INI file (where just saved by setup wizard). … … Create New NET Site, located on Home Office Masdet computer in OCSOASIS\database directory. Then run OCS-OASIS off of the freshly downloaded local Net Replica. Download data to 2 different NET sites. Run both OASIS appa on both NET mdbs and print reports to populate temp tables. Now, Upload both NET database and check if conflicts occurred (the conflicts should be ignored for all tables flaged "N" at ReplicateActions table). Do not yet know if just ignore conflicts, or if actively delete temp tables (because that would destory users work during Upload and Download process...force exclusive use only). Use multi-select at listbox when selecting sites to Upload and download. Perform an Upload . Run Data Export to State via OASIS app. Perform Download. Go verify that AssementVerification field values set by State Transfer are in fact downloaded back to the NET (or STA) sites.
BIZ002 BIZ003 BIZ004
BIZ005 BIZ006
BIZ007
Create new NET Site. Execute download and verify that it performs only a transfer out. Execute one upload, followed by one download. In both instances, verify that only a synchronization occurs (file extension in Agency directory under Home Office Master should be .DNL or .UPL; but never .OUT or .IN). … …
BIZ008
BIZ009
BIZ010
Create a NET replica and put it onto a laptop. Unplug laptop and run OCS-OASIS. Add records. Re-connect laptop to network. Attempt upload of laptop NET replica data. Check for changes at Home Office Master. … … … … … Create NET site replica from Home Office Master w/3,000+ records. Download. Use query to change about 1,000 of the records. Upload and time it to confirm if acceptable. Now, change record values back via query once have been uploaded. Download re-changed recs and time it. Confirm if time is acceptable. Create STA site replica from Home Office Master w/3,000+ records. Download. Use query to change about 1,000 of the records. Upload and time it to confirm if acceptable. Now, change record values back via query once have been uploaded. Download re-changed recs and time it. Confirm if time is acceptable. Create NET site at HOM computer. Do a download to populate it. Do a few upload/download cycles. Delete HOM database. Copy this backup NET Full replica DB into location of HOM database, including taking its name. Load new HOM database into Access. Click Replication menu item, and set Design Master flag = true (see Matt for non-code method...if it exists) Alternate Upload and Download cycles of a Full NET replilca (try partial replicas too). In between every Upload and Download, use update queries to change data and force thousands of recs to be synchronized. After 10-12 cycles, check mdb size to see how much it grew. If excessive, then bug and will need to re-implement compaction instead of relying on client user to do it (or show them how to schedule auto-compaction using Access97). Make NET site and download it. Make backup. Delete replica. Make restored copy. Run OASIS and test if it works. Run DAT upload / download cycle and see if it still works (be sure to actually change some data too). Click Start:Run. Enter: "C:\DAT\DAT.EXE /UPLOAD" and click enter. Confirm that Upload event occurs for all Agency Sites, that Standalone Sites are not a problem, and that DAT closes immediately after Upload occurs Click Start:Run. Enter: "C:\DAT\DAT.EXE /DOWNLOAD" and click enter. Confirm that Download event occurs for all Agency Sites, that Standalone Sites are not a problem, and that DAT closes immediately after Download occurs
BIZ011 BIZ012 BIZ013 BIZ014 BIZ015 BIZ016
BIZ017
BIZ018 BIZ019
BIZ020
CMDLN001 CMDLN002
ID
CMDLN003 CMDLN004 CMDLN005 CONF001
Details Click Start:Run. Enter: "C:\DAT\DAT.EXE /DOWNLOAD /NET" and click enter. Confirm that Download event occurs for ONLY Networked Agency Sites and that Standalone Sites are ignored. Click Start:Run. Enter: "C:\DAT\DAT.EXE /DOWNLOAD /SITE 123456 001" and click enter. Confirm that Download event occurs for ONLY Agency Site specified, and all others ignored. Click Start:Run. Enter: "C:\DAT\DAT.EXE /DOWNLOAD /NOCOMPACT" and click enter. Confirm that Download event occurs *but* Compact does not. Setup Networked replica. Install and run multiple OCS-OASIS applications on multiple computers all pointing the database path (in INI file) to this Networked replica.
CONF002 CONF003 CONF004 CONF005 CONF006 GUI001 GUI002 GUI004 GUI005 GUI006 GUI007 GUI008 GUI009 GUI010 GUI011 GUI012 GUI013 GUI014 GUI015 GUI016 GUI017 GUI018 GUI019 GUI020 GUI021 GUI022 GUI023 GUI024 GUI025 GUI026 GUI027 GUI028
Setup Standalone replica. Install and run multiple OCS-OASIS applications on multiple computers all pointing the database path (in INI file) to this Standalone replica. Create new NET site. Download it. Make changes. Upload it. Verify changes at Server. Make more changes. Download it. Verify changes at Client. Create new Standalone site. Download it. Make changes. Upload it. Verify changes at Server. Make more changes. Download it. Verify changes at Client. Create new NET site on laptop. Download it. Disconnect from network. Data entry. Reconnect to network. Upload it. Verify changes at Home Office Master. Do submission export to state (or just change data at Home Office Master). Download it. Confirm changes are now in laptop replica. Create new Standalone site on laptop. Download it via zip disk. Data entry. Upload it via zipdisk. Verify changes at Home Office Master. Do submission export to state (or just change data at Home Office Master). Download it via zip disk. Confirm changes are now in laptop replica. Set "DATType" key of DAT.INI = "" to trigger form to popup. Test client and verify setup occurs properly. Set "DATType" key of DAT.INI = "" to trigger form to popup. Test server and verify setup occurs properly. See previous Acc.Crit. After password, does message box popup prompting for confirmation of creating new HOM DB? Try hitting cancel first to confirm it terminates app. Re-run and hit Ok to continue this time. Run Home Office Master Wizard (by setting "DATType" key of DAT.INI = "") At Step 2 of wizard, click browse button and choose source mdb file. After click Open button, be sure file is placed into text box. Similar to above … Physically rename directory in which NET replica mdb exists. Run DAT Server. Click View:Options. Select the existing NET site in list box. Change the directory via browse button and re-point to newly renamed directory. Run DAT/Server. Click Help:About. Verify values for Setup="Server", DB Path, etc. Run DAT/Client. Click Help:About. Verify values for Setup="Client", DB Path, etc. Run DAT. Click Help:About. Click Tech Support. View message box contents. Verify phone number and text appears appropriate. Run DAT / Server. Click Setup New Site button. Goto Step 2. Enter as many digits as possible into text box. Should be limited to 6 digits. Step 3 of New Agency Site Wizard should have SiteID text box visible, but disabled. Execute Acc.Crit above for new Client Setup. At Wizard, Step #3, attempt to type more than 3 digits. At Step 3 of New Agency Site Wizard, click Unlock button. Should now be able to override default SiteID calculated by system. At step 4 of New Agency Site Wizard, try selecting Network. Then, create a new site and try selecting Standalone. Run DAT Server. Click Add Site. Make Networked site at step 4. At step 5 of New Agency Site Wizard, select Non-Filtered Partial replica. Finish site setup. Download new site. Change data at new net replica. Upload back to server. Confirm changes made below are brought forward to top during upload synchronization. Same as GUI16, except diff option at step 5. Same as GUI16, except diff option at step 5. Run DAT Server. Click Add Site. Goto step 6. Use browse button to pick a path. Path should automatically overwrite textbox contents. Attempt variety of paths on variety of drives…all should work. Any/All wizards have Cancel button. Clicking it should immediately close the wizard without ever making any database changes. Any/All wizards have Back button. Button should be disabled whenever at step 1 and enabled on any other step. Clicking Back should move to previous step in wizard. Any/All wizards have Next button. Button should be disabled whenever at last step and enabled on any other step. Clicking Next should move to next step in wizard. Any/All wizards have Finish button. Button should automatically flag any invalid or unaswered responses and not permit wizard to proceed. If all answers on wizard steps are acceptable, then wizard should do its thing. Erase entire DAT.INI file. Run DAT. Choose Client Install. Verify that message box pops up asking "Since this is the first time you have used DAT Client…" Execute Acc.Crit above for new Client Setup. At Wizard, Step #2, attempt to type more than 6 digits. Execute Acc.Crit above for new Client Setup. At Wizard, Step #3, attempt to type more than 3 digits. Execute Acc.Crit above for new Client Setup. At Wizard, Step #3, click the Browse button and look for the incoming Standalone replica on zip disk. After selecting the file, the Agency ID and Site ID should be autodefaulted in the text boxes.
ID
GUI029 GUI030 GUI031 BUG026 BUG065 BUG069 BUG070
Details Execute Acc.Crit above for new Client Setup. At Wizard, Step #4, click Browse button and select zip disk copy of Standalone replica downloaded from Home Office Master. Change the Client database path name. Run DAT/Client. Click View:Options. Click Client Database browse button to pick the new renamed path. Execute Download and Upload cycle with data changes to ensure everything converted okay. Run DAT/Client. Click View:Options. Click Transfer Location browse button to pick a different zip drive path (map to different zip drive on network). Execute Download and Upload cycle with data changes to ensure everything converted okay to new zip drive location. Run OASIS app against network replica database. Attempt to Upload and Download the Agency Site while the OASIS app is using the same database. Error trapping should prevent the Upload and Download from ever occurying. Run DAT Server. Create New Site. Verify that once new site is created, the Download button is clicked for that option, and the proper site is highlighted for Transfer Out. Run OASIS app against two different NET replicas. Run multiple reports and do a little data entry on each instance. Upload both sets of changes. Verify that no conflict files occur due to temp tables for reporting, etc. Add table to Home Office Master. Run Download and confirm that new table is automatically flagged for synchronization and ReplicateActions table value is prompted from user…default is Yes for full synch.
Pass 1 1 1 1 1 1 1 1 1 1
Fail
Un-tested
1 1 1 1 1 1 1 1 1 1
Pass 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Fail
Un-tested
Pass 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1
Fail
Un-tested
Pass 1 1 1 1 1 1 1 87
Fail
Un-tested
3