Test Plan for Stitcher (ICE – Image Composite Editor)
Introduction
This document is designed to be an overview of the ADT test strategies, plans, processes, and tools that will be used for the ICE project. It will also cover the centralized roles, provide links to related information. As the test strategies, plans, processes, and tools covered in this document are mandatory for ADT test team to execute and deliver, individual test plan should map closely to this document.
History\Overview:
The Stitcher project takes multiple pictures and allows good seamless stitching of the pictures into one picture. There also will be an app that allows the user to manage their pictures on an external store. It is planned to ship this and sell it on MS Marketplace.
ADT Devs \ Researchers Involved:
– – – – – – ADT dev – Niru C. ADT test – Darren, Rick and ThuVan Researcher – Behrooz Chitsaz Researcher RSDE Lead - Matt Uyttendaele Researcher RSDE - Bryan Ressler Researcher intern – Ran Tao
Summary of testing approach:
This app will need production level testing because it is will be a download that will be for sale.
Expected Timeline:
To Test – 8/13 To public MS – 9/7 RTM – 11/24/07 - 12/5/07 2/18/08 – first drop to test 3/10 – code complete drop 3/28 – internal beta release 4/30 – RTM 4/8 – Drop of Gallery Mid April – Feature Complete End April – Internal beta release 7/16 – available on Marketplace
ICE Schedule
Milestone Beta 1 CC Beta 1 Beta 2 CC Beta2 RTM
Start 1/8/2008 4//22/2008 6/01/2008 7/14/2008 8/11/2008
End 4/8/2008 7/14/2008 6/30/2008 7/30/2008 8/14/2008
Weeks 16 10 4 2
Notes
Testing Level:
(1) Thorough testing – shipped product level
Dev Deliverables:
1) Client stitcher app 2) ICE Gallery – app that manages external data store (PlanetEye, S3 and Deep Zoom)
Resources:
1) \\ibr-bigstore\panoramas -- a lot of panoramas 2) \\msrwebxiis\ICE -- build drop 3) Pixel Compare routine a. \\szeliski1\public\VideoMosaic 4) Images to test with a. \\ibr-bigstore\panoramas b. \\msrwebxiis\ICE\Pictures 5) Current stitcher available on http://msrweb/vision/ibr
General Notes:
When finally testing – check if app is dependent on hardware. Does it require Direct 3D graphics hardware or not? Good Test case: create the project and then modify is something else (Photoshop etc) then reopen in app Command line options Written in C++ ICE Galllery in C#
General Tests
Setup & Configuration Configuration testing will cover hardware & peripherals, client software (such as browsers and 3rd party packages), MS Logo compliance, 3rd party Network, and Web services (such as firewall, proxy, web servers). Performance/ Memory leaks/ Stress
A good performing application has other qualities that should be considered such as resource usage (especially RAM), scalability.. o Test team will provide a spread sheet result that will record the stitching and uploading time for 5 images, 10 images, 20 images, 40 images, 80 images, 100 imags, 150 image, 200 images, 300 images, 500 images. o Load 1 image, 5 images, 10 images, 20 images, 100 images to ICE Gallery Accessibility Testing will include functional testing run at an individual tester’s desk (such as keyboard access and high contrast testing) o High Contrast o High DPI o MSAA compliant Display o 800 x 600 Spell check Globalization o Change Locale o Maybe IME but so far doesn’t look like there are any edit fields that need to test Far East chars Error messages Integration Testing ADT test team will
Areas to be tested:
Install
1) 2) 3) 4) 64 big install \ 32 bit install Vista & XP Regsvr32 ShellExt.dll Compose Panoramas through Explorer
Stitcher Engine
Test Notes \ Ideas Reflections Lighting / B&W 100s of pictures at once Blurred pics All the different projections & Camera settings Many different file types in one stitching
Stitching Camera vs Projection Matrix
Camera Projection Perspective Cylindrical (Horizontal) Cylindrical (Vertical) Spherical (Horizontal) Spherical (Horizontal) Automatic
Rotating Motion
Planar Motion 1
Planar Motion 2
Planar Motion 3
Automatic
X X X X X
ICE GUI
Menus
File New Open Close Save Save As Export Panorama Exit Key Board Accelerator Keys \ Short cuts Open New Close Save Save As Export Panorama Help About MS Image Composite Editor F1
Ctrl +O Ctrl + N Ctrl + W Ctrl + S Ctrl +Shift + S Ctrl + E
Panorama Preview
Main preview window Test Notes\ Ideas: 1) Drag and drop images from 1 folder
2) 3) 4) 5) 6) 7) 8)
Drag and drop images from 1 folder with subfolders Drag and drop invalid format files Cancel Preview while reading, solving source images Different combinations of file types (.jpg, .bmp etc) Different file sizes Adding files through File Open Files from different sources (network, CD, hard drive, etc)
Crop Reset Crop Automatic Crop Fill in edges if needed Fill in text box Left Right
Top Bottom
Test Ideas: 1) Boundary 1 , 1 and beyond 2) Crop is off edge of boundary 3) Invalid numbers and chars (negatives etc) Export Save file name start with valid characters, numbers and invalid characters with following Type .jpeg .Adobe Photoshop .HD View Titleset .tiff .DeepZoon Titleset .Window Bitmap .PNG Image .HD Photo Image Create JPEG thumbnail check box Pixels in longest dimension text box Upload S3 * Silver light Deepzoom *S3 Amazon account information Go to https://aws-portal.amazon.com/gp/aws/developer/account/index.html/104-12134707904762?ie=UTF8&action=access-key Size 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100% 50%, 75%, 100%
User name: ADTS3@live.com Password: ADT_test OR User name: ADTS3_02@live.com Password: ADT_test Test Notes / Ideas: 1) All various file save type tests (to existing file, to network share, to drive that has no space etc)
ICE Gallery
Login page (valid and invalid key) Add Panorama (valid and invalid format) Open Delete Email Sort Help About Tags Add Tags Remove Tag Max length for tags: 16 Max tags to add to each panorama: 20 Duplicate name tag not allow Date Add Caption Max length for caption is 32 characters Description Max length for description is 256 characters Panorama Check for Date Taken and Uploading Time Size of the image Dimension of the image Save Error message Shortcut
Tester Environment
ADT test team will be supporting the same platforms that describe in the ICE help document
Component
Requirement
Operating system Microsoft Windows XP SP2 or later, or Windows Vista (Windows XP Professional x64 Edition is not supported.) Processor Memory Browser Minimum 800 MHz processor Minimum 256 MB of RAM (1GB recommended) Internet Explorer 6, or later
Internet connection Internet functionality requires dial-up or broadband Internet access (provided separately). Local or long-distance charges may apply. Display Minimum 800 x 600 screen resolution (1024 x 768 or larger recommended)
Builds \\msrwebxiis\ICE is the centralized drop point.