Jeff murray

Document Sample
Jeff murray Powered By Docstoc
					Quality Engineering in
  Microsoft Office


      Jeffrey Murray
 Test Manager PowerPoint,
  Microsoft Silicon Valley
Microsoft Silicon Valley
• Over 1600 employees, plus 400 vendors/contractors. Approx 450
  employees in San Francisco.

• Teams on campus:
   –   Microsoft Research
   –   Windows Live Operations
   –   Live Search Labs
   –   MSTV/IPTV/Mediaroom
   –   Tellme
   –   MSN Mobile
   –   MSN Video
   –   Xbox Hardware
   –   Hotmail
   –   MacBU
   –   PowerPoint
Goals for today

• Learn about the Office product cycle

• Career Tips

• Fun Stories
About Me




 1990               Internal tools   Windows           Office
 Graduated           Tester of no    • Arabic/Hebrew   • Word97,XP,2000
 SUNY Albany        compile tools      Windows 3.1     • OneNote 2003
 • BS in Computer                    • Japanese        • Outlook 2007
   Science and      Bug tracking       Windows 95      • PowerPoint 14
   Mathematics          tools
 • Straight to
   Microsoft          Common
                     Dialog tools
What Challenges face Office?
Office Challenges




                                        Hiring and
World Wide   Users want     New
                                         Retaining
deployment     more!      Competitors
                                        great talent
    Basic Project Management
            Variables

• Time
  – How much time do we have?
• Resources
  – Who are they and how many?
• Scope
  – What are you going to do and how risky is it?
The Cast


                           Software
                          Development
                           Engineer




             Software
           Development                   Program
            Engineer in                 Management
               Test
Scope – What Features?

• Feature team makes the decisions
  – Must align with Office “Pillars”
  – Must fit into allowed development time
  – Must be fully resourced
• Management will approve features via
  – Adds/Cuts
  – Product priorities and opportunities
  – Manage risk
     Office Schedule is fixed to
           28-32 Months

4 weeks of planning followed by 12 weeks of design


12 weeks dev + 12 weeks of testing (x3 milestones)


              2 betas 10 weeks each


                RTM 8-16 weeks
 Overlapping for Efficiency
           Milestone 1



Planning      Coding     Validation



                              Planning   Coding        Validation




                                         Milestone 2
    Product Cycle Resource Utilization




                         Planning
                           17%




Testing
 52%
                                Coding
                                 31%
Quality Engineering 1990-1993

     Over the wall
     Black box
     VCR
Testing grows up ~1993-2000
Big Button – can the dev check in?


   BVT – Release the build to testing?

       Acceptance – Does my feature work
       enough to continue

           Performance – Key sign of something
           major wrong

              Comprehensive -- All tests possible
Pushing Quality Further
Upstream 2000+

•   Testers involved in spec and design phase
•   Feature not “checked in” till beta quality
•   More formal review of test/dev collateral
•   Code reviews earlier in product cycle
•   Advancement in dev tools and auto
    validation programs
                                 Automation
When are you ready to ship?      Performance
                                 Accessibility
                                 International
                                 Localization
•   Your set of risky features need to be under control
                                 Planned testing
                                 Stress
•                                  doing the
    Statistics and trends are allUser Scenarios right thing
•   Checklists                   Backward compatibility
                                 Configuration
•   Bug Charts                   Interoperability
                                 Political sensitivity
•   Dogfood                      UA approval
•   Watson                       Visual Freeze
                                 Programmability
•   Beta feedback                Printing
•   “Show Stopper”               Setup and Upgrade
                                 Code Optimization
•   Triage committee             Logo
Typical Office Product Bug Trend
Watson
       450,000               Example Watson Curve
       400,000
       350,000                                  1. We don’t have user steps or
                                                   data
       300,000
                                                2. We know what line of code
       250,000                                     caused the crash and can often
Hits




       200,000                                     guard against it
       150,000
       100,000
        50,000
            0
                 1 3 5 7 9 11 13 15 17 19 21 23 25 27 29 31 33 35 37 39 41 43 45 47 49
                                        Bucket number
Career Tips
• Companies are better at identifying talent within you than you
  are at picking the best company. Make sure you don’t hold back
  at an interview.
• Don’t plan your whole career all at once, you will miss out on
  interesting opportunities
• Use that open door
• You are a professional, act like it
• When you screw up (and you will) what you do next is critical
• Ask yourself each week, what do I like about my job?
• Interview the company beyond the job, a good part of your life
  will be there.
Stories
•   How I got my Job at Microsoft
•   Copy protection
•   Steve’s laptop
•   OneNote
•   Office pranks
    –   Elevator
    –   Beach
    –   Peanuts
    –   Disco
www.microsoft.com/college
www.viewmyworld.com

				
DOCUMENT INFO
Shared By:
Categories:
Tags:
Stats:
views:7
posted:7/20/2012
language:English
pages:21