Microsoft Storage Solutions Overview DuWayne Harrison Senior Storage Technology Specialist firstname.lastname@example.org Agenda Introduction R2 Overview Service Pack 1 Changes Print Servers in R2 Storage Management Features in R2 DFS in R2 Windows Storage Server 2003 R2 Microsoft System Center Data Protection Manager 2006 (DPM) Helpful Collateral R2 Overview Windows Server 2003 Update Codename “R2” Customer Benefits Predictable & Easy to Consume Built on Windows Server 2003 SP1 Identical servicing, app compatibility etc. Security, reliability and performance enhancements Integration of key Feature Packs (e.g. Windows Sharepoint Services) Simplified Branch Server Management Streamlined Access Management Across Security Boundaries Efficient Storage Management Availability and Licensing R2 replaces original WS03 release (R2 components optional) No charge for servers covered by SA/EA Available as new server license for non-SA Windows Server 2003 CALs required (no R2 specific version) Same support lifecycle as WS03 Service Pack 1 Changes Windows Server 2003 SP1 Storage Enhancements Volume Sizes Basic or dynamic volume size: 264 blocks = 273 bytes (too big to pronounce) Maximum NTFS file system size that can be realized on Windows: 256 TB Volume Shadow Copy Services Volume Revert Allows administrator to revert an entire volume back to a previous snapshot Access-based Enumeration Makes visible only those files or folders that the user has the rights to access VSS - Volume Revert Pre-SP1 SP1 - with Volume Revert Access-based Enumeration Makes visible only those files or folders that the user has the rights to access Info available at “Windows Server 2003 Access-based Enumeration” http://www.microsoft.com/downloads/detail s.aspx?FamilyID=04A563D9-78D9-4342- A485- B030AC442084&displaylang=en#filelist Access-based Enumeration What you see without What you see with Access-based Enumeration How do you enable it? Entire server (at install time) Share by Share Storage Changes in SP1 Support for large volumes Includes support for GUID Partition Table (GPT) Disks on all platforms (new for x86 and x64) Windows Server 2003 will now support LUNs> 2TB FC, iSCSI, RAID, SCSI, SAS Maximum NTFS file system size: 256 TB NOTE: There are may trade-offs with larger LUNs…be aware: chkdsk, defrag, backup and recovery can suffer Various Updates Miniport Updates- Support for storage tracing infrastructure Storport Updates- Enhanced reliability and scalability Storage Changes in SP1- Continue HBAAPI inbox SNIA-compatible API (hbaapi.dll) – no vendor DLLs required All inbox miniports updated to support this WMI schema exposed for native management FCInfo tool available for download Updated FC logo requirements SCSI compliance HBA API support using WMI SAS Logo Program Cluster Improvements Quorum corruption bugfixes in SP1 iSCSI Support (no code change required) Setup bugfixes for conflicting SCSI addresses Unique ID (Post SP1 QFE) Print Servers in R2 PMC Target Scenarios General system management (print servers, print queues) Research shows IHV tools will get used for printer-specific troubleshooting or helpdesk scenarios Support all network connected printers Manage Win2k and later print servers Scale to 100’s of servers and 1000’s printers Low bandwidth usage for WAN scenario Provide a new view and manageability on existing interfaces Console creates no new interfaces Consolidated print server management Push printers to machines or users through group policy Vendor extensions targeted post-Longhorn PMC Printers Node - Screenshot PMC Printers Node All printers across all print servers Rich status tab in screenshot replaced by tab that shows embedded web page of printer Status information will be delivered through the bi-di APIs Create filtered folders for notifications Can deploy printer connections from this view PMC Servers Node - Screenshot Auto-Discovery of Printers Simple discovery for single-subnet branch offices Pings the subnet and uses TCPMon.INI file to find 1284 ID of printer Automatically installs or prompts for driver Storage Management Features in R2 Storage Management Scope Component Windows Tool Asset Management • Fibre Channel (FC) Information Tool Manage, track and maintain physical (hardware) and logical (volumes, • Virtual Disk Service (VDS) files, I/O etc) storage information Capacity Management • File Server Resource Manager Disk and volume space information Charge-Backs support through File Server • Indirect Provides customer billing for storage costs Resource Manager Configuration Management • VDS Configures physical storage systems • Storage Manager for SANs for SAN management • Storage tracing Data and Media Migration • File Server Migration Toolkit Allows data movement from different media types Event Management • Microsoft Operations Manager (MOM)* Administrator notification of storage problems • FC Information Tool Performance & Availability Management • MOM* Application, server, & subsystem information Policy Management Server Resource Manager (file • File Sets and enforces policies for systems and users screening) Quota Management • File Server Resource Manager Manages storage usage Media Management -- Provides information about removable media storage * Through hardware vendor pack. Storage Manager for SANs : Functionality A SAN GUI provisioning application Leverages Virtual Disk Service (VDS) infrastructure Allows Windows administrators to perform basic array and LUN management Target audience: small-scale SANs built from simplified hardware Storage Manager for SANs is a MMC snap-in enabling the following high level operations: Discovery of storage arrays on a Fibre Channel or iSCSI SAN, including storage array properties, such as firmware info Creation, deletion and expansion of storage array LUNs Specification of LUN options, such as RAID levels Allocation of LUNs to specific servers on the SAN Monitor LUNs, including status/health and allocation to servers Using VDS, integrates iSCSI, iSNS, MPIO, HBA API, and local storage management Storage Manager for SANs : User Interface LUN Management Storage Manager for SANs : User Interface Assign LUNs to server DFS in R2 Replication Feature Summary Win2k3 Win 2000 Win 2003 Win2k3 R2 SP1 Replication FRS FRS FRS DFS Replication Topology reuse No No No Yes Yes (Cross-File on RDC No No No Enterprise Edition) Bandwidth Throttling No No No Yes Schedule granularity 1 hour 1 hour 1 hour 15 minute Scalability 200 200 200 ~1000 (Connections) Scalability (Files) 250k 250k 250k No Hard limit Auto-recovery No No No Yes Admin Delegation No No No Yes Namespace Feature Summary Win2k3 Win 2000 Win 2003 Win2k3 R2 SP1 Failover Yes Yes Yes Yes Yes (with Yes (with Yes (with Win2k3 Closest site referral No Win2k3 DC) Win2k3 DC) DC) Root Scalability No Yes Yes Yes Yes Yes Yes (Enterprise Multiple Roots No (Enterprise (Enterprise Edition) Edition) Edition) Yes (with Failback support No No Yes (with client QFE) client QFE) Admin Delegation No No Yes Yes Target Priority No No Yes Yes DFS Management Feature Summary Win2k3 Win 2000 Win 2003 Win2k3 R2 SP1 Yes Yes Yes Namespace Command Yes (DFSUtil, (DFSUtil, (DFSUtil, (DFSUtil, Line Configuration DFSCmd) DFSCmd) DFSCmd) DFSCmd) Replication Command No No No Yes (DFSRCmd) Line Configuration Replication only Yes (DFS Mgmt No No No Configuration Snap-in) MOM and In-the-box Replication Monitoring Ultrasound Ultrasound Ultrasound reporting Namespace Monitoring No MOM MOM MOM Distributed Distributed Distributed Namespace DFS Management File System File System File System Configuration UI Snap-in Snap-in Snap-in Snap-in Enabling Technology Remote Differential Compression (RDC) Only send minimal deltas when transferring data over a network No local change tracking required Can use similar files for seeding RDC efficiency examples: Change title in a 3.5-MB PowerPoint file, resync takes just 16 K Connection Type Save full 3.5MB ppt Save with RDC 56 kbps modem 10 minutes 3 seconds 500 kbps DSL 70 seconds <1 second Monitoring DFS in R2 Built-in reporting HTML report Generated on demand Windows Storage Server 2003 R2 Windows Storage Server R2 Customer challenges Storage Consolidation to reduce the number of Servers Direct attached Storage is inefficient for enterprise need SAN is complicated and not easy to deploy Goal Dedicated file and print server based on Windows Server™ 2003 R2 that is designed for dependability, seamless integration, and best value in networked storage Key Benefits Single Instance Storage Text based search Optimized file serving Key Enablers Dedicated appliance form factor Best Economics – CAL less server Ease of Use Integrates into existing infrastructure What is unique about Windows Storage Server 2003 R2? There are three key differentiating features that are available ONLY in Windows Storage Server 2003 R2: File Server Performance Optimization Single Instance Storage Index Based Search Single Instance Storage Single Instance Storage (SIS) Previously available in Windows 2000 Server and Windows Server 2003 only with RIS Generally available in Windows Storage Server 2003 R2 Standard Edition and Enterprise Edition Single Instance Storage Reduces disk space consumption SIS enabled volume are scanned for duplicate files. Duplicate files are moved to SIS Common Store and replaced with reparse points Transparent to the End User Backup applications with support for SIS include Veritas Backup Exec CA ArcServe CommVault Galaxy Index based Search Common customer feedback – “I not only want to put files on my file servers, I want to be able to search them as well” Indexing engine already part of Windows Server Updated in Windows Storage Server 2003 R2 to facilitate fast and effective index based search on network shares Leverages Search function built into XP and 2000 Supports Microsoft Office applications OOB Filters are available for many other file formats, including: Visio, Project, PDF, ZIP, AutoCAD, Macromedia Flash, WordPerfect. MP3, XML, RTF Microsoft System Center Data Protection Manager 2006 (DPM) Solutions with DPM Disk to Disk to Tape within data center Active Directory Clients File Servers DPM Tape Library Server Rapid & Reliable Recovery Recover Files in Minutes No More Failed Recoveries Enable End Users Recoveries Efficient & Near Continuous Protection Eliminate the Backup Window Shrink potential data loss down to 1 hour Operational Simplicity Protect Your File Servers in Minutes Industry Standard Hardware & Software DPM “Under The Hood” DPM Server Agent components: Synchronization File System Filter: runs in kernel mode “Pull” model, synchronizations instigated by DPM File Agent service runs in user mode Asynchronous replication Requires reboot of file server Two communication channels Each protected volume has Control commands - DCOM synchronization log Data movement - DPM proprietary protocol Synchronization log 10% of volume size Replication unit of operation is protected volume Agent overhead 3-5% Check points: 2 min/10 MBs Byte level replication Consistency Check DPM Engine Unexpected events create need to .NET application (managed code) resync replica Application state and configuration data Consistency Check does two things stored in SQL Checks file by file for more recent Protected data stores: modified times Replica Area is a mounted volume that is If changed, all blocks associated with made up of replica of protected volume and file are check summed and appropriate the diff area blocks are replicated to DPM server Transfer Area is an unmounted volume that All open files are check summed contains the spill log irregardless Non-blocking, distributed architecture How DPM Works Active Directory Easy to use wizards End user recovery Backup validation Restore servers and shares Multiple recovery points Easy, flexible scheduling Clients File Servers DPM Tape Library Servers DPM Server: Auto-discovery Windows Server 2003, Windows Server 2003 SP1, Windows Server Scheduled discovery job 2003 R2, Windows Storage Server 2003, Windows Storage Server 2003 Queries AD for new servers SP1, Windows Storage Server 2003 R2 Protects Windows Server 2003, AD, SQL, Reporting Services Windows Server 2003 SP1, Windows Lots of disks (2.5X) Server 2003 R2, Windows Storage VDS Server 2003, Windows Storage Server 2003 SP1, Windows Storage Server Installed parallel to tape 2003 R2 How does it work? Customer Scenarios Agents track and synchronize data from production End User Recovery (via DPM servers to DPM client) Snapshots created for quick recovery IT Admin can restore entire servers, volumes, shares Helpful Collateral Resources/Tools Data Protection Manager Website www.microsoft.com/dataprotectionmanager Data Protection Manager Trial Software http://www.microsoft.com/windowsserversystem/dpm/evaluation/t rial.mspx Microsoft System Center Data Protection Manager 2006 Management Pack for Microsoft Operations Manager 2005 http://www.microsoft.com/downloads/details.aspx?FamilyID=63a c06e6-c178-445f-b126-290d9abc283c&displaylang=en Data Protection Manager MOM Management Pack Guide http://www.microsoft.com/technet/prodtechnol/mom/mom2005/m aintain/5560e32e-8496-420f-aa74-473b5b6c155f.mspx Course 2952: Deploying and Managing Microsoft® System Center Data Protection Manager https://www.microsoftelearning.com/eLearning/offerDetail.aspx?o fferPriceId=73476 KB Articles How to upgrade to Microsoft System Center Data Protection Manager 2006 http://support.microsoft.com/default.aspx?scid=kb;en-us;908180 You may receive an "Access Denied" error message when you use the synchronization with consistency check feature in Data Protection Manager and you are running Windows Server 2003 http://support.microsoft.com/default.aspx?scid=kb;en-us;906881 How to use Microsoft System Center Data Protection Manager 2006 to help protect an Exchange server http://support.microsoft.com/default.aspx?scid=kb;en-us;909644 How to use Microsoft System Center Data Protection Manager 2006 to help protect a SQL Server database http://support.microsoft.com/kb/910401/en-us How to use System Center Data Protection Manager (DPM) 2006 to help protect Windows SharePoint Services and Office SharePoint Portal Server 2003 http://www.support.microsoft.com/kb/915181 Whitepapers Using Data Protection Manager with Commvault QiNetix http://www.microsoft.com/windowsserversystem/dpm/techresourc es/commvault.mspx Using Data Protection Manager and Windows Backup http://www.microsoft.com/windowsserversystem/dpm/techresourc es/winbackup.mspx Using Data Protection Manager and Yosemite Backup http://www.microsoft.com/windowsserversystem/dpm/techresourc es/yosemite.mspx Using Data Protection Manager with Veritas BackupExec http://www.microsoft.com/windowsserversystem/dpm/techresourc es/backupexec.mspx Documentation DPM Planning and Deployment Guide http://www.microsoft.com/technet/prodtechnol/dpm/proddocs/PD GTop.mspx Data Protection Manager 2006 FAQ http://www.microsoft.com/technet/prodtechnol/dpm/proddocs/faq. mspx Operations Guide: Archiving and Restoring Data http://www.microsoft.com/technet/prodtechnol/dpm/proddocs/opg daard.mspx Press Releases Calling for Backup: Microsoft System Center Data Protection Manager Provides Low-Cost Data Recovery http://www.microsoft.com/presspass/features/2005/jul05/07- 08DataProtectionManager.mspx Microsoft Launches System Center Data Protection Manager as Part of Its Universal Distributed Storage Vision http://www.microsoft.com/presspass/press/2005/sep05/09- 27SCDPMLaunchPR.mspx Case Studies New York City Department of Sanitation Municipality Reduces Backup Time by 96 Percent, Gives Users File Restore Capabilities https://members.microsoft.com/customerevidence/search/Eviden ceDetails.aspx?EvidenceID=13404&LanguageID=1&PFT=Micros oft%20System%20Center%20Data%20Protection%20Manager& TaxID=26011 Des Moines Public Schools Metropolitan School District Expects to Cut Data Protection Costs by 94 Percent https://members.microsoft.com/customerevidence/search/Eviden ceDetails.aspx?EvidenceID=13300&LanguageID=1&PFT=Micros oft%20Windows%20Server%202003&TaxID=20106 San Francisco Unified School District School District Adopts New File Backup System, Expects to Save $100,000 https://members.microsoft.com/customerevidence/search/Eviden ceDetails.aspx?EvidenceID=13314&LanguageID=1&PFT=Micros oft%20System%20Center%20Data%20Protection%20Manager& TaxID=26011 Case Studies Global Media Company Global Media Company Expects 95 Percent Consolidation of File Server Backups https://members.microsoft.com/customerevidence/search/Eviden ceDetails.aspx?EvidenceID=13405&LanguageID=1&PFT=Micros oft%20System%20Center%20Data%20Protection%20Manager& TaxID=26011 Improving Backup Services at Microsoft using Data Protection Manager http://www.microsoft.com/downloads/details.aspx?FamilyId=D12 A577E-162D-4DBD-A546-D4362FE1F9C6&displaylang=en © 2003-2004 Microsoft Corporation. All rights reserved. This presentation is for informational purposes only. Microsoft makes no w arranties, express or implied, in this summary.