Deploying Oracle Maximum Availability Architecture
with Sun Oracle Database Machine and Oracle Exadata
Agenda
• Overview: Oracle Maximum Availability Architecture (MAA)
• MAA Best Practices for Sun Oracle Database Machine
2
Oracle High Availability
Design Principles
1. Scale-out model
• Low-cost, high-volume hardware
• All components active in a grid infrastructure
2. Application oriented
• Protect and recover application objects
• Enable online application changes
3. Integrated and simple
• Built-in HA with pluggable components
• Automate and eliminate manual processes
4. Complete
• Minimize all planned and unplanned downtime
• Offer a standard validated platform for maximum availability
3
Oracle’s Database HA Solution Set
Database Integration Unique in the Industry!
Server Real Application Clusters
Oracle MAA Best Practices
Failures
Unplanned Flashback
Downtime RMAN & Oracle Secure Backup
Data
ASM
Failures
Data Guard
GoldenGate / Streams
System Online Reconfiguration
Changes Rolling Upgrades
Planned Data
Changes Online Redefinition
Downtime
App Edition-based Redefinition
Changes
4
Real Application Clusters
Virtualize Low-cost Servers
HR SALES ERP
• Scale workloads across multiple low cost servers
• Consolidate into fewer servers and databases
• Runs all Oracle database applications
• Built-in HA to support mission critical workloads
5
Traditional
Flashback Technologies 80
Recovery
Error Detection & Correction
60
Recovery Time
• Flashback revolutionizes error recovery 40
• View ‘good’ data as of a past point-in-time
• Simply rewind data changes
20
Flashback
• Time to correct error equals time to make error 0
Correction Time = Error Time + f(DB_SIZE)
• Low impact, easy – simple commands, no complex procedure
• Flashback Query, Table, Transaction, Database, Drop
• E.g.: SQL> flashback database to ;
6
Oracle Backup & Recovery
Integrated Disk, Tape & Cloud Backup
Oracle Enterprise
Manager • Recovery Manager (RMAN) provides
the infrastructure for Oracle’s
Oracle Secure Integrated Backup & Recovery
Backup • Intrinsic knowledge of database file
formats and recovery procedures
RMAN • Block validation
• Online block-level recovery
• Unused block compression
• Online, multi-streamed backup
Tape Drive • Native encryption
• Multiple compression levels (11.2)
• Integrated disk backup: Fast
Fast Recovery Recovery Area
Area Cloud • Integrated tape & cloud backup:
Data Files
Oracle Secure Backup
7
Automatic Storage Management (ASM)
For Database and Clusterware Files
Database files Clusterware files
ASM
Exadata Storage Server Exadata Storage Server Exadata Storage Server
… … …
Failgroup1 Failgroup2 Failgroup3
Primary Mirror Disk Group
• Evenly distributes I/O
• Mirroring to protect against disk failures and corruption auto-repair
• Failure groups to protect against Storage Server failures
8
Built-in Protection from Data Corruptions
Comprehensive Data Validation
• Oracle Database has checks to detect and repair corruptions
• Detects corruptions in data and redo blocks using checksum validation
• Detects data block corruptions using semantic checks
• Detects writes acknowledged, but actually lost by the I/O subsystem
• Various levels of checks can be configured by the administrator
• Choose the desired protection level
• Can be configured for data blocks / data + index blocks
• Specific technologies provide additional validation
• RMAN – validating while doing backup & recovery
• ASM – validating using mirrored copies
• Data Guard – validating while synchronizing standby database
* “Hard Disk Drives – the Good, the Bad & the Ugly”, ACM Queue, Sep/Oct 2007,
http://queue.acm.org/detail.cfm?id=1317403
9
Oracle Data Guard
Best Data Protection
Active Data Guard
Standby Database
Sync / Async
Redo Transport
Primary
Database
Data Guard
• Data availability and data protection for the Oracle Database
• Up to thirty standby databases in a single configuration
• Auto-block media recovery
• Standby database used for queries, reports, test, or backups
10
Oracle GoldenGate
Best Information Integration
Capture: Committed changes are captured (and can be filtered)
as they occur by reading the transaction logs.
Trail files: Stages and queues data for routing.
Pump: Distribute data for routing to multiple targets.
Route: Data is compressed, encrypted for routing to targets.
Delivery: Applies data with transaction Read/Write
Read/Write Workload
Workload
integrity, transforming the data as required.
Pump
Source Trail LAN / WAN / Target Trail
Capture Internet Delivery
Pump (TCP/IP)
Source Target Trail Source Trail
Target
Database(s) Delivery Capture Database(s)
Bi-directional
11
Online Patching and Upgrades
• Most one-off patches can be applied to a running Oracle instance
• Linux-x86, Solaris 10, HP-UX 11i
• [New in 11.2] Windows 32-bit and Windows 64-bit, AIX v6.1 [TL2 SP1]
• More complex one-off patches can be deployed online using RAC
rolling patches (available 10g onwards). Clusterware and ASM
are rolling upgradeable.
• Database release/patchset upgrades, operating system upgrades,
platform migrations can be applied in rolling fashion using
Data Guard / GoldenGate / Streams
• Data Center moves / SAN migration / Technology Refresh etc.
can be done with minimal downtime using
Data Guard / GoldenGate / Streams
12
New in 11.2
Edition-based Redefinition
Enabling Online Application Upgrades
Post-upgrade Edition
• Maintains logical versions of changed database
objects, through:
• Edition
• Editioning View
• Crossedition Trigger
• Code changes installed in the privacy Crossedition
of a new edition Triggers
• New data changes made to new
columns/tables not seen by old edition Pre-upgrade Edition
• Editioning view exposes a private
projection of a table into each edition
• Crossedition trigger propagates changes made by
old edition into new edition’s columns, or vice-versa
13
Summarizing Oracle HA
• Oracle Database as the next-generation HA platform
Scalable Grid Clusters ……………………………………… RAC
DR with fast failover and production offload ……………… Data Guard
Active-active flexible replication …………………………... GoldenGate
Continuous Data Protection (CDP) ………………………. Flashback
Integrated volume management ………………………….. ASM
Data corruption protection …………… Checksum Validation plus more
Disk-to-Disk backup ……..…………… RMAN & Fast Recovery Area
Integrated tape & cloud backup …….………… Oracle Secure Backup
Minimal downtime planned maintenance ……. Rolling Upgrades
No downtime system changes ………………… Online Reconfiguration
No downtime application upgrades…………………..Online Redefinition
All these capabilities based on an integrated, modular software architecture
and lower cost, high-volume hardware components
14
Maximum Availability Architecture (MAA)
Low-cost, Fully Active, High ROI
Real Application Active
Clusters Data Guard
Secure Backups to
Disk, Tape or Data Guard
Cloud
Automatic Storage Management
Fast Recovery Area
15
Agenda
• Overview: Oracle Maximum Availability Architecture (MAA)
• MAA Best Practices for Sun Oracle Database Machine
16
Sun Oracle Database Machine
Resilient Grid Architecture
Extreme performance in a highly-available, highly-secure environment
• Best for Data Warehouse
• Best for OLTP Oracle Database Server Grid
• Best for consolidation • 8 high-performance RAC
compute servers
• Protection from server failures
Exadata Storage Server Grid
• 14 high-performance storage servers
• 5TB flash storage InfiniBand Network
• Fault tolerance for both cell and disk
• 40 Gb/sec fault-tolerant unified
failures using ASM redundancy
server and storage network
• Exadata storage built-in corruption
• Multiple switches for HA
checks
• Redundant ports on Host
Channel Adapters
17
Oracle MAA with Database Machine
Complete, Open, Integrated, Highly Available
Real Active
Application Data Guard
Clusters
WAN
ASM
Fast Oracle Secure
Backup
Recovery Area
• Comprehensive protection from failures: server, storage, network, site, corruptions
• Correction from human errors: database, table, row, transaction
• Active Disaster Recovery: Real-time remote standby open for query offload
• Online indexing and table redefinition
• Online patching and upgrades with Exadata, ASM, Clusterware, RAC, Data Guard
and GoldenGate
18
MAA Best Practices
On Sun Database Machine and Exadata
• Oracle is Oracle
• Use all MAA Best Practices
• Some additional best practices apply
• To take advantage of superior
capabilities of the Database
Machine
19
MAA Best Practices
• ASM, Flashback, Corruption Protection
• Backup and Recovery, Oracle Data Guard
• Data Warehouse
• Patching and upgrades
• Wrap-up & resources
20
ASM Disk Group
Configuration Best Practices
• Standard Protection Disk Group
• DATA – normal redundancy
• Data files only (OUTER)
• RECO – high redundancy
• One controlfile, online redo logs (1 member), archives, flashback logs,
spfile, voting disks and OCR
• Tolerates multiple non-partner disk failures or a cell failure without
incurring downtime
• If double partner disk or double cell failure occurs, then database can be
restored from tape and full recovery with zero data loss is achievable
21
Flashback for all Applications
Configuration Best Practices
• Enable Flashback Database
• Minimum impact to OLTP workloads ( 1 TB/hour
• Before the Oracle Database Machine, insufficient I/O and network
bandwidth meant that Data Warehouse ETLs or batch loads were
often done with nologging, noarchivelog and with flashback database
disabled
• Backups of large Data Warehouses must complete in less
than 12 hours
• Implications:
• Archivelog mode and logging is a requirement for Oracle MAA
solutions such as Data Guard
• Oracle Recovery Manager must be able to quickly backup very large
Data Warehouses
31
Requirements are Achieved
When Loading Data with Archive Log Mode Enabled
• Test: Load when Database Machine is configured with archive log mode enabled
• Result: 1.5 TB/hr with uncompressed data
• Conclusion: Oracle MAA can support Data Warehouse requirements
• Proof Points: Over seven production Data Guard deployments on Database
Machine
32
Requirements are Achieved
When Using RMAN for Backup and Recovery
• Fast backup, restore and recovery
• Database Machine Backup & Restore validated with
Oracle Secure Backup: RMAN integration drives high performance
• RMAN tape-based and disk-based backups of 7 TB/hr
• Effective backup rates with RMAN incrementals of 10-48 TB/hr
• Database restore rates achieved over 23 TB/hr
• Redo apply rate of 200-637 MB/sec (or 2.1 TB/hr) was achieved
• For details see:
• Backup and Recovery Performance and Best Practices for Sun Oracle Database Machine and
Exadata
• Oracle Data Guard: Disaster Recovery for Sun Oracle Database Machine and Exadata
• http://www.oracle.com/technology/deploy/availability/htdocs/maa.htm
33
Data Warehouse Summary
The Sun Database Machine and Exadata
• Oracle MAA addresses the most demanding Data
Warehouse requirements
• Use archivelog mode and force logging with confidence
• Run with Flashback Database enabled
• Use RMAN for backup and recovery
• Use Data Guard for optimal data protection and availability
34
MAA Best Practices
• ASM, Flashback, and Corruption Protection
• Backup and Recovery, Oracle Data Guard
• Data Warehouse
• Patching and upgrades
• Wrap-up & resources
35
Patching & Upgrading
Overview
• All Planned Maintenance solutions apply
• Database Machine upgrades may require
• Exadata Storage server software changes
• Exadata software, firmware, OFED, OS
• Database Server software changes
• Oracle database software, firmware, OFED, OS
• Switch software (InfiniBand, Ethernet)
• Patches and Upgrades Situations
• Exadata Storage Server patch
• Database software patch
• Database server system patch (OS or firmware)
36
Exadata Storage Server Online Patching
• Exadata Storage Server patches supplied by Oracle
maintain all aspects of OS, firmware, and software
• No additional software (Linux RPMs or otherwise) is
allowed
• Only software supplied by Oracle patching is permitted
• Manual firmware changes not allowed
• Patches are one of two types
• Overlay - Restart Exadata cell services, automatic reconnect
• Staged - Restart Exadata Storage Server, resync interim changes
with ASM fast mirror resync
• Installed by whomever manages the Exadata Cells
• Use patch installation tool (patchmgr.sh) – see README
• Most patches installed using root account
37
Database Server Patching
• Database software patches installed by DBA w/ OPatch
• Contact Oracle Support if one-off patch conflicts with Exadata
required patches
• Operating system and firmware patches installed by SA
• Verify new patch meets Exadata requirements
• IB HCA and OFED versions must match storage servers
• Additional software allowed
• Must maintain compliance with Exadata requirements for all
dependencies
• RAC rolling upgrade
• Database software patches
• Firmware changes
• Certified operating system upgrades
38
Exadata & Database Machine Software
Maintenance Documents
• Two My Oracle Support (MOS) notes document:
• Software/firmware requirements
• Compatibility requirements between components
• Software patches and upgrades
• Procedures for download and installation
• MOS note 835032.1 documents requirements for Oracle Database
11.1 (V1) systems
• MOS note 888828.1 documents requirements for Oracle Database
11.2 (V1 and V2) systems
• Customers should sign up for automated alerts for changes to these
MOS notes
• In the future OCM will provide automatic notification of patches and
configuration changes
39
MAA Best Practices
• ASM, Flashback, and Corruption Protection
• Backup and Recovery, Oracle Data Guard
• Data Warehouse
• Patching and upgrades
• Wrap-up & resources
40
Oracle MAA with Database Machine
Complete, Open, Integrated Availability
Real Active
Application Data Guard
Clusters
WAN
ASM
Fast Oracle Secure
Backup
Recovery Area
• Comprehensive protection from failures: server, storage, network, site, corruptions
• Correction from human errors: database, table, row, transaction
• Active DR: Real-time remote standby open for query offload
• Online indexing and table redefinition
• Online patching and upgrades
• Oracle MAA: optimized and validated for Database Machine
41
General HA Best Practices
Additional Resources
• MAA and Exadata OTN website contains best practices
and different architectural solutions
• MAA best practices for the Database Machine will
continue to evolve – for latest please visit url’s below
• MAA OTN website:
http://www.oracle.com/technology/deploy/availability/htdocs/maa.htm
• Sun Oracle Database Machine and Exadata OTN website
http://www.oracle.com/technology/products/bi/db/exadata/index.html
42