Data Availability
and Security
Page 1
1
High Availability is …
3
What Could Happen to Your Data?
Hardware & System Error 49%
Human Error 36%
Computer Viruses 7%
Software Corruption 4%
Natural Disasters 3%
- The Disaster Recovery Journal 2001
4
Page 2
2
Clustering Eliminates Single Points Of Failure
Hot
Failover What
About
Security?
Warm Failover
Cold Failover
Restart
5
High Availability Goal
Design and validate the best, integrated High
Availability solution
– Unbreakable Architecture
Handle all outages at all tiers
– Best Practices
Cookbook for prevention, avoidance, mitigation, and
recovery
Configuration, operational, outage solutions, restore fault
tolerance
– Complete out-of-the-box high availability
Tested and validated solution
Unbreakable Architecture + Best Practices = Maximum Availability
6
Page 3
3
Maximum Availability Architecture
WAN Traffic Manager
Dedicated Network
RAC Data Guard RAC
Primary Site Secondary Site
7
Oracle’s Integrated HA Solutions
System Real Application Clusters
Failures
Unplanned Automatic Storage Management
Downtime Data
Flashback
RMAN & Flash Recovery Area
Failures H.A.R.D
Data Guard
System Online Reconfiguration
Planned Changes Rolling Upgrades
Downtime
Data Online Redefinition
Changes
8
Page 4
4
Fault Tolerance
System Real Application Clusters
Failures
Unplanned Automatic Storage Management
Downtime Data
Flashback
RMAN & Flash Recovery Area
Failures H.A.R.D
Data Guard
System Online Reconfiguration
Planned Changes Rolling Upgrades
Downtime
Data Online Redefinition
Changes
9
Standard Oracle Architecture
Instance Database
10
Page 5
5
Shared Disk Architecture
Product: Real Application Clusters (RAC)
Database
Instance 1
Table A
Database
Instance 2 Table B
Table C
Database
Instance 3
11
Benefits
Reliability/availability - more reliable as you add
systems (vs. less reliable for shared nothing systems)
Scalability – new nodes added online without need to
move data
Flexibility - systems do NOT have to be identical
– Better usage of hardware
– Application partitioning (ex. new system for OLTP, older for
DW, small system for loading, stats generation, backup,
etc)
Capacity on demand saves money
12
Page 6
6
Complete Scalability
Adds incremental I/O bandwidth
Incremental processing power is immediately
available for useful work
Requires no re-partitioning or re-distribution of data
Data Data
A-Z A-Z
13
RAC Flexibility
Network
Big box - OLTP
Users
Medium/Older Box - DW
Small box
Statistics, Backup,
DBA Work, etc
Shared Disk System
14
Page 7
7
Capacity Planning …
Planning to handle workload
W
300%
o
r
200%
k
l
100%
o
d
3 6 9 12 15 18 21 24
Months
15
… vs Capacity on Demand
Initial workload with RAC
W
300%
o
r
200%
k
l
100%
o
d
3 6 9 12 15 18 21 24
Months
16
Page 8
8
… etc …
Scaling out with RAC
New server added
New server added
W to cluster is
300% to cluster is
purchased at
purchased at
o present day prices
present day prices
r
200%
k
l
100%
o
d
3 6 9 12 15 18 21 24
Months
17
… etc …
New server added
New server added
to cluster is
to cluster is
purchased at
Scaling out with RAC purchased at
present day prices
present day prices
W
300%
o
r
200%
k
l
100%
o
d
3 6 9 12 15 18 21 24
Months
18
Page 9
9
Data Protection
System Real Application Clusters
Failures
Unplanned Automatic Storage Management
Downtime Data
Flashback
RMAN & Flash Recovery Area
Failures H.A.R.D
Data Guard
System Online Reconfiguration
Planned Changes Rolling Upgrades
Downtime
Data Online Redefinition
Changes
19
Automatic Storage
Management
Low Cost
– Eliminates need for volume
manager and file systems
– Works well with inexpensive,
modular storage
– Gives better storage utilization
Easy – up to 50% less
ASM
–
DBA/Sys Admin work
Fault tolerant
Raw disk performance
Capacity on demand
Automatic I/O load balancing
20
Page 10
10
Data Mirroring with ASM
ASM mirrors data across
inexpensive modular
storage arrays
Automatically remirrors
when disk or array fails
Designed to tolerate
failures
Failure Resiliency using Low Cost Storage
21
Customer Proof Point – Amazon
2 - 61 TB Database on Low Cost Storage Array
61 TB database 16 Node RAC Linux Cluster
– 51 TB raw data, 2 TB Indexes 4 CPUs per Node
– 71 TB raw disk
Oracle10g using ASM
System per storage array
Services 100,000 complex
queries per week 8 Brocade switches, 32 port each
– Mostly ad-hoc Switch Switch Switch
– 2 to 3 gigabyte (byte, not bit)
per second table scan
throughput 71 HP MSA-1000 Arrays
Data and query volumes
double annually
22
Page 11
11
Human Error
Human
Errors
Single Biggest Cause Other
of Downtime Downtime
Goal is to quickly analyze and repair
– For Localized damage
Need surgical analysis and repair
Example – deleted wrong order
– For Widespread damage
Need complete back-out to avoid long downtime
Example – batch job deletes this month’s orders
23
Flashback Query
A Time Machine for Flashback Query allows
Your Data viewing data as it was before
a mistake
– Query data at a time of your
choosing
– Use standard SQL for
corrections
Mistake Correction
Delete from Emp Insert into Emp
where Ename=‘Smith’; select * from Emp AS OF yesterday
where Ename=‘Smith’;
24
Page 12
12
Flashback Drop
Emp Quickly recover dropped objects
Provides self-service recovery
Eliminate the need for TSPITR
Drop
table Virtual Recycle Bin
emp; – Objects remain in the recycle bin until
you permanently drop them with the
PURGE command or recover them
with the Flashback Table command.
Recycle bin – Objects will remain in the recycle bin
Flashback until there is no room in the
Table emp tablespace for new rows or updates to
to before existing rows or until the tablespace
drop;
needs to be extended
– Objects are purged in the order they
Emp were dropped.
Mistake was
made
25
Oracle End-to-end Data Validation
Blocks validated and
Protection info added to block
Oracle
H.A.R.D. – Hardware Assisted
A.S.M. Resilient Data
Volume Manager – Prevents corruption introduced in
IO path between DB and storage
Operating System
Initially introduced in Oracle9iR2
Host Bus Adapter 10g HARD provides
– Better checks
SAN & – All file types & block sizes checked
Virtualization DB, log, archive, backup, etc.
– A.S.M. enables HARD without
SAN Interface using RAW devices
Supported by major storage vendors
Storage Device
Protection info validated by storage device
26
Page 13
13
Database Backups:
Recovery Manager (RMAN)
Integrated with RMAN API
Oracle Databases Flash 2.0 supporting Oracle9i
Recovery forward
Area
Exclusive RMAN backup
encryption directly to tape
RMAN RMAN Fastest, most efficient
database backups to tape
Backup
Directly to --- OR --- Backup From Supports RAC, ASM and
Tape Disk to Tape Data Guard environments
Exclusive integration with
Enterprise Manager
Leverages Oracle security
Oracle Secure Backup technology
Media Management Layer
Enterprise
Manager
27
Primary Site Standby Site A
Standby Site B
Standby
Database
Primary
Database Standby
Database
28
Page 14
14
Read-Only / Read-Write
Standby Reporting
Server
Backups
Tape
Standby database can be used to
offload the primary database, increasing the ROI
29
Physical Standby
Database
Sync or Async
Redo Shipping Backup
Production
Database Redo Apply
DIGITAL DATA STORAGE
Network
DIGITAL DATA STORAGE
Broker
Logical Standby
Transform Database Open for
Redo to SQL Reports
SQL
Apply
Additional
Indexes & MVs
30
Page 15
15
Data Guard / MAA Configuration
Primary Site Standby Site
RAC
RAC
Broker
Primary Data Guard Standby
Database Database
Data Guard + RAC: end-to-end Data Protection and HA
Managed as a single configuration
31
Customer Testimonials
“Data Guard automates disaster-recovery procedures and
reduces Fidelity's exposure to data loss by an order of
magnitude compared to previous approaches.”
Jonathan Schapiro
Vice President
Data Architecture & Services
Global Equity Trading & Technology
32
Page 16
16
Customer Testimonials
“We needed to consider the safe-keeping of our data, but
we also needed to look at cost. Oracle Data Guard
provides everything for a high availability solution at a
lower cost than other alternatives”
Ann Collins
Technical Director
33
Customer Testimonials
“We don't have to baby-sit it – it just works!”
Darl Kuhn
Senior DBA & Staff Engineer
Database Services
Sun Services Global Engineering
34
Page 17
17
Highest Data Protection & Lowest Cost
Oracle Secure Backup
Archive to Tape
Data Guard
Site Failure Protection
Flash Recovery Area
Data Corruption
Protection
Flashback
Human Error Combine the
Protection
Features to
ASM Mirroring Dramatic Advances Achieve Any Level
Storage Failure in Ease of Use of Data Protection
Protection
35
Oracle’s Integrated HA Solutions
System Real Application Clusters
Failures
Unplanned Automatic Storage Management
Downtime Data
Flashback
RMAN & Flash Recovery Area
Failures H.A.R.D
Data Guard
System Online Reconfiguration
Planned Changes Rolling Upgrades
Downtime
Data Online Redefinition
Changes
36
Page 18
18
No Cost System Changes –
Capacity on Demand
CPU
– Add/remove CPUs on SMP online
Cluster Nodes
– Add/remove cluster nodes online
– No data movement needed
Memory
– Grow and shrink shared memory
and buffer cache online
– Auto tuning of memory online
Disk
– Add/remove disks online
– Automatically rebalance
– Move datafiles
37
Rolling Patch Upgrade using RAC
Oracle
Clients Clients Patch Patch
A B A B
B
1 2 Upgrades
Operating
Initial RAC Configuration Clients on A, Patch B
System
Upgrades
A
AA B
B Patch A
A B
B
4 3 Hardware
Upgrades
Upgrade Complete Clients on B, Patch A
38
Page 19
19
Oracle’s Integrated HA Solutions
System Real Application Clusters
Failures
Unplanned Automatic Storage Management
Downtime Data
Flashback
RMAN & Flash Recovery Area
Failures H.A.R.D
Data Guard
System Online Reconfiguration
Planned Changes Rolling Upgrades
Downtime
Data Online Redefinition
Changes
39
Online Redefinition
All indexing operations can be done online
– Create new index, move index, defragment index
Tables can be Reorganized & Redefined online
– Table contents are copied to a new table
Defragments and allows changing location, table type, partitioning
– Contents can be transformed as they are copied
Can change columns, types, sizes - specified using SQL “Select”
Copy Transform
Source
Table Table Result
Table
GUI
Store
Update Updates interface
Continuous to make it
Queries & Tracking Transform
Simple
Updates Updates
40
Page 20
20
Highest Availability at Lowest Cost
Highest Availability
– Fault Tolerant Clusters
– Flashback Error Correction
– Automated Disk Backup
– No Compromise Disaster Recovery
– Rolling Upgrades
– Online Redefinition
At Lowest Cost
– Low Cost Grid servers
– Low Cost Modular Storage Arrays
– Automated & Simple to Use
High Quality AND Low Cost
41
Securing the Enterprise
Challenges
Business • Reduce risk and liability
• Address Regulatory Compliance
• Ensure privacy and accountability
• Maintain operational effectiveness
Information Security Continuity
• Identification (who) • High Availability
• Access Controls (what) • Disaster Recovery
• Auditing (where, when & how) • Continuous Operations
Applies to ALL applications across ALL industries
42
Page 21
21
Holistic Approach To Security
Reduces Risk
SECURITY
Technology Methodology/Process
Assurance
43
Security & Privacy
Data
IT
Staff Register
Financial Aid
Rx Class
Clerical
Office Visit
Network Lab 973
Dormitory
Professor
Staff
Alumni
Cert Child
Enrollment
Student Students
Identify Privacy & Access Privacy & Comprehensive
& integrity of control integrity of auditing
communications data
Authenticate
44
Page 22
22
Password Policy Example
Cannot be similar to user’s name
My guessable
Cannot be easilycurrent password:
Must be at least 12 characters in length
“This1is2Hard!”
Contains upper and lower case characters
Contains at least one special character
Contains at least one number
Rotated every 14 days
Cannot be re-used for 5 years
46
Oracle Advanced Security
(ASO)
Protects data in motion
Network Encryption & Integrity
– FIPS140-1 level 2 certified
– Supports Public Key Infrastructure (PKI)
Strong identification of end users, clients and
servers
Transparent Data Encryption
TRANSPARENT: Applications run unchanged!!!
47
Page 23
23
Transparent Data Encryption
Separation of duties
Wallet password is separate from
System or DBA password
No access
to wallet
DBA starts up
Database
Security DBA opens wallet
containing master key
48
Enforcing Policy Compliance
Auditing
– Basic
– Fine Grain Auditing
– Auditing can be XML file
– Audit Vault
49
Page 24
24
Audit Vault
Specialized Warehouse for Audit Data
Enterprise Audit Customer Reports
Sources
(custom)
Oracle
Database
9i R2
Partner Reports
3rd Party
Audit Audit Warehouse Oracle Audit Vault
Sources Reporting
Oracle
Enterprise Database
Database Audit Settings
10g
10g R2
Oracle App Svr Pre-defined Roles
For Separation of Duty
Oracle
Protected Schema
Applications Security Feature
Oracle Data Mining
Database
10g R1
Partitioning
50
Database Vault
Raising the Bar on Information Security
Financials OE
GL
HR PER
BEN
Other Applications OLTP
OLAP
Risks and Liabilities:
• SOX, HIPAA, SB1386 …
• Intellectual Property
51
Page 25
25
Q
&A
Q U E S T I O N S
A N S W E R S
Page 26
26