NetBackup Commands UNIX

1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.
Creating a High Availability

Architecture with SPARC
SuperCluster
Carter Wright
Database Engineer, Computer Knowledge, Inc.
Bruce Chapman
Principal Software Engineer, Oracle
Dean Halbeisen
Solutions Manager, Oracle
Program  SPARC SuperCluster High Availability
Agenda Implementation
 SPARC SuperCluster High Availability
 Optimized Solutions High Availability
Examples
 Next Steps / Resources

SPARC SuperCluster High Availability
Large Government Law Enforcement Agency Implementation of HA
 Leverage the HA features built in to the SPARC SuperCluster
– Oracle Real Application Cluster(RAC), Oracle Exadata Storage Server,
Oracle Automatic Storage Management(ASM), Network and Power
redundancies
– Clustering of applications in Oracle VM Server For SPARC and Oracle
Solaris Zones on SPARC T4-4 nodes
 Use of Oracle Data Guard
 Use of Oracle RMAN
 Use of Sun ZFS Storage Appliance 7420 and ZFS Replication

Workload Overview
 12,000 to 15,000 concurrent users worldwide during peak hours
 Database greater than 1.6TB and growing
 1500 to 2000 SQL executions per second per RAC node during peak hours (~4000 SQL execs per
second combined)
 Greater than 1.5 million blocks per second read from each SGA during peak hours ( > 3 million blocks
per second combined )
 900K to 1.2MB of redo written per second (combined RAC nodes)
 Query response time typically less than 300ms
 Data Guard latency less than three seconds to standby site
 ZFS replication latency less than three seconds to standby site
 Each RAC node CPU utilization at peak load 15% to 20%

SPARC SuperCluster Configuration
Solaris 11 Solaris 10
Nodes 1 & 2
App
External Zone
Server1
10GbE Solaris 10 ZFS 7420 Storage

Nodes 3 & 4
InfiniBand RMAN Backups
Data Pump Dir
External 600G
Server2 App Svr
10K SAS
App App
Zone Zone
InfiniBand
Exadata Data Cells

External 216TB Raw
Server3 ASM High
72TB Usable
3 X ASM Disk Groups

Database Configuration
 SuperCluster installation does provide a fully functional Oracle RAC install, but
it has to be configured to meet your applications needs
– Database Hardening must be performed
– Listener configurations (scan and local) can be modified
– You configure your RAC Workload Services
– Network settings – 10Gb and 1Gb interfaces only
 TCP window, MTU’s
 Leave IB settings alone
– Backup and recovery is your responsibility
– Application tuning is your responsibility

Database Configuration
– OLTP or Data Warehouse (or both)
– SGA Settings can be modified
 We changed only a few settings
– SGA, PGA Aggregate Target
– Data Guard parameters
 SPARC SuperCluster uses Auto SGA and Auto PGA, not full AMM (see pg 18-18 11g
Concepts Guide)
 Can change the quantity and size of Redo Logs (if needed)
 Users, tablespaces, datafiles
– Roles and privileges
– Datafile size and quantity

Workload Services
Intranet
SCAN + Service Name
SCAN Listeners
Load Balanced Services Single Node Services
Main App 1 Main App 2 Smaller Apps Non-RAC COTS
RMAN Service Data Guard Data Guard
12K-15K Active Concurrent Users Accessed World Wide

Data Guard on SPARC SuperCluster
 Data Guard setup
– Physical Standby, High Performance Mode, Async
 Multi-instance Primary, single instance standby
 Active Guard enabled at standby site
 Use standby for
– Reporting and Read-only access
– Smoke testing application deployments
 Make standby a temporary Primary and restore back to standby using Flashback
Database
 Use standby as the Last deployment before deployment to prod site
– Other live applications to leverage investment

Replication Strategy
Primary Standby
SPARC Data Guard Replication SPARC
SuperCluster Database Content SuperCluster
Latency to Remote Site <3 Seconds
ZFS Storage ZFS Replication ZFS Storage

Appliance 7420 External Content Appliance 7420
Latency to Remote Site <3 Seconds

RMAN Configuration
 Backupsets stored on ZFS 7420 (not in ASM) Solaris 11 Solaris 10
Node 2
– Accessible during crisis
App
RMAN Services
– Leave space to database in Exadata Zone
– Backup file system mounted to both nodes for parallelism

– ZFS RAID 10 Solaris 11 Solaris 10
 Use RAC Workload Service
Node 1
App
– Allows RMAN parallelism across RAC Zone
 rman target sys/<pw>@rman_svc

 Improves speed
ZFS 7420 Storage
InfiniBand
 Parallelism 16 with 16 Channels allocated RMAN Backups
– RMAN will allocate 8 on node 1, 8 on node2

RMAN Backup Operations
 Level 0 weekly
– 7 day recovery window
 Level 1 nightly
– Cumulative Incremental
 Backup both primary and standby sites separately

RMAN Configuration and Management in a RAC Environment
 Recovery Catalog is required
 Flashback database enabled at both sites
 db_unique_name required
 Backups taken at both sites
– BACKUP and RESTORE command uses
TAG ‘system_name’ option when creating backups
 Distinguishes each site in Recovery Catalog
 Archivelog deletion policy on Primary

– Ensures archivelogs are not deleted by RMAN before getting to standby site
CONFIGURE ARCHIVELOG DELETION POLICY TO SHIPPED TO ALL STANDBY;

Monitoring and Management
 Grid Control 12c
– Good graphs and drill down capabilities
 Custom Scripts (bash)
– Exadata Cell monitoring –
 No Grid 12c plug-in yet for SPARC SuperCluster with Exadata
– Alert monitoring to send notifications to our NOC

Time to Deployment for an Engineered Solution
 Early adopter of SPARC SuperCluster and it was not your common install being a customer
engineered application, had to train a new team with clearance to work on the systems to
perform the install
 Purchased three SPARC SuperCluster systems in December 2011 Pre-Prod, Production,
Standby DR site
 First system delivered early February, next system two weeks later, third system two weeks
after that
 Each system was installed and running our application within three weeks of each delivery.
 Within a 9 week period, we had three fully operational SuperClusters in three different data
centers.
 Went live production in July of 2012. Successful worldwide launch
 Instantiated DR site with Oracle Data Guard shortly thereafter.

Knowledge to Share
 SPARC SuperCluster High Availability White papers on
www.cknowledge.com
– How To Guide: RAC Workload Services – 11gR2
– How To Guide: Building Data Guard
– RMAN Quick Reference

Examples

SPARC SuperCluster: High Availability
Hardware HA Features
Mirrored Disks
Dual Power Distribution Units
All OS Disks On T4-4 Domains are
Both connected to each server or switch
mirrored.
in the SuperCluster, each with redundant
power supplies. SPARC T4-4 HA Features
Ten Gigabit Ethernet Networking Hot swap redundant PS, hot swap
PCI-E, DIMM off lining, predictive self
Each logical 10GbE interface has two
healing
physical ports for connection to separate
external lab switches. 7320 ZFS Storage Appliance
-Two Storage head nodes each with
Infiniband Networking redundant networking, SCSI.
- 3 IB switches for availability / growth. -Configurable RAID / spare options for
- Each logical IB connection to T4-4, shares.
Exadata DB Storage Cells, and 7320 Database Storage Cells
Storage Appliance has two physical Each with redundant IB and
InfiniBand ports. configurable disk mirroring.

SPARC SuperCluster: High Availability
Software HA
Multiple RAC instances
Enabling DB to tolerate and react to instance
and node failures automatically with zero to
near zero impact on applications.
Oracle Grid Infrastructure
Clusterware and ASM provide abstraction of
DB storage cell nodes and disks, also able to
continue functioning despite disk or DB
storage node failure.
Oracle Solaris Cluster
One of several high availability options for
application domains. Configurable number of
Domains for horizontal scaling and failover.

Examples

High Availability on SPARC SuperCluster
Oracle Optimized Solutions
10 GbE Data Center Network
T4-4 Node 3 T4-4 Node 4

T4-4 Node 1 T4-4Node
T4-4 Node22
Oracle Solaris Oracle Oracle Solaris
Oracle Solaris Solaris Oracle Solaris
Cluster
High
GP Domain GP Domain
GP Domain
Availability
GP Domain
Oracle Solaris 11 Oracle Oracle Solaris 11

RAC
Oracle Solaris 11
11g R2
Oracle Solaris 11
Scale
Database Domain Database Domain
Database Domain Database Domain
InfiniBand Network
Oracle Exadata Storage Servers

High Availability / Fail Over Test Results
Extremely fast failure detection and service recovery times
Detection Recovery
Web server node failure 11 12

OPMN/OC4J failure 0 0
SECONDS
General purpose domain failure 0 10
Database domain failure 61 5

Driving Risk Down • Driving Innovation Up • Active Partnership with Oracle
Up • Active Partnership with Oracle • Driving Risk Down • Driving Innovation
Down • Driving Innovation Up • Active Partnership with Oracle • Driving Risk
Tested, Secure, Flexible
Driving Risk Down • Driving Innovation
DrivingUp Risk
• Active
DownPartnership with Oracle
Driving
Down • Driving Innovation Up • Active Innovation
Partnership Up • Driving Risk
with Oracle
Driving Risk Down • Driving Innovation
ActiveUp • Active Partnership
Partnership with Oracle
with Oracle

Examples

SPARC SuperCluster Conference Sessions
Session Date Time Room
Accelerate Oracle E-Business Suite Deployment with SPARC SuperCluster Monday 12:15PM Moscone West - 2001
SPARC SuperCluster: Architecture, Roadmap, and Partner Services Opportunities Monday 12:15PM Marriott Marquis – Golden
Gate B
My Oracle Support: Tips and Techniques for Getting the Best Hardware Support Monday 1:45PM Moscone West - 2001
Top 10 Database Performance Tips for SPARC Systems Running Oracle Solaris Monday 1:45PM Moscone West - 2000
Building a Flexible Enterprise Cloud Infrastructure on Oracle SPARC Systems Monday 4:45PM Moscone West - 2001
Database and Application Consolidation on SPARC SuperCluster Monday 4:45PM Moscone West - 2000
Oracle's SPARC Server Strategy Update Tuesday 10:15AM Moscone West - 2001
Oracle Engineered Systems Backup and Recovery Best Practices Tuesday 10:15AM Moscone South - 252
Transform Data Center TCO with Oracle Optimized Servers: A Customer Panel Tuesday 11:45AM Moscone West - 2001
Deep Dive into SPARC SuperCluster: Engineered for Extreme Efficiency Tuesday 1:15PM Moscone West - 2001
Accelerate Your SAP Landscape with the Oracle SPARC SuperCluster Tuesday 5:00PM Moscone West - 2001
High Performance Security for Oracle Applications Using SPARC T4 Systems Tuesday 5:00PM Moscone West - 2000
SPARC Processor Update Wednesday 10:15AM Moscone West - 2000
Creating a Maximum Availability Architecture with SPARC SuperCluster Wednesday 11:45AM Moscone West - 2000
Improve PeopleSoft HCM Performance and Reliability with SPARC SuperCluster Wednesday 5:00PM Moscone South - 200
Managing Sun Servers and Oracle Engineered Systems with Oracle Enterprise Manager Thursday 12:45PM Moscone West - 2000
SPARC SuperCluster Demos
Demo Location
Accelerating SAP Queries and Reporting on SPARC SuperCluster Moscone South -102
Bullet Proof E-Business Suite on SPARC SuperCluster Moscone South -101
Bullet proof PeopleSoft on SPARC SuperCluster Moscone South-131
Consolidate your Datacenter: Enterprise Cloud Infrastructure on SPARC Moscone South-150
Explore the Benefits of Oracle SPARC SuperCluster Moscone South-104
Mission Critical Availability and Disaster Recover for Your Cloud Moscone South-116
Mission Critical SPARC-Powered Infrastructure as a Service Moscone South-157
Oracle SPARC SuperCluster: World’s First General Purpose Engineered System Moscone South-106
Oracle SPARC SuperCluster T4-4 to Improve Efficiency and Cut Costs Moscone South-105
The Data Center Superhero: Backup and Recovery Systems Moscone South-107
Transform an Enterprise Cloud Infrastructure: Oracle SPARC SuperCluster Moscone South-130
Transform and Optimize Revenue Management with SPARC SuperCluster Moscone South-108
Engineered System Showcase - SPARC SuperCluster Consolidation Moscone North Lower Lobby

Resources
In depth information
 Computer Knowledge White Papers

– http://www.cknowledge.com
 Oracle Maximum Availability Architecture Guides
– http://www.oracle.com/technetwork/database/features/availability/maa-
090890.html
 Optimized Solutions
– http://www.oracle.com/us/solutions/oos/overview/index.html

Graphic Section Divider


NetBackup Commands UNIX

Caricato da

Informazioni sul documento

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

NetBackup Commands UNIX

Caricato da

Copyright:

Formati disponibili

1 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Creating a High Availability

3 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

4 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

5 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

10GbE Solaris 10 ZFS 7420 Storage

Exadata Data Cells

6 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

7 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

8 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

SCAN + Service Name

Load Balanced Services Single Node Services

Main App 1 Main App 2 Smaller Apps Non-RAC COTS

RMAN Service Data Guard Data Guard

12K-15K Active Concurrent Users Accessed World Wide

9 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

10 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

ZFS Storage ZFS Replication ZFS Storage

11 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

– Backup file system mounted to both nodes for parallelism

 rman target sys/<pw>@rman_svc

12 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

 Backup both primary and standby sites separately

13 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

 Archivelog deletion policy on Primary

14 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

15 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

16 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

17 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

18 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

19 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

20 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

21 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

T4-4 Node 3 T4-4 Node 4

Oracle Solaris 11 Oracle Oracle Solaris 11

Oracle Exadata Storage Servers

22 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Web server node failure 11 12

23 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

24 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

25 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

27 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

 Computer Knowledge White Papers

28 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

29 Copyright © 2012, Oracle and/or its affiliates. All rights reserved.

Potrebbero piacerti anche