Sei sulla pagina 1di 38

5

Exadata Database Machine Initial


Configuration

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Objectives
After completing this lesson, you should be able to:
Describe the installation and configuration process for
Database Machine.
Describe the default configuration for Database Machine.
Describe supported and unsupported customizations for
Database Machine.

5-2

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Database Machine Implementation Overview


Four phases:
1. Pre-installation
Various planning and scheduling activities including:

Site planning: space, power, cooling, logistics


Configuration planning: host names, IP addresses, databases
Network preparation: DNS, NTP, cabling

Oracle and customer engineers work together

2. Installation and configuration


Hardware and software installation and configuration
Result is a working system based on a recommended
configuration
Recommended to be performed by Oracle engineers

5-3

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Database Machine Implementation Overview


3. Additional configuration
Additional activities for production readiness including:

Reconfigure storage using non-default settings


Create additional databases
Configure Enterprise Manager
Configure backup and recovery
Connect Oracle Exalogic Elastic Cloud

Conducted by customer or Oracle services engagement

4. Post-installation
Ongoing monitoring and maintenance
Conducted by customer or Oracle services engagement

5-4

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Key Documents

Oracle Exadata Database Machine Owner's Guide


Important reference document covering:

Site planning
Network planning
Initial configuration
Core maintenance

Oracle Exadata Database Machine Configuration


Worksheets
Set of forms used to gather initial
configuration settings

5-5

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Database Machine Site Preparation

Use the following sections in the Owner's Guide to direct


site preparation activities:
Chapter 2: Site Requirements for Oracle Exadata Database
Machine

General Environmental Requirements


Space Requirements
Flooring Requirements
Electrical Power Requirements
Temperature and Humidity Requirements
Ventilation and Cooling Requirements
Network Connection and IP Address Requirements

Appendix A: Site Checklists

5-6

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Configuration Worksheets Overview


The Configuration Worksheets:
Are contained in a PDF document:
Part of the Exadata Database Machine documentation library
Document contains form fields to record settings

Contain site-specific configuration settings including:

5-7

Host and domain names


IP addresses
Region and time zone information
Name servers and NTP time servers
Exadata cell notification settings

Are used to generate files that drive the configuration


programs

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

General Configuration Worksheet

5-8

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Choosing the Right Protection Level

HIGH redundancy:

Triple mirroring across three separate storage servers


Provides maximum protection

Requires more storage capacity


Writes require greater I/O bandwidth

NORMAL redundancy:

Double mirroring across two separate storage servers


Provides one layer of redundancy

No additional protection if one cell is offline


Requires extra time and effort to maintain redundancy through planned
maintenance

Free space management:

5 - 10

Double mirroring still maintained if one cell is offline

Free space is required to preserve redundancy


Consider the impact of loosing a disk and the impact of loosing a cell
Consider also the desired protection level and the number of available cells

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

General Network Configuration Worksheet

5 - 12

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Management Network Configuration Worksheet

5 - 13

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Management Network IP Address Allocation


Example
Interface Type

Hostname

IP Address

Database server management interface

eidmdb01

10.7.7.101

Database server management interface

eidmdb02

10.7.7.102

Exadata cell management interface

eidmcel01

10.7.7.103

Exadata cell management interface

eidmcel02

10.7.7.104

Exadata cell management interface

eidmcel03

10.7.7.105

Database server ILOM interface

eidmdb01-ilom

10.7.7.106

Database server ILOM interface

eidmdb02-ilom

10.7.7.107

Exadata cell ILOM interface

eidmcel01-ilom

10.7.7.108

Exadata cell ILOM interface

eidmcel02-ilom

10.7.7.109

Exadata cell ILOM interface

eidmcel03-ilom

10.7.7.110

KVM management interface

eidmsw-kvm

10.7.7.111

Ethernet switch management interface

eidmsw-ip

10.7.7.112

InfiniBand switch management interface

eidmsw-ib2

10.7.7.114

InfiniBand switch management interface

eidmsw-ib3

10.7.7.115

PDU management interface

eidm-pdua

10.7.7.116

PDU management interface

eidm-pdub

10.7.7.117

5 - 14

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Client Access Network Configuration Worksheet

5 - 15

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Client Access Network IP Address Allocation


Example
Address Type

Hostname

IP Address

Database server physical client access interface

eidm01

172.16.1.101

Database server physical client access interface

eidm02

172.16.1.102

Database server VIP

eidm01-vip

172.16.1.103

Database server VIP

eidm02-vip

172.16.1.104

SCAN address

eidm-scan

172.16.1.105

SCAN address

eidm-scan

172.16.1.106

SCAN address

eidm-scan

172.16.1.107

5 - 16

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Optional Network Configuration Worksheets

5 - 17

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Power Distribution Unit Configuration Worksheet

5 - 18

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Auto Service Request Configuration Worksheet

5 - 19

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Oracle Enterprise Manager Grid Control


Configuration Worksheets

5 - 20

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Cell Alert Delivery Configuration Worksheet

5 - 21

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Beyond the Configuration Worksheets


Pre-installation
Phase

Planning and
Preparation

Installation and
Configuration
Phase

Configuration
Worksheets

Configurator
Spreadsheet
Generate

Configuration
Programs

5 - 22

Configuration
Files

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Configurator Spreadsheet Overview

5 - 23

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Generating the Configuration Files

1
2

5 - 25

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Database Machine Hardware Installation


Overview
Refer to the Owner's Guide for details on the following hardware
installation tasks:
Reviewing Safety Guidelines
Unpacking Oracle Exadata Database Machine
Placing Oracle Exadata Database Machine in Its Allocated
Space
Moving Oracle Exadata Database Machine
Stabilizing Oracle Exadata Database Machine
Attaching a Ground Cable

Powering on the System the First Time


Inspecting the Machine After it is in Place
Connecting Power Cords
Powering on Oracle Exadata Database Machine

5 - 26

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Configuring Oracle Exadata Database


Machine Overview

5 - 27

Connect to the Network


Configure the KVM Switch
Configure Sun Datacenter InfiniBand Switch 36 Switch
Configure the Cisco Ethernet Switch
Configure the Power Distribution Units
Check Exadata Storage Servers
Check Oracle Database Servers
Perform Additional Checks and Configuration
Verify the InfiniBand Network
Select the Operating System
Reclaim Disk Space After Selecting the Operating System
Perform Initial Network Configuration
Load the Configuration Information and Install the Software
Install Oracle Enterprise Manager Grid Control

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Selecting the Database Server Operating System

Customers now have a choice for the database server


operating system:
Oracle Linux X86_64 (default)
Oracle Solaris 11 for x86

5 - 28

Servers are shipped from the factory with both operating


systems preloaded
Space consumed by the unused operating system is
reclaimed and reused

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Deploying Solaris on the Database Servers


As the root user on each database server:
# cd /opt/SupportTools
# ./defaultOSchoose.pl
Default OS is : LINUX_BOOT_0
Please choose new default OS:
[0] LINUX_BOOT_0
[1] SOLARIS_BOOT_1
[2] SOLARIS_BOOT_2
Please type the number you would like to make a new
default OS: 1

5 - 29

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Reclaiming Unused Operating


System Disk Space Using Linux
As the root user on each database server:
# cd /opt/SupportTools
# ./reclaimdisks.sh -check
<check for expected output>
# ./reclaimdisks.sh free reclaim
<monitor /var/log/cellos/reclaimdisks.bg.log>
# ./reclaimdisks.sh -check
<check for expected output>

5 - 30

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Reclaiming Unused Operating


System Disk Space Using Solaris
As the root user on each database server:
# cd /opt/SupportTools
# ./reclaimdisks.pl
This script changes the Linux virtual and physical disks
to Solaris disks.
<Output truncated>
The virtual disks will be deleted. Do you want to
proceed? (yes/no) yes
This is an irreversible operation. Confirm that you want
to proceed. (yes/no) yes
Deleting the virtual disks ...
<Output continues>
5 - 32

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Performing Initial Network Configuration


IP addresses and host names are applied to the Database
Machine servers:
# cd /opt/oracle.SupportTools/firstconf
# ./applyconfig.sh <size>
/opt/oracle.SupportTools/onecommand/preconf.csv

IP addresses,
host names

preconf.csv
applyconfig.sh

5 - 33

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Loading the Configuration Information and


Installing the Software
Steps performed by OneCommand:

5 - 35

Step 0: Validate the environment.


Step 1: Create work directory.
Step 2: Unzip files.
Step 3: Setup SSH for the root user.
Step 4: Update the /etc/hosts file.
Step 5: Create the cellip.ora and
cellinit.ora files
Step 6: Validate the cells.
Step 7: Check RDS using the ping
command.
Step 8: Create the user accounts for
celladmin and cellmonitor.
Step 9: Set up SSH for the user accounts.
Step 10: Create the grid disks.
Step 11: Install the grid software.
Step 12: Patch the grid home software.

Step 13: Relink Reliable Data Socket


(RDS) for Grid Infrastructure.
Step 14: Run the grid root scripts.
Step 15: Install the Oracle Database
software.
Step 16: Patch the database software.
Step 17: Create the Oracle ASM disk
groups.
Step 18: Run Oracle Database
Configuration Assistant.
Step 19: Unlock Oracle Grid Infrastructure.
Step 20: Relink RDS protocol.
Step 21: Lock Oracle Grid Infrastructure.
Step 22: Set up e-mail alerts for Exadata
Storage Servers.
Step 23: Apply any security fixes.
Step 24: Secure Oracle Exadata
Database Machine.

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Running OneCommand on Database Machine


1.

Log in as the root user on the first database server. The default
password is welcome1.

2.

Download all necessary Oracle Exadata Storage Server Software and


Oracle Database patches.

3.

See My Oracle Support note 888828.1 for details.

Apply updates for the OneCommand utility.

4.

Configuration files should already be located at


/opt/oracle.SupportTools/onecommand

See associated README file for instructions.

Change to the OneCommand directory:

# cd /opt/oracle.SupportTools/onecommand
5.

Run the OneCommand utility using the following command:

# ./deploy112.sh i [ -s <n> | -r <n>-<N> | -l ]

5 - 36

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Exadata Storage Configuration

System Area (Disks 0-1)


or DBFS_DG (Disks 2-11)
(29G)

Exadata Cell 1
Exadata Cell 2
Exadata Cell n

DATA_EIDM
(40%)

RECO_EIDM
(60%)

5 - 37

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

The Result After Installation and Configuration


eidm01 172.16.1.101
eidm01-vip

eidm02 172.16.1.102

172.16.1.103

eidm02-vip

eidmdb01
10.7.7.101

eidmdb01-ilom
10.7.7.106

172.16.1.104
eidmdb02
10.7.7.102

eidmdb02-ilom
10.7.7.107

DB Server 1

DB Server 2

DB Instance: dbm1

DB Instance: dbm2

ASM Instance: +ASM1

ASM Instance: +ASM2

Cluster: eidm

Cluster: eidm

eidmdb01-priv
192.168.10.1

eidm-scan 172.16.1.105
172.16.1.106
172.16.1.107

eidmdb02-priv
192.168.10.2

InfiniBand Storage Network


eidmcel01-priv
192.168.10.3

eidmcel03-priv
192.168.10.5

DBFS_DG

DBFS_DG

DBFS_DG

DATA_EIDM

DATA_EIDM

DATA_EIDM

RECO_EIDM

RECO_EIDM

RECO_EIDM

Exadata Server 1

Exadata Server 2

Exadata Server 3

eidmcel01
10.7.7.103

5 - 39

eidmcel02-priv
192.168.10.4

eidmcel01-ilom
10.7.7.108

eidmcel02
10.7.7.104

eidmcel02-ilom
10.7.7.109

eidmcel03
10.7.7.105

eidmcel03-ilom
10.7.7.110

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Supported Additional Configuration Activities

Earthquake protection using a 3rd party Seismic Isolation


Platform

Replace the Ethernet switch


Connect a tape library for backup
Customize the storage configuration
Create and configure databases
Configure database features
Oracle Data Guard
Database File System (DBFS)

5 - 40

Configure Enterprise Manager


Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Unsupported Configuration Activities

5 - 41

Hardware re-racking
Adding components to servers
Adding servers to Quarter Rack or Half Rack configurations
Swapping Linux distributions
Configuring ACFS

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Quiz
Using the configuration worksheets you can set specific IP
addresses for each database server and Exadata cell in
Database Machine:
a. True
b. False

5 - 43

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Quiz
Which of the following options for connecting to existing SAN
storage is supported in conjunction with Database Machine?
a. Install a fiber channel HBA into each database server
b. Use a server connected to the existing SAN as a storage
gateway and connect it to Database Machine using NFS
over Ethernet
c. Use a server connected to the existing SAN as a storage
gateway and connect it to Database Machine using NFS
over InfiniBand

5 - 44

Copyright 2012, Oracle and/or its affiliates. All rights reserved.

Summary
In this lesson, you should have learned how to:
Describe the installation and configuration process for
Database Machine.
Describe the default configuration for Database Machine.
Describe supported and unsupported customizations for
Database Machine.

5 - 45

Copyright 2012, Oracle and/or its affiliates. All rights reserved.