Sei sulla pagina 1di 29

IBM Power Systems

Getting Started with IBM i PowerVM Live Partition Mobility

June, 27nd 2012

Willy Gnther IBM Power Systems FTSS Germany Ingo Dimmer IBM ATS System Storage Support Europe

http://w3.ibm.com/support/techdocs/atsmastr.nsf/WebIndex/TD105970 http://www-03.ibm.com/partnerworld/partnerinfo/src/atsmastr.nsf/WebIndex/TD105970
2012 IBM Corporation

IBM Power Systems

Agenda Getting Started with IBM i Live Partition Mobility


PowerVM Live Partition Mobility Overview Prerequisites Validation and Migration Process

2012 IBM Corporation

IBM Power Systems

PowerVM Edition Features


PowerVM Edition Features
PowerVM Hypervisor Dynamic Logical Partitioning Maximum VMs Management Virtual I/O Server Integrated Virtualization Manager PowerVM Lx86 N_Port ID Virtualization Shared Processor Pools Shared Storage Pools Thin Provisioning Suspend/Resume Live Partition Mobility Active Memory Sharing
3

Express (5765-PVX) 9 9 2 per server + VIOS IVM, VM Control 9 9 9 9

Standard (5765-PVS) 9 9 10 per core (up to 1000) IVM, HMC, SDMC, VM Control 99 (redundant) 9 9 9 9 9 9 9

Enterprise (5765-PVE) 9 9 10 per core (up to 1000) IVM, HMC, SDMC, VM Control 99 (redundant) 9 9 9 9 9 9 9 9 9
Note: PowerVM upgrades are available to higher edition offerings.

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility for IBM i


PowerVM support for IBM i Live Partition Mobility allows the user to migrate an active / inactive or suspended partition to another system
Partition mobility allows to free up server resources used by a partition e.g. for rebalancing system resource usage, server migration / consolidation or for scheduled maintenance Active partition mobility allows migration with no application downtime No solution to protect against unplanned outages

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (1/6)


POWER7 System #1 Suspended IBM i Client Partition 1 POWER7 System #2

M M M M M M M

Validate environment for appropriate resources

A
DC01

LIN1 CMN01 VLAN


Hypervisor

HMC

VLAN
Hypervisor

VASI Mover Service

vhost0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

VASI Mover Service fcs0

vtscsi0

fcs0

ent0

VIOS

VIOS

ent0

Storage Subsystem

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (2/6)


POWER7 System #1 Suspended IBM i Client Partition 1 POWER7 System #2 Shell Partition

M M M M M M M

Create shell partition on target system

A
DC01

LIN1 CMN01 VLAN


Hypervisor

LIN1 CMN01 DC01

HMC

VLAN
Hypervisor

VASI Mover Service

vhost0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

VASI Mover Service fcs0

vtscsi0

fcs0

ent0

VIOS

VIOS

ent0

Storage Subsystem

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (3/6)


POWER7 System #1 Suspended IBM i Client Partition 1 POWER7 System #2 Shell Partition

M M M M M M M

Create virtual SCSI devices

A
DC01

LIN1 CMN01 VLAN


Hypervisor

LIN1 CMN01

A
DC01

HMC

VLAN
Hypervisor

VASI Mover Service

vhost0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

vhost0

VASI Mover Service

vtscsi0

vtscsi0

fcs0

ent0

VIOS

VIOS

ent0

fcs0

Storage Subsystem

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (4/6)


POWER7 System #1 Suspended IBM i Client Partition 1 POWER7 System #2 Shell Partition

M M

Start migrating memory pages

M M M

A
DC01

LIN1 CMN01 VLAN


Hypervisor

LIN1 CMN01

A
DC01

HMC

VLAN
Hypervisor

VASI Mover Service

vhost0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

vhost0

VASI Mover Service

vtscsi0

vtscsi0

fcs0

ent0

VIOS

VIOS

ent0

fcs0

M
Storage Subsystem

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (5/6)


POWER7 System #1 Suspended Partition POWER7 System #2

A
DC01

LIN1 CMN01 VLAN


Hypervisor

Once enough memory pages have been moved, suspend the source system

Shell IBM i Partition Client 1

M M M M M M M

LIN1 CMN01

A
DC01

HMC

VLAN
Hypervisor

VASI Mover Service

vhost0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

vhost0

VASI Mover Service

vtscsi0

vtscsi0

fcs0

ent0

VIOS

VIOS

ent0

fcs0

Storage Subsystem

2012 IBM Corporation

IBM Power Systems

PowerVM Live Partition Mobility Migration Process (6/6)


POWER7 System #1 POWER7 System #2

Finish the migration and remove the original LPAR definitions

Shell IBM i Partition Client 1

M M M M M M M

LIN1 CMN01 VLAN


Hypervisor

A
DC01

HMC

VLAN
Hypervisor

VASI Mover Service fcs0

ent1 ent2 SEA en2 (if) en2 (if)

ent1 ent2 SEA

vhost0

VASI Mover Service

vtscsi0

ent0

VIOS

VIOS

ent0

fcs0

Storage Subsystem

10

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites Summary


POWER7 tower/rack server with firmware level Ax730_087_035 or later (currently not supported for Blades and PureFlex Power compute nodes) HMC V7R7.5 or later PowerVM Enterprise Edition VIOS 2.2.1.4 (FP25-SP2) or later IBM i 7.1 TR4 or later All VIOS virtual adapters assigned as desired All IBM i client I/O needs to be virtual IBM i partition properties need to be set to Restricted I/O Resources All partition storage must be externally attached either via VSCSI or NPIV and shared between source and target VIOS(s) If using NPIV both logical WWPNs of a virtual FC server adapter need to be zoned (2nd WWPN used on destination server) VLAN ID for IBM i client to be migrated must be identical on source and target system VIOS(s) flagged as Mover Service Partition (for active partition migration only) Virtual optical devices need to be deallocated Working RMC connection for VIOS partitions
11
2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites PowerVM Enterprise Edition

General partition mobility capability provided by PowerVM EE IBM i Partition Mobility Capable enabled by firmware level Ax730_087_035 or higher
12
2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites Restricted I/O Resources


IBM i partition properties need to be set to Restricted I/O Resources
requires IBM i partition to be deactivated

13

2012 IBM Corporation

IBM Power Systems

IBM i Prerequisites Dual VIOS SEA Failover Configuration (1/4)


Complexity
Specialized setup confined to VIOS

Resilience
Protection against single VIOS, switch port, switch, and Ethernet adapter failure

VIO Client

NIC VIOS SEA VIOS SEA

Throughput / Scalability
Load-sharing between primary and backup SEA
requires using more than one VLAN and two or more trunk adapters per VIOS Backup SEA detects the active SEA has failed Active SEA detects a loss of the physical link Manual failover by putting SEA in standby mode Active SEA cannot ping a given IP address

NIC

NIC

SEA failure initiated by:



Switch

Shared Ethernet Adapter Failover

Notes
Can be used by AIX, IBM i, and Linux Outside traffic may be tagged

14

2012 IBM Corporation

IBM Power Systems

IBM i Prerequisites Dual VIOS SEA Failover Configuration (2/4)


VIOS 1 VIOS 2 IBM i Client 1 IBM i Client 2

Primary

en4 (if) ent4 (SEA)

en4 (if) ent4 (SEA) ent3 (vir) PVID=99 Control Channel ent3 (vir) ent2 (vir) PVID 1

Backup
ETH01 (LIND) ent0 (phy) CMN01 (vir) PVID 1 ETH01 (LIND) CMN01 (vir) PVID 1

ent0 (phy)

ent2 (vir) PVID 1

Notes: Primary and backup SEA roles are defined by the trunk priority settings for the virtual Ethernet adapters used for SEA external network access in the VIOS partition profile. Optionally link aggregation can be used for ent0.
15
2012 IBM Corporation

Hypervisor
Ethernet Switch

VLAN 1

Untagged

Untagged

VLAN ID needs to be identical on LPM source and destination system


Active Passive

Untagged

Ethernet Switch

IBM Power Systems

IBM i Prerequisites Dual VIOS SEA Failover Configuration (3/4)


mkvdev use for creating a Shared Ethernet Adapter failover configuration on both Virtual I/O Servers
Example:
$ mkvdev -sea ent0 -vadapter ent2 -default ent2 -defaultid 1 -attr ha_mode=auto ctl_chan=ent3 netaddr=9.155.50.1 largesend=1 ent4 Available en4 et4 $ lsdev -dev ent4 -attr attribute value ctl_chan ent3 Gvrp no ha_mode auto jumbo_frames no large_receive no largesend 1 netaddr 9.155.50.1 pvid 1 pvid_adapter ent2 real_adapter ent0 thread 1 virt_adapters ent2

Default adapter and VLAN used for untagged packages

SEA failover configuration parameters

description user_settable Control Channel adapter for SEA failover True Enable GARP VLAN Registration Protocol (GVRP) True High Availability Mode True Enable Gigabit Ethernet Jumbo Frames True Enable receive TCP segment aggregation True Enable Hardware Transmit TCP Resegmentation True Address to ping True PVID to use for the SEA device True Default virtual adapter to use for non-VLAN-tagged packets True Physical adapter associated with the SEA True Thread mode enabled (1) or disabled (0) True List of virtual adapters associated with the SEA (comma separated) True

Notes: The IP interface needs to be detached from the physical port before creating a SEA (chdev -dev en0 -attr state=detach) If using a HEA/IVE port for SEA, VIOS needs to be set as the promiscuous LPAR for exclusive HEA port usage.
16
2012 IBM Corporation

IBM Power Systems

IBM i Prerequisites Dual VIOS SEA Failover Configuration (4/4)


mktcpip use for configuring the VIOS TCP/IP setup on the SEA interface
Example:
$ mktcpip -hostname i7VIOS -inetaddr 9.155.50.108 -interface en4 -netmask 255.255.255.0 -gateway 9.155.50.1 -nsrvaddr 9.xxx.yyy.zzz -nsrvdomain mainz.de.ibm.com -start
or:

$ cfgassist with selecting menu item VIOS TCP/IP Configuration


VIOS TCP/IP Configuration Type or select values in entry fields. Press Enter AFTER making all desired changes. [Entry Fields] [i7vios] [9.155.50.108] [255.255.255.0] en4 [9.155.50.1] [9.xxx.yyy.zzz] [mainz.de.ibm.com] bnc

* Hostname * Internet ADDRESS (dotted decimal) Network MASK (dotted decimal) * Network INTERFACE Default Gateway (dotted decimal) NAMESERVER Internet ADDRESS (dotted decimal) DOMAIN Name CableType

F1=Help F5=Reset F9=Shell

F2=Refresh F6=Command F10=Exit

F3=Cancel F7=Edit Enter=Do

F4=List F8=Image

17

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites Deallocation of Optical Devices


Virtual optical devices need to be deallocated
virtual IOP #290A reset from IBM i SST unconfigure of virtual optical target device in VIOS (e.g. rmdev -dev vtopt0 -ucfg)

Note: Partition migration will not retain optical device mappings.

18

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites VIOS Mover Service Partitions


VIOS(s) on source and destination server flagged as Mover Service Partition
will automatically configure a vasiX device in VIOS)

19

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites Known HMC Code Issues

20

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites RMC Connection


Working RMC connection for VIOS partitions required
be careful with cloned VIOS generated e.g. by FlashCopy or alt_disk_copy as the ct_node_id needs to be unique
Procedure to create unique ct_node_id:
1. 2. 3. 4. #/usr/sbin/rsct/bin/rmcctrl k (stop rmc) #/usr/sbin/rsct/bin/mknodeid f (force node id creation) #/usr/sbin/rsct/bin/rmcctrl s (start rmc) # /usr/sbin/rsct/bin/rmcctrl p (this will enable remote client connections to the RMC subsystem) There are some cases when the nodeid is not regenerated, if so replace step 2 with: #/usr/sbin/rsct/install/bin/recfgct -i <new_ct_node_id> (for the new node id you can just can just modify the last 3-4 digits from /etc/ct_node_id)

21

2012 IBM Corporation

IBM Power Systems

IBM i LPM Prerequisites VSCSI Adapter IDs


VSCSI server adapter IDs dont need to match between source and target VIOS (mismatch creates a warning message only)

22

2012 IBM Corporation

IBM Power Systems

IBM i LPM Validation Task (1/2)


Selecting the IBM i partition to be migrated and choosing Operations Mobility Validate to check if all requirements for LPM are met before actually starting the migration

23

2012 IBM Corporation

IBM Power Systems

IBM i LPM Validation Task (2/2)


After successful Validate operation the virtual storage assignments can optionally be changed and a partition migration task can be started

All possible MSP network pairs are shown and user has to select a valid combination

24

2012 IBM Corporation

IBM Power Systems

IBM i LPM Migration Task


Starting the partition migration task

Note: VSCSI mappings and VSCSI server adapters are automatically removed on source VIOS(s)

25

2012 IBM Corporation

IBM Power Systems

IBM i LPM Migrated Partition on Destination Server


IBM i client partition successfully running on destination server

Note: The partition profile of the migrated LPAR is automatically removed from source server. While LPM tries to maintain the source server LPAR ID, the system serial number is different on the destination server with corresponding implications for ISV applications which base their licensing model on serial numbers.
26
2012 IBM Corporation

IBM Power Systems

IBM i Client Partition QSYSOPR Messages for LPM Migration Process


Additional Message Information Message ID . . . . . . : Message type . . . . . : Date sent . . . . . . : Message . . . . : Cause . . . . . : CPI09A5 Information 05/29/12 Severity . . . . . . . : Time sent . . . . . . : 00 20:28:11

Partition suspend request in progress. A request was made to suspend the partition.

Additional Message Information Message ID . . . . . . : Message type . . . . . : Date sent . . . . . . : Message . . . . : Cause . . . . . : CPI09A8 Information 05/29/12 Severity . . . . . . . : Time sent . . . . . . : 00 20:30:04

Partition resumed after migration. The partition has been migrated to another machine.

Note: Suspend (QIBM_QWC_SUSPEND) and resume (QIBM_QWC_RESUME) exit points:


http://publib.boulder.ibm.com/infocenter/iseries/v7r1m0/index.jsp?topic=%2Fapis%2Fxsuspend.htm http://publib.boulder.ibm.com/infocenter/iseries/v7r1m0/index.jsp?topic=%2Fapis%2Fxresume.htm 27
2012 IBM Corporation

IBM Power Systems

References
IBM i developerWorks Live Partition Mobility
https://www.ibm.com/developerworks/mydeveloperworks/wikis/home?lang=en#/wiki/IBM%20i%20Techno logy%20Updates/page/Live%20Partition%20Mobility

PowerVM Virtualization Introduction and Configuration, SG24-7940


http://www.redbooks.ibm.com/abstracts/sg247940.html?Open

PowerVM Virtualization Managing and Monitoring, SG24-7590


http://www.redbooks.ibm.com/abstracts/sg247590.html?Open

How to Setup SEA Failover on DUAL VIO servers


http://www-304.ibm.com/support/docview.wss?uid=isg3T1011040

28

2012 IBM Corporation

IBM Power Systems

Trademarks / Disclaimers
Trademarks The following are trademarks of the International Business Machines Corporation in the United States and/or other countries. For a complete list of IBM Trademarks, see www.ibm.com/legal/copytrade.shtml: AS/400, IBM, IBM Logo, iSeries, MVS, OS/390, pSeries, PowerVM, Power Systems, VM/ESA, VSE/ESA, Websphere, xSeries, z/OS, zSeries, z/VM The following are trademarks or registered trademarks of other companies Lotus, Notes, and Domino are trademarks or registered trademarks of Lotus Development Corporation Java and all Java-related trademarks and logos are trademarks of Sun Microsystems, Inc., in the United States and other countries LINUX is a registered trademark of Linux Torvalds UNIX is a registered trademark of The Open Group in the United States and other countries. Microsoft, Windows and Windows NT are registered trademarks of Microsoft Corporation. SET and Secure Electronic Transaction are trademarks owned by SET Secure Electronic Transaction LLC. Intel is a registered trademark of Intel Corporation PATROL for iSeries Predict is registered trademark of BMC Software Inc. Performance Navigator and What if are registered trademarks of Midrange Performance Group All other products may be trademarks or registered trademarks of their respective companies. Disclaimers Copyright 2010 by International Business Machines Corporation. No part of this document may be reproduced or transmitted in any form without written permission from IBM Corporation. Product data has been reviewed for accuracy as of the date of initial publication. Product data is subject to change without notice. This information could include technical inaccuracies or typographical errors. IBM may make improvements and/or changes in the product(s) and/or programs(s) at any time without notice. Unless otherwise note, the performance data contained herein was obtained in a controlled, isolated environment. Actual results that may be obtained in other operating environments may vary significantly. While IBM has reviewed each item for accuracy in a specific situation, there is no guarantee that the same or similar results will be obtained elsewhere. Other data may have been obtained from publicly available documents or sources. In such cases, IBM has endeavored to provide comparable measurements for systems being compared. References in this document to IBM products, programs, or services does not imply that IBM intends to make such such products, programs or services available in all countries in which IBM operates or does business. Any reference to an IBM Program Product in this document is not intended to state or imply that only that program product may be used. Any functionally equivalent program, that does not infringe IBMs intellectually property rights, may be used instead. It is the users responsibility to evaluate and verify the operation of anynon-IBM product, program or service. The information provided in this document is distributed "AS IS" without any warranty, either express or implied. IBM EXPRESSLY DISCLAIMS any warranties of merchantability, fitness for a particular purpose OR NONINFRINGEMENT. IBM shall have no responsibility to update this information. IBM products are warranted according to the terms and conditions of the agreements (e.g., IBM Customer Agreement, Statement of Limited Warranty, International Program License Agreement, etc.) under which they are provided. IBM is not responsible for the performance or interoperability of any non-IBM products discussed herein. Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM products should be addressed to the suppliers of those products. The provision of the information contained herein is not intended to, and does not, grant any right or license under any IBM patents or copyrights. Inquiries regarding patent or copyright licenses should be made, in writing, to: IBM Director of Licensing IBM Corporation North Castle Drive Armonk, NY 10504-1785 U.S.A.

29

2012 IBM Corporation

Potrebbero piacerti anche