2013 Cisco and/or its affiliates. All rights reserved.

sebarrag 1
IOS-XR Upgrade Procedures
Sergio Barragn CCIE#36903
Manuel Irizarry CCIE#3777
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 2
Agenda
! Introduction
! Definitions and Concepts
! Types of Upgrades
! CLI Upgrade demonstration
! Turboboot upgrade demonstration
! Tips
! Q&A
Definitions and
Concepts
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 4
Definitions
! Cisco IOS XR software comprises modular "packages." Each package contains
the components to perform a specific set of router functions, such as routing,
security, modular services card, or line card support.

! Package Installation Envelope (PIE) files (.pie extension) are compressed files
used to install the bootup, feature, or upgrade packages of a router. All PIE files
are installed using CLI commands. When a PIE file is installed, packages
contained in the PIE file are extracted and installed onto the storage device of
the route processor (RP). During this installation, a directory is automatically
created to store the components of the package. By default, the directory name
is based on the name of the package.
RP/0/RSP0/CPU0:ASR9006-C#show install active summary
Active Packages:
disk0:asr9k-mini-px-4.3.0
disk0:asr9k-fpd-px-4.3.0
disk0:asr9k-k9sec-px-4.3.0
disk0:asr9k-mcast-px-4.3.0
disk0:asr9k-mpls-px-4.3.0
disk0:asr9k-px-4.3.0.CSCud19987-1.0.0
disk0:asr9k-px-4.3.0.CSCue23747-1.0.0
disk0:asr9k-px-4.3.0.CSCue28217-1.0.0
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 5
Mand.
OS-MBI
Admin
Base
SC-GE
Mand.
MPLS
Multi-
cast
Opt'l
MSC or LC
OS-MBI
Base
Forwarding
Line card
Implementation locations
Mand.
Optl
DRP
Routing
MPLS
Multi-
cast
Manage-
ability
Security
OS-MBI
Base
Forwarding
Line card
MPLS
Multi-
cast
Manage-
ability
Security
Mand.
Optl
RP
OS-MBI
Base
Admin
Forwarding
Line card
Routing
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 6
IOS-XR Software Packaging (Mandatory)
! Mini : Composite image with mandatory packages. Contains:
Core packages, including OS, Admin, Base, Forwarding, Modular Services
Card, Routing, SNMP Agent, and Alarm Correlation.
Forwarding (FWDG)
Administration (ADMIN)
Base (BASE)
Operating System MBI (OS-MBI)
Routing (ROUT)
LC (LC) - Modular Services Card or Line Card
! Two types - .vm (bootable image) and .pie
! Multiple uses:
Quickly run an image without installing it (.vm)
Initial install of IOS XR (.vm)
Recovery if system is corrupted (.vm)
Major/Maintenance upgrade (.pie)
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 7
IOS-XR Software Packaging (Optional)
Optional packages provide additional features:

! Manageability (MGBL) Support for HTTP, XML, SNMP and other management
tools. CORBA agent, XML Parser, and HTTP server packages.
! Multicast (MCAST) Support for multicast protocols (PIM, MSDP, IGMP, Auto-
RP), Tools (SAP, MTrace), and Infrastructure (MRIB, MURIB , MFWD), and BIDIR-
PIM.
! MPLS (MPLS) Support for Multiprotocol Label Switching (MPLS). MPLS-TE,
LDP, MPLS Forwarding, MPLS OAM, LMP, OUNI, RSVP,and Layer-2 VPN and
Layer-3 VPN.
! Security (K9SEC) Support for Secure Sockets Layer (SSL), certificates and
other security tools. Support for Encryption, Decryption, IPSec, SSH, SSL, and PKI
! FPD (FPD) - Firmware for Fixed PLIM and SPA modules as well as ROMMON
images for Cisco CRS chassis.
! Diagnostic (DIAGS) - Diagnostic utilities for Cisco IOS XR routers.
! Documentation (DOC) - .man pages for Cisco IOS XR software on the Cisco CRS
chassis.
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 8
Software Versions P and PX Images
! Support for P and PX images was introduced in Release 4.0.0 of Cisco IOS XR
Software.
! PX is a superset of P image.
! Starting with Cisco IOS XR Release 4.2.0 for the CRS and 4.3.0 for the ASR9K
they will support only the PX image.
! Example:
asr9k-mini-p.pie or asr9k-mini-px.pie ??
The reason why there are 2 sets of files is because there are 2 hardware versions
of the RSP. The RSP2, the "old" RSP is based on a dual core PPC and the new
RSP440 that has a 4 core Intel processor.
Because PPC and INTEL handle endians differently, there are compiler differences
to generate sw for the different PPC and the INTEL.

Features and functionality are the same between RSP2 and RSP3.
IOS XR
Upgrade
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 10
Upgrade procedures
! CLI (recommended)
Has Rollback capability
Can be tested beforehand
! Turbo-boot
Good when dealing with low disk space
Good when dealing with corrupted filed.

2013 Cisco and/or its affiliates. All rights reserved. sebarrag 11
Preparations for a IOS Upgrade
1. Backup your configuration
2. READ the upgrade guide posted on CCO
http://www.cisco.com/web/Cisco_IOS_XR_Software/index.html
3. Read again the upgrade guide and look if a SMU is
required for an Upgrade/Downgrade. Also look in
the upgrade guide if it is possible to perform a CLI
upgrade or if turboboot is the Only option.
4. Download all upgrade files
5. Ideally, have physical access to the router.
6. Have a tftp / ftp server accessible from the router.
CLI
Upgrade
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 13
CLI Upgrade
! Install Operations:
1. Add
2. Activate
3. Commit
---------------------
1. Deactivate
2. Remove
3. Commit
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 14
CLI Upgrade
1. Download all the feature packages A.K.A. PIEs you currently
have. (You can download more feature packages than those
you currently have but NOT less)
RP/0/RP0/CPU0:CRS-G#show install active summary
Wed Aug 8 19:00:50.794 EDT
Active Packages:
disk0:hfr-doc-px-4.0.4
disk0:hfr-k9sec-px-4.0.4
disk0:hfr-mpls-px-4.0.4
disk0:hfr-mgbl-px-4.0.4
disk0:hfr-px-4.0.4.CSCtx96252-1.0.0
disk0:hfr-mcast-px-4.0.4
disk0:hfr-px-4.0.4.CSCtw73941-1.0.0
disk0:hfr-mini-px-4.0.4
disk0:hfr-fpd-px-4.0.4
disk0:hfr-diags-px-4.0.4

Note: The SMUs are NOT accounted.
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 15
Cont.
2. Add PIEs:
router(admin)# install add <source>/<path>/<pie> sync

Example:
router(admin)# install add <source>/hfr-mini-
p.pie-4.0.3 <source>/hfr- mcast-p.pie-4.0.3 sync
or
router(admin)# install add <source> hfr-mini-
p.pie-4.0.3 hfr-mcast-p.pie-4.0.3 sync
Disk0:
Disk1:
Direct add
TFTP, FTP,RCP, SFTP
Activate
Deactivate
Add
Commit
Server
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 16
Cont.
3. Activate PIEs:

Preliminary Test:
router(admin)# install activate disk0:hfr-mini-
p-4.0.3 disk0:hfr-mcast-p-4.0.3 sync test

Actual Activation:
router(admin)# install activate disk0:hfr-mini-
p-4.0.3 disk0:hfr-mcast-p-4.0.3 sync
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 17
Cont.
4. After the packages have been installed, the system
will reload in order for the changes to take effect.
Once the system is back up perform a install
commit command to confirm. Else, the next time
the box reloads, it will boot on the previous IOS.
5. Remove all inactive packages:
router(admin)# show install inactive
router(admin)# install remove
disk0:<package_name1> disk0:<package_name2> ..
disk0:<pkg_nameN> sync
Or to remove all at once:
router(admin)# install remove inactive
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 18
Troubleshoot CLI Upgrade
! Is the TFTP server reachable?
! Ensure there is no Firewall, Antivirus, etc blocking the
transfer.
! Is do the File on the Server has the necessary read/
write permissions?
! Did we added at least the exact same optional files?
(New versions vs old version)
! Was there any corruption with the file? Transfer again
the file and/or download it again from CCO
Turbo-Boot
Upgrade
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 20
Turboboot Preparation
! Show run interface mgmtEth 0/RSP0/CPU0/0
! Show route 0.0.0.0/0
! Make sure the TFTP server is reachable via the
Management port.
! Physical access to the router HIGHLY advisable.
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 21
Turbo Boot
1. Bring BOTH RSP into rommon.
RP/0/RSP0/CPU0:Router(admin)#config-register
boot-mode rom-monitor
and reload the router.

2. On standby:
Rommon1>unset BOOT
Rommon2>confreg 0x102
Rommon3>sync
Rommon4>reset
(this will keep it in a booting loop)
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 22
Cont.
3. (Optional) If Disk Mirroring was enabled, then this
needs to be disabled via rommon:

unset BOOT_DEV_SEQ_OPER
unset MIRROR_ENABLE
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 23
Cont.
4. On the Active RSP:
Rommon1>IP_ADDRESS=<a.b.c.d>
Rommon2>IP_SUBNET_MASK=<mask>
Rommon3>TFTP_SERVER=<a.b.c.d>
Rommon4>DEFAULT_GATEWAY=<a.b.c.d>
Rommon5>unset BOOT
Rommon6>TURBOBOOT=on,disk0,clean
Rommon7>sync
Rommon8>boot tftp://a.b.c.d/path/hfr-mini-
px.vm-4.0.0
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 24
Turboboot TFTP Alternatives:
! The RSP-440 can boot from the USB front panel port
like this:
The command is mediaboot usb:\yourfilename
Example:
mediaboot usb:\asr9k-mini-px.vm
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 25
Troubleshooting Turboboot
! Is the Management port up?
rommon B2 > portstatus 1
Port 1 link is down
Port 1 speed is 10 mpbs
! Is the TFTP Server reachable?
! Is the File accessible?
! Adjust Turboboot variables:
TFTP_RETRY_COUNT=20
sets the number of retries to contact the tftp server. (default 18)

TFTP_TIMEOUT=8000
sets the TFTP timeout for the transfer, you may need to set this larger to prevent abort during xfer if there
are network delay. (default 7200)

TFTP_MGMT_INTF=0
Mgmt Ether interface connected to (0 or 1 default = 0)
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 26
Troubleshooting Turboboot
! Change the default behavior of RP in ROMMON to not reset in 30 minutes
Rommon> priv
Rommon> diswd <- Disable the CPU watchdog
! Make sure they the system was Turboboot and NOT Memboot (show install
active summary should show the packages on disk0 if turboboot and nvram or
similar if Memboot)
Tips
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 28
Watchdog CRS issue CSCtw47685
! If you are running a CRS bellow 4.3.0 ALWAYS
perform the following before a full system reload: (as
part as any upgrade procedure, a full reload is required so this me be
encountered) This has no service affectation nor impact.
RP/0/RP1/CPU0:CRS-A#format bootflash:
monlib-only location all
! What could happen on CSCtw47685?
RPs or MSC may fail to come up after a reload.
The RP will be in a boot loop. Can be easily recovered
though the process takes usually an additional hour.
MSC will need to be RMA
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 29
Watchdog CRS issue CSCtw47685
! How to identify if we hit the Watchdog issue?
! If your RP is in a constant loop trying to boop:

System Bootstrap, Version 2.1(20100723:223432) [CRS-1 ROMMON],
Copyright (c) 1994-2010 by Cisco Systems, Inc.

Acquiring backplane mastership ........failed
Board type is 0x100002 (1048578)
Switch 0 initialized
Backplane FE port Up... Enabling
Enabling watchdog
G4(7457-NonSMP-MV64360 Rev 4) platform with 4096 MB of main memory
..

! The constant reload after the two points is the Key
2013 Cisco and/or its affiliates. All rights reserved. sebarrag 30
Watchdog CRS issue CSCtw47685
! How to recover the RP:
For each RP affected by this problem:

- Connect to RP console and take it into rommon ( hit control + c )
- Enter these commands to disable the watchdog timeout and reboot:

WATCHDOG_MODE=1
sync
reset

- When the RP is running IOS XR, format the bootflash. (format bootflash: )
- Reload the RP. (reload)
- Take the RP again into rommon by hitting Ctrl+c

unset WATCHDOG_MODE
sync
reset

- Router should come back up in IOS XR.
Q&A
Thank you.