Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
2012
www.ceq.com.ua
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 2
Session Goal
To provide you with a thorough understanding of the Cisco ASR 9000 Router
architecture, RSP, fabric, and line card design, packet flows, and ASR 9000 nV
architecture
This session will not examine baseline IOS-XR, for example, IOS-XR control
plane and management plane protection, modular OS design, software package,
SMU installation, IOS-XR routing configuration, etc
This session will not examine the baseline configuration of ASR 9000, such as
L3, L2 forwarding and feature configurations.
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Agenda
HW Overview
– Chassis, RSP, line card, service modules
System Architecture
– Fabric architecture
– Line card architecture
– ASR 9001 architecture
– Packet flow, control plane and data plane
– Internal multicast replication
– System scale
nV (network virtualization) Architecture
– nV edge
– nV satellite
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 4
Cisco ASR 9000 Overview
Next Generation Service Provider Edge/Aggregation
Large Data Center Inter-Connect and Cloud Gateway
o Designed for Longevity & TCO:
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 5
48 Tbps
ASR 9000 Chassis Overview
Same HW&SW architecture, identical features
across different chassis type
one ASR 9000 family 7 Tbps
3.5 Tbps
240 Gbps
ASR 9001 (Ironman) ASR 9006 ASR 9010 ASR 9922 (Megatron)
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 6
ASR 9010 and ASR 9006 Chassis
Front-to-back
Integrated cable airflow
management
with cover
Air draw
cable 6 or 8 Modular
management 3 or 4 Modular Power Supplies
Power Supplies
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 7
ASR 9001 “Iron Man” Chassis
Two Modular bays
Supported MPA: 20xGE, 2/4x10GE, 1x40GE (2HCY12)
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
ASR 9922 “Megatron” Chassis
8+8 ACs or
11+1 DCs
22x RPs
x RPs
• AC & DC power supplies
Power • Pay As You Grow Modular Power
6+1
4+1 FCsFCs
• 24KW max power, ~30W per 10GE
Fan trays 2x
(ASR-9922-FAN)
* ASR 9922 RP and switch fabric ASIC are separated on different physical card. The RP portion is the same as RSP440
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
Power and Cooling
DC Supplies
A
B 2.1/1.5 kW Single power zone
A All power supplies run in active mode
B 2.1 kW
Power draw shared evenly
Power Supply AC Supplies 50 Amp DC Input or 16 Amp AC
for Easy CO Install
A 3 kW
B 3 kW
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
ASR 9006/9010 RSP (Route/Switch Processors )
RSP2 RSP440
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 11
RSP440 – Front Ports
Note, red color is the new functional ports, which is
1G/10G SFP+ * supported on RSP440 only, not RSP2
EOBC ports for nV Cluster
LEDs
USB Type A Status, Alarm
Aux
IEEE 1588, GPS
SyncE, IEEE1588 master and slave
10/100M Copper Ethernet Console
BITS/J.211
Sync 0, Sync 1
RJ45
Management
Ethernet
* nV EOBC port only support 1G with SFP optics in the current shipping release. 10G (SFP+ optics) support plan for the
future release
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 12
RSP Engine Architecture
BITS Time
Clock
FPGA
MEM Timing Domain
HDD
CF card
or USB
Mgt Eth CPU
Ether
Mgt Eth Switch EOBC/
Internal GE switch
Console
Aux 4G disk Punt Arbiter
FPGA FIA Arbitration
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
ASR 9000 Ethernet Line Card Overview
-L, -B, -E
First-generation LC
(Trident NP)
-TR, -SE
Second-generation LC
(Typhoon NP)
A9K-MOD80 A9K-MOD160
A9K-24x10GE A9K-2x100GE MPAs
20x1GE
2x10GE
4x10GE
1x40GE
2x40GE
Presentation_ID A9K-36x10GE
© 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
ASR 9000 SIP-700 and SPA
SPA support list:
http://www.cisco.com/en/US/partner/prod/collateral/routers/ps9853/data_sheet_c78-573452.html
Strong QoS Scalability
• 128+K Queues, • Distributed control and data
• 128+K Policers plane; 20G; 4 Bays
High Availability
• H-QoS • L3 i/f, route, session,
protocol – scaled up for • IC-Stateful Switch Over
• Color Policing capability,
MSE needs
• MR-APS
• IOS-XR base for high scale
and reliability
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
ASR 9000 ISM (Integrated Service Module)
• Integrated application intelligence into the ASR 9000 System
Converged
• Reduced footprint, power and cooling
• Use with existing CDS deployments Feature ASR 9000 ISM Capabilities
Flexible
• CGN Integration: NAT44, DS-lite AFTR Ultra-Dense VoD, TV,
Applications
Internet Streaming, Error Repair, CGv6
HW Overview
System Architecture
– Fabric architecture
– LC architecture
– ASR 9001 architecture
– Packet flow, control plane and data plane
– Internal multicast replication
– System scale
nV Architecture
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
ASR 9000 System Architecture
“At-a-Glance”
Line Card
RSP
CPU
CPU BITS/DTI
FIA
FIC
Switch Fabric
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
ASR 9000 Switch Fabric Overview
3-Stage Fabric
8x55Gbps =440Gbps with dual RSP
4x55Gbps=220Gbps with single RSP
fabric fabric
Arbiter
FIA
FIA FIA
FIA RSP0 FIA
FIA
fabric
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 19
Fabric Back-compatible: Mix New and
Existing LC
FIA0 8x23G bi-directional
8x55G bi-directional
FIA1 fabric
fabric
Dual-FIA 8xNPs 1st
gen Linecard Arbiter FIA
FIA
RSP0 FIA
FIA 2nd gen Line Card
fabric
Single-FIA 4xNPs
1st gen Linecard
RSP1
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 20
Fabric Forward-compatible:
Mix New LC and Existing Switch Fabric
FIA0 8x23G bi-directional
8x23G bi-directional
FIA1
fabric
fabric
Single-FIA 4xNPs
1st gen Linecard
RSP1
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
ASR 9922 Fabric Architecture : 5-plane
System
550Gbps/LC or fabric
440Gbps/LC with fabric
redundancy
FIA
FIA
FIA
2nd gen Line Card
RSP 3 Switch
Fabric
FIA
FIA fabric
FIA
fabric
FIA
FIA
FIA
2nd gen Line Card 7-plane (6+1)
2nd gen Line Card
All fabric connections are fully-meshed,
2ndFabric
stage faic
cards
non-blocking
2x55G links
110G per fabric plane
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
ASR 9000 Line Card Architecture Overview
10x1GE NP1 B0
4x23G
FIA0
PHY NP2 B1
PHY NP3
A9K-4T Switch
Fabric
RSP0
3x10GE CPU
SFP + Typhoon
3x10GE
NP1
FIA0
SFP +
Typhoon Line card
2nd generation
3x10GE
NP2
Fabric ASIC
Switch
SFP +
3x10GE
NP3
FIA1 8x55G Switch
SFP +
Fabric
3x10GE
SFP + NP4 RSP1
3x10GE FIA2
SFP + NP5
3x10GE
SFP + NP6 9010/9006
3x10GE FIA3
SFP + NP7
A9K-24x10G
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
LC Architecture Example – 24x10G
CPU
3x10GE
SFP + NP
3x10GE
NP
FIA
SFP + 8x55G
3x10GE
NP
LC Switch Fabric
SFP +
3x10GE
NP
FIA Switch
Fabric
SFP +
ASIC
RSP0
3x10GE
SFP + NP
3x10GE FIA
SFP + NP
3x10GE Switch
SFP + NP Fabric
3x10GE
NP
FIA RSP1
SFP +
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 24
LC Architecture Example – 2x100G
CPU
Ingress
100G
NP FIA
8x55G
100GE
MAC/PHY
LC Switch Fabric
Egress
FIA
100G
Switch
NP Fabric
ASIC
RSP0
Ingress
100G
NP FIA
100GE
Switch
MAC/PHY Fabric
Egress
100G
NP FIA RSP1
MUX
FPGA
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
NP Architecture Details
STATS MEMORY
FIB MAC
LOOKUP Forwarding chip (micro cpu) FRAME MEMORY
MEMORY
- TCAM
NP complex
Each NPU has Four Main Associated memories TCAM , Search/Lookup memory , Frame/buffer memory and
statistics memory
– TCAM is used for VLAN tag, QoS and ACL classification
– Lookup Memory is used for storing FIB tables, Mac address table and Adjacencies
– Stats memory is used for all interface statistics, forwarding statistics etc
– Frame memory is buffer memory for Queues
E/B/L or –SE/-TR line card have different TCAM , Stats and Frame Memory size, which give different scale
number such as ACL, QoS queues, L2/L3 sub-interfaces, etc per line card
However, lookup Memory is the same across line card s why?
– To support mix of the line cards without impacting the system wide scale including FIB table, MAC
address table, MPLS label space
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
ASR 9001 Architecture
ASR 9001 Overview
System Architecture Overview
MPAs
2,4x10GE
20xGE
1x40GE
NP FIA
MPAs NP
2,4x10GE
20xGE
FIA
1x40GE
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
Agenda
HW Overview
System Architecture
– Fabric architecture
– LC architecture
– ASR 9001 architecture
– Packet flow, control plane and data plane
– Internal multicast replication
– System scale
nV Architecture
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
ASR 9000 Fully Distributed Control Plane
ASIC
Switch Fabric
SFP +
3x10GE FIA HSRP/VRRP, etc
NP
SFP +
3x10GE
SFP +
NP LC CPU: ARP, ICMP, BFD, Netflow,
FIA
3x10GE
SFP +
NP OAM, etc
3x10GE
NP
SFP +
3x10GE FIA
NP
SFP +
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Packet Flow Overview – 2-stage Forwarding
1 2
Egress NP look up
Ingress NP look up
Get egress NP information Get egress logical port, VLAN,
(added into the NP/fabric MAC, ADJ information, etc for
header), apply ingress features packet rewrite, apply egress
features
3x10GE
SFP + NP
3x10GE
FIA
NP
SFP + 1 Ingress 100G
FIA
NP
3x10GE 100GE
SFP + NP
MAC/PHY
FIA
Switch Fabric
3x10GE
Switch
Egress
NP Fabric
Switch Fabric
100G
SFP + FIA NP
2
ASIC
3x10GE
ASIC
SFP + NP
3x10GE
FIA FIA
Ingress
NP 100G
SFP + NP
100GE
3x10GE MAC/PHY
SFP + NP
Egress
FIA Switch FIA NP 100G
3x10GE
SFP +
1
Typhoon Fabric
2
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 30
Internal Multicast Replication Overview
1 Fabric to LC Replication FGID – Fabric Group ID
Efficiency: replicate if required
MGID – Multicast Group ID
MFIB
3x10GE Typhoo MGID
SFP + 4n 3
3x10GE
FIA
SFP + NP
4
FIA Ingress
NP
3x10GE FGID/ 100GE
NP
ASIC
Switch Fabric
SFP + FPOE
MGID/ MAC/PHY
FIA MGID/
FPOE 1
Switch
FPOE MFIB
ASIC
Switch Fabric
3x10GE
NP MGID Egress
SFP + Fabric FIA 4
NP
2 2 3
3x10GE
SFP + NP
3x10GE
FIA FIA
Ingress
NP
SFP + NP
100GE
3x10GE MAC/PHY
SFP + NP
Egress
FIA Switch FIA NP
3x10GE
SFP + NP Fabric
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
ASR 9000 System Scale Overview
RSP2 and RSP440 and
Feature Comments
Trident line card Typhoon line card
MAC 512K 2M
L3 VRF 4K 8K
BD/VFI 8K 64K
PW 64K 128K
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
Agenda
HW Overview
System Architecture
– Fabric architecture
– LC architecture
– ASR 9001 architecture
– Packet flow, control plane and data plane
nV Architecture
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
ASR 9000 nV Technology Overview
SP Services/ Third-Party
Content Services/ Content
Before: nV Technology After: nV Technology
Cisco
Prime IP NGN
Each device managed
Core Edge and aggregation
separately: different CLI
managed as one virtual system
experience, different image
through Cisco Prime IP NGN
upgrade, different release
cycle Edge nV Edge Plug-N-Play for the satellite:
Reduced protocol complexity
Manual and complex protocols
configuration between edge
and aggregation
Residentia
l
Converged
Business nV between edge and aggregation
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
ASR 9000 nV Satellite Overview
Self-managed Access
Local user
interfaces
“virtual/remote” user Satellite Protocol
interfaces
Install special satellite image on the selected access device to make it ASR9K nv satellite
Satellite and ASR 9000 Host run satellite protocol for auto-discovery, provisioning and management
Satellite and Host could co-locate or in different location. There is no distance limit between satellite and Host
The connection between satellite and host is called “nv fabric link”, which could be L1 or over L2 virtual circuit (future)
From end user point of view, satellite looks/feels/works like a ASR9K “remote or virtual” line card. The interfaces on the satellite
looks/feels/works the same as the interfaces on the local ASR9K line cards
From end user point of view, ASR9K Host and associated satellites is one virtual Router system. Satellite is plug-n-play, zero touch
configuration/management
• Copper and fiber SFP optics • Copper and fiber SFP+ optics
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. • -40C to +70C Storage
Cisco PublicTemperature 36
Satellite – Host Control Plane
Satellite discovery and control protocol
CPU MAC-DA MAC-SA Control VID Payload/FCS CPU
Control Phase
• Used for Inter-Process Communication between Host and Satellite
• Cisco proprietary protocol over TCP socket for the time being. It could move to standard in the future
• Get/ Set style messages to provision the satellites and also to retrieve notifications from the satellite
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 37
Satellite – Host Data Plane Encapsulation
MAC-DA MAC-SA VLANs (OPT) Payload MAC-DA MAC-SA VLANs (OPT) Payload
Satellite add special nV-tag, then local xconnect packet to its fabric port
Put packet into fabric port egress queue, transmit packet out
On Host
• Host receive the packet on its satellite fabric port
• Check the nV tag, then map the frame to the corresponding satellite virtual
access port
• From there, process packet just as local port, apply potential L2/L3 features,
qos, ACL, etc
• Packet is forwarded out of local port, or satellite fabric port to same or
different satellite
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
Satellite Operation (1) – End User View
“nv” Ethernet interface sample CLIs
Virtual Satellite
access port –
represent real
satellite access port
Satellite ASR 9000v Satellite/Host
Fabric port
One ASR 9000 nV System ASR 9000 Host
Satellite access port is represented by virtual “nv” interface on the Host. User configure this virtual interface just as
regular local L2/L3 interface or sub-interface on the Host
If real access port goes down, then the “nv” interface will go down as well. If shut down the “nv” interface, then the
real satellite access port will shut down as well
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
Satellite Operation (2) – Packet Flow
ASR 9000v
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
nV Edge Architecture Overview
Special external EOBC 1G/
One Virtual ASR 9000 nV System
10G ports on RSP
Control Plane EOBC Extension (L1 or L2 connection)
0 1
Active Secondary Standby Secondary
RSP RSP RSP RSP Internal
EOBC
LC LC LC LC LC LC LC LC
Control plane extension: Active RSP and standby RSP are on the different chassis, they
sync up via external EOBC links “AS IF” they are in the same physical chassis
Data plane extension: bundle regular data links into special “nV fabric link” to simulate
switch fabric function between two physical chassis for data packet across
Doesn’t require dedicated fabric chassis flexible co-located or different location
deployment
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
nV Edge Configuration
1 Configure nv Edge globally
nv
edge-system
serial FOX1437GC1R rack 1 static mapping of chassis serial# and rack#
serial FOX1439G63M rack 0
interface TenGigE1/2/0/0
nv edge interface
interface TenGigE0/2/0/0
nv edge interface
NO need to configure the inter-chassis control plane EOBC ports. It’s plug-and-play J
After this configuration, rack 1 will reload and then join cluster after it boot up
Now you successfully convert two standalone ASR 9000 into one ASR 9000 nV Edge
As simple as this !!!
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
Supported Topologies in initial release
Satellite must have direct Ethernet over Fiber/copper or Ethernet over Optical transport system
(such as Ethernet over a SONET/ SDH/ CWDM/ DWDM network: ring, mesh topology, etc)
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Satellite Configuration Examples
nv
satellite 101 define satellite ID range <100-65534>
type asr9000v
ipv4 address 10.0.0.101 ß internal communication IP address between
host and satellite. This configuration will be optional in the future
release with the “auto-IP” feature
satellite 102 define satellite
ipv4 address 10.0.0.102
type asr9000v Management IP could be put into VRF
interface bundle-ethernet 1
ipv4 point-to-point
ipv4 unnumbered Loopback0 Fabric link
nv
satellite-fabric-link satellite 102 bundle
remote-ports
GigabitEthernet 0/0/0-43
Presentation_ID © 2012 Cisco and/or its affiliates. All rights reserved. Cisco Public 45