Segment Routing

Clarence Filsfils
Distinguished Engineer
cf@cisco.com
Segment Routing
• Unified
– DC + WAN + Aggregation
– from server in the DC, through WAN and to the service edge

• Policy-aware
– DC: disjoint planes, flow-based congestion avoidance
– WAN: disjoint services, latency-sensitive traffic, scheduled bulk transfer

• Application programs the end-to-end policy

– The end-to-end policy is encoded by the application as an SR segment list in the packet header

• Balance between distributed and centralized intelligence

– Distributed: automated sub-30msec FRR link/node in any topology with optimum backup path
– Centralized: traffic optimization for better use of the installed capacity

• Applicable to MPLS and IPv6 dataplanes

• Much simpler to operate than MPLS Classic

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 2
Key Concepts
Segment Routing

 Source Routing: the source chooses a path and encodes it in the packet
header as an ordered list of segments.
 Segment: an identifier for any type of instruction
 Service
 Context
 Locator
 IGP-based forwarding construct Segment = Instructions such as
 BGP-based forwarding construct "go to node N using the shortest path"
 Local value or Global Index

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 4
Segment Routing

 MPLS: an ordered list of segments is represented as a stack of labels

 SR re-uses MPLS dataplane without any change
 IPv6: an ordered list of segments is represented as a routing
extension header, see 4.4 of RFC2460
 IGP-based segments require minor extension to the existing link-
state routing protocols (OSPF and IS-IS).

The remainder of this session focuses on SR on MPLS dataplane

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 5
IGP Segments

Node segment to C
Node segment to C
A B C D

Adj Segment Z

M N O P

Node segment to Z

 Simple extension to let IGP install segments in the MPLS dataplane

 Excellent Scale: a node installs N+A FIB entries
 N node segments and A adjacency segments
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 6
Node Segment
FEC Z swap 16065 swap 16065
push 16065 to 16065 to 16065
pop 16065
A B C D A packet injected
Z 16065 anywhere with top
16065 16065 16065
Packet to Packet to Packet to Packet to Packet to
segment 16065 will
Z Z Z Z Z reach Z via
shortest-path

• Z advertises a global node segment 16065 with its loopback

– simple ISIS sub-TLV extension
> default SRGB [16000, 23999] at all nodes is a request from all lead operators for operational
simplicity. The protocol and implementation allows for different SRGB at every node

• All remote nodes install in their FIB the node segment 16065 to Z
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 7
Node Segment

A B C D

M N O P
16078

• ECMP
– A node segment to 16078 distributes traffic across all ECMP paths
to O

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 8
Adjacency Segment

A B
M N
A packet injected at
C D
node C with segment
Pop
29003
Z 29003 is forced
O P through datalink CO

• C allocates a local segment 29003 and maps it to the instruction

“complete the segment and forward along the interface CO”
• C advertises the adjacency segment in ISIS
– simple sub-TLV extension
• C is the only node to install the adjacency segment in FIB
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 9
Explicit path as Segment List

• ECMP 16072 16072

16078 16078
– Node segment 16065 16065
16078
16065
Packet to Z Packet to Z Packet to Z
• Per-flow state only at 16072 16072
head-end A B C D

– not at midpoints 16078 Z

M N O P 16065
• Source Routing 16065 Packet to Z
– the path state is in the packet 16065 16065
Packet to Z Packet to Z
header

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 10
Automated 50-msec Protection for IGP Segments
 Guaranteed Link/Node FRR in any topology
 50msec protection
 Simplicity
 Entirely automated
 No directed LDP session
 No RSVP-TE tunnels

 Incremental deployment
 Applicable to LDP primary traffic

 Optimal backup path along postconvergence path

 Prevents transient congestion and suboptimal routing

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 11
What is Segment Routing?

IP/MPLS architecture that seeks the right balance between distributed intelligence and centralized
optimization and programming.
 simplifies operation (lower opex)
 enables application-based service creation (new revenue)
 allows for better utilization of the installed infrastructure (lower capex)

An IP/MPLS architecture with wide application

 (SP, OTT/Web, GET) across (WAN, Metro/Agg, DC)
 MPLS and IPv6 dataplanes
 SDN controller

An architecture designed with SDN in mind

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 12
Industry Acceptance &
Standardization
Strong Operator Partnership

 Fundamental to the velocity

and success
 Significant commitment
 technical transparency
 multi-vendor commitment
 beta and poc

 Many more operators now involved

 Deployments in a few months

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 14
 www.segment-routing.net
IETF

• Working-Group is created
• Use-Case is WG status
• Architecture is WG status
• Protocol Extension is WG status
• ~ 25 drafts maintained by SR team
Over 50% are WG status
Over 75% have a Cisco implementation

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 15
SR ToolBox
SR ToolBox
Impressive in < 24months

ISIS Prefix and Adjacency Segment with 50msec link-FRR IOS-XR 5.2.2

SR/LDP seamless interworking for ISIS IOS-XR 5.2.2

OSPF Prefix and Adjacency Segment with 50msec link-FRR IOS-XR 5.3.0

SRTE Head-end on ASR9k Beta

SRTE head-end on VPEF Beta

BGP Peering Segment Beta

BGP Prefix Segment Beta

SR Planning and Design Mate Design 6.0

Get involved and provide ideas and requirements

Leverage dcloud.cisco.com virtual labs
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 17
SR Traffic Engineering
SRTE Headend

• Classify packets and push the matching segment-list

– All the TE functionality is leveraged (counters, autoroute, PBTS...)

• Network Design
– Virtual PE facing Application VM’s: VPP beta available
– DCI, PE or Aggregation: IOS-XR/ASR9k beta available

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 19
SRTE midpoint

• Does not exist

– No state overhead
– No signalling overhead

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 20
SR Policy Computation

Router (headend) WAE Mate Design

Latency V V V

Avoid a topological resource V V V

Disjoint from another service V (if both originate on the same head- V V
end)

BW - V V

Inter-Area/Inter-Domain - V V

Integration with IP/Optical - V V

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 21
The benefits of centralized TE

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 22
www.opennetsummit.org/archives/apr12/hoelzle-tue-openflow.pdf
The benefits of centralized TE

• Centralized Traffic Engineering

 Better optimum
 Better predictability
 Faster convergence
 Better suited for Application Programmability (Nbound-API)
 Network Programmability (Sbound-API, PCEP)

• Centralized TE with Segment Routing

 Controller expresses path as segment list
 Network maintains segments and provide FRR for them
 ECMP-awareness
 No signalling and per-flow state at midpoint

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 23
www.opennetsummit.org/archives/apr12/hoelzle-tue-openflow.pdf
Centralized Traffic Engineering

16065
2G from A to Z please
FULL

16065
Link CD is full, I cannot use the
shortest-path 65 straight to Z

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 24
Centralized Traffic Engineering
Tunnel AZ onto
{16066, 16068, 16065} 16066
FULL

16068
16065

Path ABCOPZ is ok. I account the BW.

Then I steer the traffic on this path

• Highly programmable and responsive to rapid changes

– perfect support for centralized optimization efficiency, if required
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 25
Real Data-Set
2014

1000
times
less
tunnels

SR-TE and Centralized Controller: 50% capex gain with better

predictibility and optimality than RSVP-TE and with 1000 times less
tunnels
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 26
SRTE Optimization
Real Data Sets
BGP Peering Segment
 Automated BGP Peering SID allocation

BGP Peering SID’s in C’s MPLS Dataplane

PeerNode SID’s:
16012: pop and fwd to 1.0.1.2/32
16022: pop and fwd to 1.0.2.2/32
16052: pop and fwd to 1.0.5.2/32 (ecmp!)

PeerAdj SID’s:
16032: pop and fwd to 1.0.3.2/32
16042: pop and fwd to 1.0.4.2/32

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 29
BGP-LS extensions to signal Peering SID to controller
• The controller learns the BGP Peering
SID’s and the external topology of the
egress border router via BGP-LS EPE
routes

BGP EPE Signalling from

egress PE to Controller

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 30
BGP Prefix Segment
MSDC

• Massive Scale DC
– Built on BGP3107
• BGP Prefix Segment
– Straightforward BGP3107
extension
– BGP equivalent to IGP
Prefix SID eBGP ipv4
labeled-unicast

– Any node within the eBGP ipv4 unicast

topology allocates the
same BGP Segment for https://www.nanog.org/meetings/nanog55/presentations/Monday/Lapukhov.pdf

the same switch https://www.nanog.org/sites/default/files/wed.general.brainslug.lapukhov.20.pdf

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 32
BGP Prefix SID

• Same benefits as IGP Prefix

SID
– ECMP
– Automated FRR (BGP PIC)
– Building block for Traffic Engineering

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 33
Use-Cases and Benefits
TI-LFA: Automated 50-msec Protection for IGP Segments
 Guaranteed Link/Node FRR in any topology
 50msec protection
 Simplicity
 Entirely automated
 No directed LDP session
 No RSVP-TE tunnels

 Incremental deployment
 Applicable to LDP primary traffic

 Optimal backup path along postconvergence path

 Prevents transient congestion and suboptimal routing

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 35
 Mate Design – TILFA Simulation
• How many segments in backup chain

• Capacity analysis
during FRR transient state

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 36
IPv4 MPLS Transport with FRR
Any service resolving
A B on IGP IPv4 Prefix SID
 Internet
PE1 PE2
 VPNv4
M N
 6PE

All VPN services ride on the prefix segment to PE2  PW

• IPv4 over MPLS: the obvious way it should have been done
– Just the IGP to operate
– Sub50msec FRR integrated and automated

• Seamless migration
– SR/LDP interworking

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 37
IPv6 MPLS Transport with FRR
Any service resolving
A B on IGP IPv6 Prefix SID
 Internet v6
PE1 PE2
 VPNv6
M N

Internet/v6 rides on the Prefix segment to PE2

• IPv6: the opportunity to do it right from the start

– Just the IGP to operate
– Sub50msec FRR integrated and automated

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 38
 9101
MPLS dataplane monitoring 9105
9107
9108
9104
9107 9105
B C 9108
9101
9105 9102

A 9108 OAM
9105
9108

9102 N O

9104

draft-geib-spring-oam-usecase-02
Nanog57, Feb 2013
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 39
 Beta Available

Disjoint TE Service
• A to Z any plane
– IGP shortest-path
– PrefixSID of Z (65) 16065
pkt
• A to Z via blue plane
– SRTE policy pushes one additional
segment “Blue Anycast” (111)

• Benefits
– ECMP
– No hop-by-hop signalling load and delay
– No midpoint state 16111
16065
pkt

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 40
Latency TE Service
• Data from Tokyo to Brussels
– IGP shortest-path via US, higher and cheaper capacity
– PrefixSID of Brussels

• Voice from Tokyo to Brussels

– SRTE policy pushes one additional segment “Russia Anycast” Node segment to Brussels
– Low-latency path Node segment to Russia
• Benefits
– ECMP Russia
– Availability of the anycast segment against node failure Brussels Brussels
– No hop-by-hop signalling load and delay pkt pkt
– No midpoint state Data Voice

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 41
Content producer engineers its WAN traffic to egress peers

AS1
PrefixSID(B) Payload
Payload B AS2 D
Best BGP
and IGP
Path
ISIS/SR-based WAN AS4

A 9.9.9.9/32

PrefixSID (C)
C E
TE Policy
installed by PeeringSID(E)
Controller
Payload
Engineered Path PeeringSID(E) AS3
Payload

Payload
Engineered Path

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 42
SR-based MSDC

• MPLS dataplane
• BGP control-plane
– No LDP, No RSVP-TE
– Integrated/Automated FRR
> no hop-by-hop manual configuration of static routes and their FRR behaviors

• Global label for easier operation

– Same SRGB at each switch
• SRTE WAN Optimization Controller applicable to DC fabric

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 43
Distributed DC for Content Engineering to local Peers
AS1
PrefixSID(B) Payload
Payload B AS2 D
Best BGP
Path
BGP/SR-based DC Fabric AS4

9.9.9.9/32

PrefixSID (C)
C E
TE Policy
installed by PeeringSID(E)
Controller
Payload
Engineered Path PeeringSID(E) AS3
Payload

Payload
Engineered Path

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 44
End-to-end policy from DC, through WAN to peer

App SR DC SR WAN BR

vPEF ToR Leaf Spine DCE LSR BR

App
BR

Next segments
Classify implement
Top Segment
flow and WAN Policy: Last segment
provides
push SR Cost vs Latency selects egress
ECMP-path to
segment Disjointness peer
selected DCI
list Select egress
BR
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 45
End-to-end policy from DC, through WAN to peer

SR DC SR WAN BR

ToR Leaf Spine DCE LSR BR

BR

Illustrated end-to-end policy implemented by the

application:
• Two service hops in the DC
• Low-latency path in the WAN
• Engineered peering exit to Internet consumer
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 46
Large-Scale Aggregation ASBR SID’s are anycast

ASBR SID’s are unique

across the entire domain

Acces1 Core Acces2 ASBR anycast prefixes and

A ASBR1A ASBR2A SID are redistributed within
70 1001 1002 each access region
C
72 Access Nodes are provided a
ASBR1B ASBR2B SID which is unique with
B 1001 1002 respect to its attached
72 ASBR’s but not necessarily
unique across the whole
domain

• Only IGP/SR (no BGP) {72} leads to B within Access1

{72} leads to C within Access2
– Automated FRR including ASBR failure
{1001, 72} leads to B from anywhere
• SRGB (k) << # access nodes (100k) {1002, 72} leads to C from anywhere

• SDN Controller programs the segment list together with service creation
© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 47
Conclusion
Segment Routing
• Unified
– DC + WAN + Aggregation
– from server in the DC, through WAN and to the service edge

• Policy-aware
– DC: disjoint planes, flow-based congestion avoidance
– WAN: disjoint services, latency-sensitive traffic, scheduled bulk transfer

• Application programs the end-to-end policy

– The end-to-end policy is encoded by the application as an SR segment list in the packet header

• Balance between distributed and centralized intelligence

– Distributed: automated sub-30msec FRR link/node in any topology with optimum backup path
– Centralized: traffic optimization for better use of the installed capacity

• Applicable to MPLS and IPv6 dataplanes

• Much simpler to operate than MPLS Classic

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 49
Get involved

• All of these use-cases are either FCS or beta available

• Leverage dcloud.cisco.com virtual labs
• Get involved and provide ideas and requirements
• SR is operator driven
• Visit the lab/demo offered by Kris Michielsen
• Your help is key

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 50
Thank you.
Complete Your Online Session Evaluation

• Please complete your online session

evaluations after each session.
Complete 4 session evaluations
& the Overall Conference Evaluation
(available from Thursday)
to receive your Cisco Live T-shirt.

• All surveys can be completed via

the Cisco Live Mobile App or the
Communication Stations

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 52
Segment Routing

 Leverage MPLS dataplane and services

 Drastically improve MPLS control-plane while enabling new services
 Simplicity, Scale, Functionality, Centralized Optimization and
Programmability
 Strong operator adoption and tight involvement
 Innovation and Standardization
 Aggressive productization by Cisco
 PoC and Beta code available

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 53
Stay Informed

 http://www.segment-routing.net/

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 54
End-to-end policy from DC, through WAN to peer

App SR DC SR WAN BR

vPEF ToR Leaf Spine DCE LSR BR

App
BR

© 2013-2014 Cisco and/or its affiliates. All rights reserved. Cisco Confidential 55