Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Webinar Instructions
Todays Session
DATE: October 23, 2012
TIME: 10:00 AM EST
EVENT: System Networking Technical Education Session
TITLE: IBM Flex System Fabric CN4093 FC/FCoE Capabilities Deep
Dive
SPEAKERs: Meenakshi Kaushik and Deepak Kumar
Bios:
Meenakshi Kaushik: PLM (FC/FCoE, Fabric Architecture and
Virtualization)
Deepak Kumar: Architect, Software Development, FC/FCoE
Upcoming Sessions
Please Remember to REGISTER for the Events Just Click on
Button in the Calendar Notice To Be Safe Register at least ONE
HOUR PRIOR to Event
10.24
10.30
11.05
IBM Flex System Fabric EN4093 10Gb Scalable Switch 4Q Update
11.13
(TBC)
11.20
Blocked - for Thanksgiving
11.27
IBM System Networking Monthly Roadmap and Marketing Update
11.29
Overview of System Networking Environments TRILL (Comparison to other
technologies:
FabricPath, etc)
System Networking
Meenakshi Kaushik
System Networking
Agenda
CN4093 FC/FCoE feature overview
Data I/O Convergence overview
FCoE Protocol Building Blocks
FIP and FCoE
System Networking
Agenda
CN4093 FC/FCoE Configuration
NPV Gateway
-
Configuration CLI
Display CLI
Debugging and Trouble Shooting
Login Redistribution (Load balancing)
Configuration CLI
Display CLI
Debugging and Trouble Shooting
Ghost FC Ports
Design Tips
IBM Confidential
System Networking
Overview
10Gb
to Server
SFP+
Ports
Omni
Ports
QSFP+
Ports
14
Upgrade #1 (00D5845)
28
Upgrade #2 (00D5847)
28
12
Upgrade #1 & #2
42
12
Total Ports
Leadership
OmniPorts allow flexibility 10GbE or 4/8Gb FC
Proven IBM Networking Operating System
Performance - Low latency, up to 1.28Tbps
Scalable pay-as-you-grow design
VM aware & VM Mobility with VMready
Virtual Fabric carve up virtual NICs and pipes
Seamless interoperability with other vendors
Warranty is 1 year or will match the chassis warranty
(Includes software upgrades)
1GbE Mgmt
Optimized for
performance
Designed for
Convergence
Enhanced virtualization
intelligence
Lower TCO
Seamless interoperability
Networking Infrastructure
Networking
System Networking
Customer Benefits
Convergence
Virtualization
VMready makes the network VM aware for simpler management & VM mobility.
Virtual Fabric allows for vNICs and virtual pipes between adapter and switch
Works with IBM DVS 5000V simple virtual & physical switches management
Cost of Ownership
Where to win
Switch upgrade 1:
Switch upgrade 2:
Performance
Base Configuration
Competes Against:
HP FlexFabric
Dell Force10 MXL
Cisco UCS Fabric Extender and
Fabric Interconnect
System Networking
Competitive Advantages
1.High Availability (Avoid down-time)
No reboot of switch needed to convert the OmniPorts from Ethernet to Fibre Channel or
Fibre Channel to Ethernet
No reboot of switch needed to make it FC switch or NPV-Gateway
2.Reduce Complexity
On a VLAN basis, it can be configured to be an Full Fabric FC/FCoE switch (only 1 VLAN)
On a VLAN basis, configure the switch to be a FCoE->FC NPV-Gateway switch (up to 12
VLANs)
Simultaneous FC switching and Gateway functionality (on different VLANs )
- Not a Interop Tested Configuration for Nov 2012
System Networking
Separate fabrics for local area networking (LAN) and storage area
networking (SAN)
LAN
LAN
Ethernet
SAN
SAN
Fibre
Channel
Advantages
Traffic isolation
Independent administration
Challenges
Underutilization of resources
Higher infrastructure costs
Complexity of management
System Networking
iSCSI
Storage
Array
Gateway
FCoE
Gateway
Fibre Channel
NFS/CIFS NAS
13
This educational material is intended for your use in selling. It is NOT a deliverable for your clients.
FC Arrays
System Networking
14
This educational material is intended for your use in selling. It is NOT a deliverable for your clients.
System Networking
Converged Solution
SW upgrade to LOM
CNA ($99 x 14 = $1,386)
10G Fabric
FC Fabric
$59,286
$43,184
I/O
Acquisition Costs
System Networking
System Networking
Based on FC Model
No FC Frame Fragmentation;
Jumbo frames
Source: IBM Redbooks
http://www.redbooks.ibm.com/redbooks/pdfs/sg247986.pdf
2012 IBM Corporation
System Networking
CN4093
System Networking
Ethernet Network
Ex: G8264/G8316
LOM or CN4054
(pNIC, vNIC
mode)
Storage node
System Networking
Ethernet Network
Ex G8264/G8316
Ext.
FCoE
Storage
Key value:
Reduce cost and complexity of external SAN network
removes Cisco and Brocade SAN
Ideal for new storage deployments
Removes need for FC cables and network all together
LOM or CN4054
(pNIC, vNIC
mode)
Integrated Switch
Storage Target
OS levels
Storwise V7K
System Networking
FCoE
Data Plane
EtherType -- 0x8906
Carries ALL SCSI traffic ; most of the
FC frames
MAC == FPMA
Destination MAC Address
Source MAC Address
(IEEE 802.1Q Tag)
ET = FCoE
Ver
Reserved
Reserved
Reserved
Reserved
SOF
Encapsulated FC Frame (minimum of 28 Bytes)
(including FC-CRC)
EOF
Reserved (Pad Bytes)
Ethernet FCS
2012 IBM Corporation
System Networking
FCF
Not in
CN4093
System Networking
SAN
SAN
SAN
SAN
FCoE HBA
FCoE HBA
FCoE HBA
FCoE HBA
This is
harder! Enet Switch
FCoE HBA
FCoE HBA
FC HBA
FC HBA
FC HBA
FCoE Switch
FCoE HBA
Going
from
here
FC Switch
FC HBA
SAN
SAN
23
System Networking
FCF (FC-BB-5)
VLAN
Discovery
FCF
Discovery
FIP
FCF
Discovery
Solicitations/ Advertisement;
FLOGI and
FDISC
FLOGI and
FDISC
Accept
FC Command
FC Command
Response
(FCoE
Initialization
Protocol)
FCoE Protocol
System Networking
Server1 FCoCEE
CNA
VNIC
VHBA
MAC1
MAC2
Lossless
Enet Bridge
FCF MAC
FCF
System Networking
Ethernet Network
Ex: G8264/G8316
LOM or CN4054
(pNIC, vNIC mode)
Storage node
System Networking
NPV Gateway
Ethernet
Ports
Host
Storage
CEE/FSB
CEE/FSB
FC
Ports
FC
Ports
F
52 F
ETH
F
FCisco MDS/
Brocade
F SAN
CN4093 53 NP
NPV
Gateway
Mode 64 NP
Storage
FC
NPV - N_Port Virtualization (Extend port density of the Full Fabric Switch)
FC/FCoE Gateway
System Networking
NPV Gateway
Enode
NPV
FLOGI
FC
FC Switch
FLOGI
Accept
VLAN
Discovery
VLAN
Discovery
Default VLAN; ALL-FCF-MACs
FIP
(FCoE
Initialization
Protocol)
FCF
Discovery
FCF
Discovery
Solicitations/ Advertisement;
FLOGI and
FDISC
Send FDISC
to FCF
FDISC
Accept
Relay FC
DISC via FIP
FC Command
FCoE / FC
Encap/Decap
FC Command
Response
FCoE
Protocol
2012 IBM Corporation
System Networking
Ext.
Storage
Cisco or Brocade
SAN
Ethernet Network
Ex. G8264/G8316
LOM or CN4054
(pNIC, vNIC
mode)
Integrated Switch
SAN Switch
Storage Target
OS levels
N/A
Cisco SAN
Brocade SAN
System Networking
Ext.
Storage
Cisco or Brocade
SAN
Ethernet Network
Ex: G8264/G8316
LOM or CN4054
(pNIC, vNIC
mode)
Storage node
Integrated Switch
SAN Switch
Storage Target
OS levels
N/A
Cisco SAN
Brocade SAN
System Networking
Ext.
Storage
Cisco or Brocade
SAN
Ethernet Network
Ex. G8264/G8316
CN4058 Adapter
Storage node
Integrated Switch
Too Of Rack
Switch
SAN Switch
Storage Target
OS levels
CN4093 10Gb
Switch
NPIV mode
NA
AIX 5/6/7
VIOS 221/222
IBM i6/i7
2012 IBM Corporation
System Networking
FSB
NPV Gateway
(F)
(F)
FC Connectivity
(NP) and
(NP-F)*
(F)*
FCoE/FC Gateway
(Encap/Decap)
(FIP ACL)
Security
(FIP ACL)
Zoning
S_ID/D_ID Routing
System Networking
Scaling
Logins
- # of FCoE Logins/Port = 175
- # of FCoE Logins/Switch= 175
Scaling
Zone
-
MAX ZONESETS
:4
MAX ZONES per ZONESET : 64
MAX MEMBERS per ZONE : 20
MAX ZONES
: 200
MAX ALIASES
: 200
MAX MEMBERS
: 1000
Logins
- # of FCoE Logins/Port = 175
- # of FCoE Logins/Switch= 175
System Networking
FC-BB-6
System Networking
FCoE
Initiator
FCoE
Target
CNA
FCoE
Initiator
FC
Switch
CNA
12x
10GbE / 2/4/8GbFC
10x10GbE
CN4093 Architecture
FC ASIC
Ethernet ASIC
42x10GbE
FCoE
Initiator
CNA
FCoE
Target
System Networking
References
T11 FC-BB-5
http://www.t11.org/ftp/t11/pub/fc/bb-5/09-056v5.pdf
IBM Redbook
http://www.redbooks.ibm.com/redbooks/pdfs/sg247986.pdf
Understanding NPIV and NPV Blog
http://blog.scottlowe.org/2009/11/27/understanding-npiv-and-npv/
http://www.juniper.net/techpubs/en_US/junos12.2/topics/concept/fibrechannel-fip-functions-understanding.html
System Networking
BACKUP SLIDES
System Networking
38