Sei sulla pagina 1di 74

Intel S/PGW test network configuration

Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label

NG40 OS Specs

OS Ubuntu 64bit Server


Version 16.04.2
repository access is mandatory

Mgmt / O&M Interface


eth0 DEV Linux
0000:03:00.0 PCI Address
00:1e:67:c9:bd:a8 MAC
10.212.93.45 ssh IP
lte1 user
lte passwd

11.1.2.4

11.1.2.84

10.1.12.224/16
11.1.2.164

11.1.2.244

11.1.2.244

11.1.2.244
penssh selected on NG40 servers

Servername RAN10 10GbE


Function RAN Switch

3GPP Interface S1-U S1U


DPDK device
PCI Addr 0000:05:00.1
MAC 68:05:ca:30:e5:09
Linux dev eth17
10.0.11.1/16 P range || last> (*)

3GPP Interface S1-U


DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
P range || last> (*)
1st> (*)

3GPP Interface S1-U


DPDK device 1
PCI Addr 0000:05:00.3

MAC 68:05:ca:30:e5:0b 10G Vlan: -

Linux dev eth3


<last || IP range ||
11.1.2.5/16
1st>

3GPP Interface S1-MME


PCI Addr 0000:03:00.1
MAC 00:1e:67:c9:bd:a9 local loopback
Linux dev eth1
<last || IP range ||
10.1.11.1/16
1st>
NUMA node0
3GPP Interface S1-U
DPDK device 3
PCI Addr 0000:81:00.1
MAC 90:e2:ba:7f:cd:a5 10G Vlan: -
Linux dev eth11
<last || IP range ||
11.1.2.85/16
1st> (*)

3GPP Interface S1-U

DPDK device 5

PCI Addr 0000:83:00.1


MAC 90:e2:ba:7c:61:99 10G Vlan: -
Linux dev eth13
<last || IP range ||
11.1.2.165/16
1st> (*)
3GPP Interface S1-U
DPDK device 7
PCI Addr 0000:86:00.1
MAC 90:e2:ba:7f:d2:d9 10G Vlan: -
Linux dev eth15
<last || IP range ||
11.1.2.165/16
1st> (*)

3GPP Interface S1-U


DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
11.1.2.245/16
1st> (*)

NUMA node1
20
0000:81:00.0
90:e2:ba:7f:d5:64
ens802f0
0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0
11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

NG40 OS Specs: Ubuntu 64bit Server Version 14.04.5


repository access is mandatory

S1-MME 3GPP Interface


0000:03:00.1 PCI Addr
local loopback00:1e:67:c9:bd:a9 MAC
eth1 Linux dev
10.1.10.10 IP
S1-MME PF
0000:03:00.1 PCI Addr
00:1E:67:C9:BC:59 MAC
MACVTAP eno2 Linux Dev
10.1.100.200 IP

NUMA0
Memory (GB) 8 4
VM1 #Cores=

Disk (GB) 16 Interface type S1-MME

PCI Addr 0000:00:04.0

MAC 52:54:00:f7:cd:0c
Linux dev ens10
S1-MME 10.0.10.20

Interface type S6a, S10


HWBr PF | Linux dev ens9
SRIOV-VF3.2
SRIOV-VF3.2
IP 192.168.110.60

HWBr
HWBr PF
PF ||
SRIOV-VF1.2

NUMA0
Memory (GB) 8 2
VM2 #Cores=

Disk (GB) 16 Interface type S6a, S6t, S6m


Linux dev ens9
IP 192.168.110.61

HWBr
HWBr PF
PF
||
SRIOV-VF3.2

NUMA0
Memory (GB) 8 4
VM3 #Cores=
Disk (GB) 16 Interface type hss, scef
Linux dev ens8
IP 192.168.112.60

NUMA0
Memory (GB) 8 2
VM4 #Cores=
Disk (GB) 16

Sprint Ref Actual

Memory NUMA0
8 16 5
(GB) VM5 #Cores=

S11ExtMACVTAP
16 Disk (GB16 Interface type
S11IntPCI_dev
PCI Addr 0000:00:04.0
MAC 52:54:00:49:d2:6a
Linux dev ens8
Total HWBr Ports SGW S11 IP 10.1.10.20
HWBr PCI HWBr PF |
SRIOV-VF5.4
SRIOV-VF5.4
MAC
Linux Dev
IP

Memory NUMA1
8 8 4
(GB) VM6 #Cores=

16 Disk (GB16 Interface type CP <NB> FPC


PCI Addr 00:0a.0
MAC 00:00:00:00:ff:10
Linux dev ens6
SGW S11 IP 192.168.124.70

Memory NUMA1
8 32 8
(GB) VM7 #Cores

16 Disk (GB16 Interface type FPC|ODL <SB> DP


Linux dev ens6
IP 192.168.124.80

Interface type S1U


PCI Addr 00.07.0
PCI Addr MAC 90:e2:ba:80:d3:b4
PF |
MAC Linux dev ens8
SRIOV-VFs
Linux Dev SGW S1U IP 11.1.1.93
IP

NUMA1
Memory (GB) 8 2
VM10 #Cores

Disk (GB) 16 Interface type Rf, Ro


Linux dev ens7
HWBrPF | IP 192.168.114.60
SRIOV-VF6.2
SRIOV-VF6.2

NUMA1
Memory (GB) 8 2
VM11 #Cores

Disk (GB) 16 Interface type Rf, Ro


Linux dev ens7
IP 192.168.114.61
Servername RAN10
Function MME

bit Server Version 14.04.5


sitory access is mandatory

S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21

VM1: cord-epc:mme VM2: openair-cn(hss)


CORES=2, MEM=16GB,
CORES=4, MEM=16GB, DISK=16GB
DISK=16GB
c3po: c3po:
freediameter, cpp driver,
freediameter, utils
utils
1G Switch
VM5: DNS
CORES=2, MEM=16GB, DISK=16GB
bind9, dnsutils

VM6: ngic-cp1 VM7: FPC|ODL


CORES=4, MEM=16GB,
CORES=5, MEM=16GB, DISK=16GB
DISK=16GB
cord-epc:mme
VCPU-CPU:
c3po:
0-1, 1-2, 2-3,
freediameter, utils[c-ares
3-4
dns]
Interface type Mgmt

Linux dev ens3

IP 192.168.122.37

Interface type S11


Linux dev ens8
IP 10.1.10.22

openair-cn(hss)
VCPU-CPU: c3po:
0-5, 1-6 freediameter, cpp driver,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.122.146

Interface type db

Linux dev ens8

IP 192.168.112.61

VCPU-CPU: Cassandra
0-7, 1-8, 2-9, 3- c3po:
freediameter, cpp driver,
10 utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.122.97

VCPU-CPU: c3po-
0-11, 1-12 bind, utils[c-ares dns]
Interface type Mgmt, ddns
Linux dev ens3
IP 192.168.100.183

Interface type ddns


Linux dev ens7
IP

VCPU-CPU:
ngic-cp1
0-13, 1-14, 2-15,
c3po: utils[c-ares dns]
3-16, 4-17

Interface type Mgmt

Linux dev ens3


IP 192.168.122.34

Interface type CP <NB> FPC


Linux dev ens9
IP 192.168.124.60
NAT

VCPU-CPU: fpc-odl1
0-19, 1-20, 2-21, c3po:
3-22 memcached, utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238

Interface type FPC|ODL <SB> DP


Linux dev ens7
IP 192.168.124.75

VCPU-CPU:
0-23, 1-24, 2-25, ngic-dp1
3-26, 4-27, 5-28, c3po: utils[c-ares dns]
6-29, 7-30
Interface type Mgmt
Linux dev ens3
IP 192.168.100.171

Interface type SGI


PCI Addr 00.08.0
MAC 90:e2:ba:80:d3:b5
Linux dev ens9
SGW SGI IP 13.1.1.93

CTF
VCPU-CPU: c3po:
0-31, 1-32 freediameter, memcached,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.170

CDF
VCPU-CPU: c3po:
0-33, 1-34 freediameter, utils[c-ares
dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.216
VM3: Cassandra VM10: ctf VM11: cdf
CORES=4, MEM=24GB, CORES=2, MEM=16GB, CORES=2, MEM=16GB,
DISK=40GB DISK=16GB DISK=16GB
c3po: c3po: c3po:
freediameter, cpp driver,
freediameter, utils freediameter, utils
utils

VM8: ngic-dp1 VM10: ngic-dp2 VM11: ngic-dp2


CORES=8, MEM=16GB,
DISK=16GB
Servername ilepc3
Function S/PGW

Interface Mgmt / O&M


DEV Linux eno1
PCI Addres 0000:03:00.0
MAC 00:1E:67:C9:BC:58

ssh IP 10.212.93.42

user root

passwd intel123
HWBrPF
HWBrPF ||
SRIOV-VF4.10
SRIOV-VF4.10
NUMA node: 0
Total #of Cores 18
#of Cores used 17
PCI Addr 0000:83:00.1
PF | MAC 90:E2:BA:7C:5D:DD
SRIOV-VFs Linux Dev ens801f1
IP 13.1.1.100

NUMA node: 1
#of Cores 18
#of Cored used 16
10GbE
Switch

SGi SGi 3GPP Interface


DPDK device
0000:05:00.0 PCI Addr
68:05:ca:30:e5:08 MAC
eth17 Linux dev
<1st || IP range ||
13.1.1.110 13.1.1.141
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC
Linux dev
<1st || IP range ||
13.1.1.142 13.1.1.173
last> (**)

SGi 3GPP Interface


0 DPDK device
0000:05:00.2 PCI Addr

10G Vlan: - 68:05:ca:30:e5:0a MAC

eth2 Linux dev


<1st || IP range ||
13.1.1.174 13.1.1.205
last> (**)

SGi 3GPP Interface


DPDK device
PCI Addr
MAC

Linux dev
<1st || IP range ||
13.1.1.174
last> (**)

SGi 3GPP Interface


2 DPDK device
0000:81:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:cd:a4 MAC
eth10 Linux dev
<1st || IP range ||
13.1.1.206 13.1.1.237
last> (**)

SGI 3GPP Interface

4 DPDK device

0000:83:00.0 PCI Addr


10G Vlan: - 90:e2:ba:7c:61:98 MAC
eth12 Linux dev
<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)

SGI 3GPP Interface


6 DPDK device
0000:86:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:d2:d8 MAC

eth14 Linux dev

<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC

Linux dev

<1st || IP range ||
13.1.2.14 13.1.2.45
last> (**)
10G Vlan
Servername RAN10
Function AppServ

Interface Mgmt / O&M


DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

NG40 OS Specs

Ubuntu 64bit ServerOS


16.04.2 Version

repository access is mandatory


NUMA node0

NUMA node1
Intel S/PGW test network configuration
Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label

NG40 OS Specs

OS Ubuntu 64bit Server


Version 16.04.2
repository access is mandatory

Mgmt / O&M Interface


eth0 DEV Linux
0000:03:00.0 PCI Address
00:1e:67:c9:bd:a8 MAC
10.212.93.45 ssh IP
lte1 user
lte passwd

11.1.2.4

11.1.2.84

10.1.12.224/16
11.1.2.164

11.1.2.244

11.1.2.244

11.1.2.244
penssh selected on NG40 servers

Servername RAN10 10GbE


Function RAN Switch

3GPP Interface S1-U S1U


DPDK device
PCI Addr 0000:05:00.1
MAC 68:05:ca:30:e5:09
Linux dev eth17
10.0.11.1/16 P range || last> (*)

3GPP Interface S1-U


DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
P range || last> (*)
1st> (*)

3GPP Interface S1-U


DPDK device 1
PCI Addr 0000:05:00.3

MAC 68:05:ca:30:e5:0b 10G Vlan: -

Linux dev eth3


<last || IP range ||
11.1.2.5/16
1st>

3GPP Interface S1-MME


PCI Addr 0000:03:00.1
MAC 00:1e:67:c9:bd:a9 local loopback
Linux dev eth1
<last || IP range ||
10.1.11.1/16
1st>
NUMA node0
3GPP Interface S1-U
DPDK device 3
PCI Addr 0000:81:00.1
MAC 90:e2:ba:7f:cd:a5 10G Vlan: -
Linux dev eth11
<last || IP range ||
11.1.2.85/16
1st> (*)

3GPP Interface S1-U

DPDK device 5

PCI Addr 0000:83:00.1


MAC 90:e2:ba:7c:61:99 10G Vlan: -
Linux dev eth13
<last || IP range ||
11.1.2.165/16
1st> (*)
3GPP Interface S1-U
DPDK device 7
PCI Addr 0000:86:00.1
MAC 90:e2:ba:7f:d2:d9 10G Vlan: -
Linux dev eth15
<last || IP range ||
11.1.2.165/16
1st> (*)

3GPP Interface S1-U


DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
11.1.2.245/16
1st> (*)

NUMA node1
20
0000:81:00.0
90:e2:ba:7f:d5:64
ens802f0
0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0
11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

NG40 OS Specs: Ubuntu 64bit Server Version 14.04.5


repository access is mandatory

S1-MME 3GPP Interface


0000:03:00.1 PCI Addr
local loopback00:1e:67:c9:bd:a9 MAC
eth1 Linux dev
10.1.10.10 IP
S1-MME PF
0000:03:00.1 PCI Addr
00:1E:67:C9:BC:59 MAC
MACVTAP eno2 Linux Dev
10.1.100.200 IP

NUMA0
Memory (GB) 8 4
VM1 #Cores=

Disk (GB) 16 Interface type S1-MME

PCI Addr 0000:00:04.0

MAC 52:54:00:f7:cd:0c
Linux dev ens4
S1-MME 10.0.10.20

Interface type S6a, S10


HWBr PF | Linux dev ens8
SRIOV-VF3.2
SRIOV-VF3.2
IP 192.168.110.60

HWBr
HWBr PF
PF ||
SRIOV-VF1.2
SRIOV-VF1.2

NUMA0
Memory (GB) 8 2
VM2 #Cores=

Disk (GB) 16 Interface type S6a, S6t, S6m


Linux dev ens7
IP 192.168.110.61

HWBr
HWBr PF
PF
|
SRIOV-VF3.2
SRIOV-VF3.2

NUMA0
Memory (GB) 8 4
VM3 #Cores=
Disk (GB) 16 Interface type hss, scef
Linux dev ens7
IP 192.168.112.60

NUMA0
Memory (GB) 8 2
VM4 #Cores=
Disk (GB) 16

Sprint Ref Actual

Memory NUMA0
8 16 5
(GB) VM5 #Cores=

S11ExtMACVTAP
16 Disk (GB16 Interface type
S11IntPCI_dev
PCI Addr 0000:00:04.0
MAC 52:54:00:49:d2:6a
Linux dev ens4, ens9
Total HWBr Ports SGW S11 IP 10.1.10.20
HWBr PCI HWBr PF |
SRIOV-VF5.4
SRIOV-VF5.4
MAC
Linux Dev
IP

Memory NUMA1
8 8 4
(GB) VM6 #Cores=

16 Disk (GB16 Interface type CP <NB> FPC


PCI Addr 00:0a.0
MAC 00:00:00:00:ff:10
Linux dev ens6
SGW S11 IP 192.168.124.70

Memory NUMA1
8 32 8
(GB) VM7 #Cores

16 Disk (GB16 Interface type FPC|ODL <SB> DP


Linux dev ens6
IP 192.168.124.80

Interface type S1U


PCI Addr 00.07.0
PCI Addr MAC 90:e2:ba:80:d3:b4
PF |
MAC Linux dev ens8
Linux Dev
SRIOV-VFs SGW S1U IP 11.1.1.93
IP

NUMA1
Memory (GB) 8 2
VM10 #Cores

Disk (GB) 16 Interface type Rf, Ro


Linux dev ens7
HWBrPF IP 192.168.114.60
HWBrPF ||
SRIOV-VF6.2

NUMA1
Memory (GB) 8 2
VM11 #Cores

Disk (GB) 16 Interface type Rf, Ro


Linux dev ens7
IP 192.168.114.61
Servername RAN10
Function MME

bit Server Version 14.04.5


sitory access is mandatory

S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21

VM1: cord-epc:mme VM2: openair-cn(hss)


CORES=2, MEM=16GB,
CORES=4, MEM=16GB, DISK=16GB
DISK=16GB
c3po: c3po:
freediameter, cpp driver,
freediameter, utils
utils
1G Switch
VM5: DNS
CORES=2, MEM=16GB, DISK=16GB
bind9, dnsutils

VM6: ngic-cp1 VM7: FPC|ODL


CORES=4, MEM=16GB,
CORES=5, MEM=16GB, DISK=16GB
DISK=16GB
S11
0000:03:00.1
00:1E:67:C9:BC:59
eno2 MACVTAP

cord-epc:mme
VCPU-CPU:
c3po:
0-1, 1-2, 2-3,
freediameter, utils[c-ares
3-4
dns]
Interface type Mgmt

Linux dev ens3

IP 192.168.100.142

Interface type S11


Linux dev ens9
IP 10.1.10.22

openair-cn(hss)
VCPU-CPU: c3po:
0-5, 1-6 freediameter, cpp driver,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.143

Interface type db

Linux dev ens8

IP 192.168.112.61

VCPU-CPU: Cassandra
0-7, 1-8, 2-9, 3- c3po:
freediameter, cpp driver,
10 utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.215

VCPU-CPU: c3po-
0-11, 1-12 bind, utils[c-ares dns]
Interface type Mgmt, ddns
Linux dev ens3
IP 192.168.100.183

Interface type ddns


Linux dev ens7
IP

VCPU-CPU:
ngic-cp1
0-13, 1-14, 2-15,
c3po: utils[c-ares dns]
3-16, 4-17

Interface type Mgmt

Linux dev ens3


IP 192.168.100.224

Interface type CP <NB> FPC


Linux dev ens7
NAT
IP 192.168.124.60

VCPU-CPU: fpc-odl1
0-19, 1-20, 2-21, c3po:
3-22 memcached, utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238

Interface type FPC|ODL <SB> DP


Linux dev ens7
IP 192.168.124.75

VCPU-CPU:
0-23, 1-24, 2-25, ngic-dp1
3-26, 4-27, 5-28, c3po: utils[c-ares dns]
6-29, 7-30
Interface type Mgmt
Linux dev ens3
IP 192.168.100.171

Interface type SGI


PCI Addr 00.08.0
MAC 90:e2:ba:80:d3:b5
Linux dev ens9
SGW SGI IP 13.1.1.93

CTF
VCPU-CPU: c3po:
0-31, 1-32 freediameter, memcached,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.170

CDF
VCPU-CPU: c3po:
0-33, 1-34 freediameter, utils[c-ares
dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.216
VM3: Cassandra VM10: ctf VM11: cdf
CORES=4, MEM=24GB, CORES=2, MEM=16GB, CORES=2, MEM=16GB,
DISK=40GB DISK=16GB DISK=16GB
c3po: c3po: c3po:
freediameter, cpp driver,
freediameter, utils freediameter, utils
utils

VM8: ngic-dp1 VM10: ngic-dp2 VM11: ngic-dp2


CORES=8, MEM=16GB,
DISK=16GB
Servername ilepc3
Function S/PGW

Interface Mgmt / O&M


DEV Linux eno1
PCI Addres 0000:03:00.0
MAC 00:1E:67:C9:BC:58

ssh IP 10.212.93.42

user root

passwd intel123
HWBrPF |
SRIOV-VF4.10
NUMA node: 0
Total #of Cores 18
#of Cores used 17
PCI Addr 0000:83:00.1
PF | MAC 90:E2:BA:7C:5D:DD
SRIOV-VFs Linux Dev ens801f1
IP 13.1.1.100

NUMA node: 1
#of Cores 18
#of Cored used 16
10GbE
Switch

SGi SGi 3GPP Interface


DPDK device
0000:05:00.0 PCI Addr
68:05:ca:30:e5:08 MAC
eth17 Linux dev
<1st || IP range ||
13.1.1.110 13.1.1.141
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC
Linux dev
<1st || IP range ||
13.1.1.142 13.1.1.173
last> (**)

SGi 3GPP Interface


0 DPDK device
0000:05:00.2 PCI Addr

10G Vlan: - 68:05:ca:30:e5:0a MAC

eth2 Linux dev


<1st || IP range ||
13.1.1.174 13.1.1.205
last> (**)

SGi 3GPP Interface


DPDK device
PCI Addr
MAC

Linux dev
<1st || IP range ||
13.1.1.174
last> (**)

SGi 3GPP Interface


2 DPDK device
0000:81:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:cd:a4 MAC
eth10 Linux dev
<1st || IP range ||
13.1.1.206 13.1.1.237
last> (**)

SGI 3GPP Interface

4 DPDK device

0000:83:00.0 PCI Addr


10G Vlan: - 90:e2:ba:7c:61:98 MAC
eth12 Linux dev
<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)

SGI 3GPP Interface


6 DPDK device
0000:86:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:d2:d8 MAC

eth14 Linux dev

<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC

Linux dev

<1st || IP range ||
13.1.2.14 13.1.2.45
last> (**)
10G Vlan
Servername RAN10
Function AppServ

Interface Mgmt / O&M


DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

NG40 OS Specs

Ubuntu 64bit ServerOS


16.04.2 Version

repository access is mandatory


NUMA node0

NUMA node1
Intel S/PGW test network configuration
Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label

NG40 OS Specs

OS Ubuntu 64bit Server


Version 16.04.2
repository access is mandatory

Mgmt / O&M Interface


eth0 DEV Linux
0000:03:00.0 PCI Address
00:1e:67:c9:bd:a8 MAC
10.212.93.45 ssh IP
lte1 user
lte passwd

11.1.2.4

11.1.2.84

10.0.12.224/16
11.1.2.164

11.1.2.244

11.1.2.244

11.1.2.244
penssh selected on NG40 servers

Servername RAN10 10GbE


Function RAN Switch

3GPP Interface S1-U S1U


DPDK device
PCI Addr 0000:05:00.1
MAC 68:05:ca:30:e5:09
Linux dev eth17
10.0.11.1/16 P range || last> (*)

3GPP Interface S1-U


DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
P range || last> (*)
1st> (*)

3GPP Interface S1-U


DPDK device 1
PCI Addr 0000:05:00.3
MAC 68:05:ca:30:e5:0b 10G Vlan: -
Linux dev eth3
<last || IP range ||
11.1.2.5/16
1st>

3GPP Interface S1-MME


PCI Addr 0000:03:00.1
MAC 00:1e:67:c9:bd:a9 local loopback
Linux dev eth1
<last || IP range ||
10.0.11.1/16
1st>

NUMA node0
3GPP Interface S1-U
DPDK device 3
PCI Addr 0000:81:00.1
MAC 90:e2:ba:7f:cd:a5 10G Vlan: -
Linux dev eth11 0000:81:00.0
<last || IP range ||
11.1.2.85/16 90:e2:ba:7f:d5:64
1st> (*)
ens802f0
3GPP Interface S1-U

DPDK device 5

PCI Addr 0000:83:00.1


MAC 90:e2:ba:7c:61:99 10G Vlan: -
Linux dev eth13
<last || IP range ||
11.1.2.165/16
1st> (*)
3GPP Interface S1-U
DPDK device 7
PCI Addr 0000:86:00.1
MAC 90:e2:ba:7f:d2:d9 10G Vlan: -
Linux dev eth15
<last || IP range ||
11.1.2.165/16
1st> (*)

3GPP Interface S1-U

DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
11.1.2.245/16
1st> (*)

NUMA node1

0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0

11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

NG40 OS Specs: Ubuntu 64bit Server Version 14.04.5


repository access is mandatory

S1-MME 3GPP Interface


0000:03:00.1 PCI Addr
local loopback00:1e:67:c9:bd:a9 MAC
eth1 Linux dev
10.0.10.10 IP

PF
PCI Addr 0000:03:00.1
MAC 00:1E:67:C9:BC:59
Linux Dev eno2
IP 10.1.100.200

Sprint Ref Actual

Memory
32 32 VM1 #Cores= 5
(GB)

16 Disk (GB16 Interface type S11


PCI Addr 0000:00:04.0
MAC 52:54:00:49:d2:6a
Linux dev ens4
SGW S11 IP 10.1.10.20
PCI Addr
PF |
MAC
SRIOV-VFs
Linux Dev
IP

Memory
16 16 VM1 #Cores= 4
(GB)

16 Disk (GB16 Interface type CP <NB> FPC


PCI Addr 00:0a.0
MAC 52:54:00:8F:42:D6
Linux dev ens10
SGW S11 IP 192.168.124.70

Memory
8 32 VM3 #Cores 8
(GB)

32 Disk (GB32 Interface type FPC|ODL <SB> DP


Linux dev ens3
IP 192.168.124.80

Interface type S1U

PCI Addr 00.08.0

MAC 00:00:00:00:01:02
PF | Linux dev ens8
PCI Addr
SRIOV-VFs SGW S1U IP 11.1.1.93
MAC
Linux Dev

IP
Servername RAN10
Function MME

bit Server Version 14.04.5


sitory access is mandatory

S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21

1G Switch

Servername
Function

MACVTAP Interface
DEV Linux
PCI Addres

MAC

VCPU-CPU:
0-1, 1-2, 2-3, ngic-cp ssh IP
3-4, 4-5
Interface type Mgmt user
Linux dev ens3 passwd
IP 192.168.100.224

Interface type CP <NB> FPC


Linux dev ens7 NAT
IP 192.168.124.60

VCPU-CPU:
0-6, 1-7, 2-8, fpc-odl
3-9
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238

Interface type FPC|ODL <SB> DP


Linux dev ens9
IP 192.168.124.75 NUMA node:
Total #of Cores
#of Cores used

VCPU-CPU:
0-19, 1-20, 2-21,
3-22, 4-23, 5-24,
ngic-dp
6-25, 7-26

Interface type Mgmt


Linux dev ens7
IP 192.168.100.171

Interface type SGI

PCI Addr 00.09.0

MAC 00:00:00:00:02:02
Linux dev ens9 PF |
SGW SGI IP 13.1.1.93 SRIOV-VFs PCI Addr
MAC
Linux Dev

IP
NUMA node:
#of Cores
#of Cored used
10GbE
Switch

SGi SGi 3GPP Interface


DPDK device
0000:05:00.0 PCI Addr
68:05:ca:30:e5:08 MAC
eth17 Linux dev
<1st || IP range ||
13.1.1.110
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC
Linux dev
<1st || IP range ||
13.1.1.142
last> (**)

SGi 3GPP Interface


0 DPDK device
0000:05:00.2 PCI Addr
10G Vlan: - 68:05:ca:30:e5:0a MAC
eth2 Linux dev
<1st || IP range ||
ilepc3 13.1.1.174
last> (**)
S/PGW
SGi 3GPP Interface
Mgmt / O&M DPDK device
eno1 PCI Addr
0000:03:00.0 MAC

00:1E:67:C9:BC:58 Linux dev

<1st || IP range ||
10.212.93.41 13.1.1.174
last> (**)

root
intel123 SGi 3GPP Interface
2 DPDK device
0000:81:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:cd:a4 MAC
eth10 Linux dev
<1st || IP range ||
13.1.1.206
last> (**)

SGI 3GPP Interface

4 DPDK device

0000:83:00.0 PCI Addr


10G Vlan: - 90:e2:ba:7c:61:98 MAC
eth12 Linux dev
<1st || IP range ||
13.1.1.238
last> (**)

SGI 3GPP Interface


0 6 DPDK device
18 0000:86:00.0 PCI Addr
9 10G Vlan: - 90:e2:ba:7f:d2:d8 MAC

eth14 Linux dev


<1st || IP range ||
13.1.1.238
last> (**)

SGI 3GPP Interface


DPDK device
PCI Addr
MAC

Linux dev

<1st || IP range ||
13.1.2.14
last> (**)

0000:83:00.1
90:E2:BA:7C:5D:DD 10G Vlan
ens801f1

13.1.1.100
1
18
8
Servername RAN10
Function AppServ

Interface Mgmt / O&M


13.1.1.141 DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte

13.1.1.173
NG40 OS Specs

Ubuntu 64bit ServerOS


16.04.2 Version
repository access is mandatory

13.1.1.205

NUMA node0
13.1.1.237

13.1.2.13

13.1.2.13

13.1.2.45

NUMA node1
Step by Step Process for VM creation and NW Configuration of:
<S1U>
NGIC-CP| <FPC-ODL| NGIC-
<S11>
VM VM> DP|VM
<SGi>

Refer:
README.MD @
https://<user_name>@ilpm.intel-research.net/stash/scm/vccbbk/ngicvm_install_pkg.git

Following lines for reference only


Example host machine: ilepc3
HOST OS: Ubuntu 16.04 LTS
http://releases.ubuntu.com/16.04.3/ubuntu-16.04.3-server-amd64.iso?_ga=2.57437098.12224879

#1:
              Target Machine ilepc3:
                             // Virtualization enaled in BIOS
                             // VT-D enables in BIOS
              root@ilepc3:# vim /etc/default/grub
                                           After:
GRUB_CMDLINE_LINUX=""
Add:
GRUB_CMDLINE_LINUX="intel_iommu=on"

root@ilepc3:~/ng-core_mc-nd# update-grub
$reboot server for grub config to take effect
To check if VT-D is enabled:
root@ilepc3:# dmesg | grep -i dmar
E.g.:
Note:
// Virtualization enaled in BIOS:
DMAR: IOMMU enabled
// VT-D enables in BIOS
DMAR: Intel(R) Virtualization Technology for Directed I/O

#2:
              root@ilepc3:# apt-get install qemu-kvm libvirt-bin virtinst bridge-utils cpu-checker libguestfs-tools virt-m
              root@ilepc3:# adduser root libvirtd;      // Then logout and login back before running virt-manager
To check if kvm is loaded:
root@ilepc3:# lsmod | grep kvm
E.g.:
root@ilepc3:#  lsmod | grep -i kvm
kvm_intel             172032  25
kvm                   544768  1 kvm_intel
irqbypass              16384  16 kvm,vfio_pci

#3:
              root@ilepc3:# git clone <TBD> ngicvm_installer.pkg
              root@ilepc3:# cd ngicvm_gen/

#4:
wget ubuntu iso image
              root@ilepc3:# wget http://releases.ubuntu.com/16.04.3/ubuntu-16.04.3-server-amd64.iso?_ga=2.57437

NOTE: Ensure:
login is root
All other VM/Guests on the host are shutdown

#5:
              root@ilepc3:~# vim ngicvm_defs.cfg
Refer sheet 'NetworkCfg-SRIOV-VM-RAN10' & Define:
# Define Control plane S11 MACVTAP IF name
# Define Control plane + FPC VFs SRIOV IF
# Define Data Plane PCI Devices
# Interface file name prefixes
# VM names

#6:
              root@ilepc3:~# vim ngicvm_install_all.sh
# Uncomment/select VMs to be creaeted

#7:
Generate the VMs
              root@ilepc3:~# ./ngicvm_install_all.sh

#8:
Login to the VMs
              root@ilepc3:~# ./sshvm.sh
use: ./sshvm.sh <login> <domain>
use a domain in: ngic-cp1

#9:
Guest OS standard configuration:
// Install Guest OS
              Hostname:         ngic-cp1; fpc-odl1; ngic-dp1; ngic-dp2
              User Account:   ngic
              User Name:       ngic
              Password:          ngic
              Encrypt Home Directory: No
Partitioning Method:
                             Guided: use entire disk
Install Security updates automatically
              Software Selections:
                             DNS Server; Standard system utilities; Virtual Machine host; OpenSSH server

# ############################################################
# TODO List:
# #############################################
#1:
ERROR on virt-install --graphics vnc,keymap=en-us (virt-viewer:14543): gtk-vnc-WARNING **: Un
Note: virt-viewer launch can be avoided. Need to figure out a way of killing virt-viewer once the gu

#2:
Remove the virbr0 and virbr0-nic interfaces from being created by default on the Guest VM

#3:
Remove need to type in password on sudo su

#4:
For the vcpupin <domain> vcpu cpuset --config to take effect, after first boot of the guest, shutdown the gues a
vcpu- cpuset start does not work when ngic-dp1 is the only VM that is installed. The vcpu pinning do
vcpupin ngic-dp1 vcpu:0::cpu:19
vcpupin ngic-dp1 vcpu:1::cpu:20

vcpupin ngic-dp1 vcpu:7::cpu:26

#5:
Pre create the necessary guest:/etc/network/interface files with the required IP assignments

#6:
Pre install vimtoolkit w/ the guest file system

#7:
Make the Guest Hostnames, User Account, User Name and Password configurable

Keep in view/resolve:
1 Issue with past VMs that have been destroyed showing up on the net-dhcp-leases defa
Note: This apparently seems to be due to the dhcp-lease live times

2 Resizing VMIMGSZ to accommodate increased GUEST_DISKSZ > 16

3 Test the need to shutdown all the guests running on the host to ensure:
- There are no vcpu pinning or other conflicts as the new guest in generated
- There is no conflict in the tearing down & re-creating of previous macvtap interfaces
- Ther is no cobflict in the creation of the sriov VFs

4 ngic-cp, ngic-dp guests:


- Check if ngic-dp guests can be pre-installed with hugepages
- Change the run.sh for the correct CPU mask (vcpu mask) & socket memory
onfiguration of:

m_install_pkg.git

_ga=2.57437098.1222487909.1502812146-866320519.1491943997

checker libguestfs-tools virt-manager


re running virt-manager
server-amd64.iso?_ga=2.57437098.1222487909.1502812146-866320519.1491943997
##################

: gtk-vnc-WARNING **: Unknown keycode mapping '(null)'.


ing virt-viewer once the guest has booted into with the file system image

lt on the Guest VM

he guest, shutdown the gues and start again.


stalled. The vcpu pinning does not take effect

ired IP assignments

on the net-dhcp-leases default.

st to ensure:
uest in generated
revious macvtap interfaces
& socket memory

Potrebbero piacerti anche