Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label
NG40 OS Specs
11.1.2.4
11.1.2.84
10.1.12.224/16
11.1.2.164
11.1.2.244
11.1.2.244
11.1.2.244
penssh selected on NG40 servers
DPDK device 5
NUMA node1
20
0000:81:00.0
90:e2:ba:7f:d5:64
ens802f0
0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0
11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte
NUMA0
Memory (GB) 8 4
VM1 #Cores=
MAC 52:54:00:f7:cd:0c
Linux dev ens10
S1-MME 10.0.10.20
HWBr
HWBr PF
PF ||
SRIOV-VF1.2
NUMA0
Memory (GB) 8 2
VM2 #Cores=
HWBr
HWBr PF
PF
||
SRIOV-VF3.2
NUMA0
Memory (GB) 8 4
VM3 #Cores=
Disk (GB) 16 Interface type hss, scef
Linux dev ens8
IP 192.168.112.60
NUMA0
Memory (GB) 8 2
VM4 #Cores=
Disk (GB) 16
Memory NUMA0
8 16 5
(GB) VM5 #Cores=
S11ExtMACVTAP
16 Disk (GB16 Interface type
S11IntPCI_dev
PCI Addr 0000:00:04.0
MAC 52:54:00:49:d2:6a
Linux dev ens8
Total HWBr Ports SGW S11 IP 10.1.10.20
HWBr PCI HWBr PF |
SRIOV-VF5.4
SRIOV-VF5.4
MAC
Linux Dev
IP
Memory NUMA1
8 8 4
(GB) VM6 #Cores=
Memory NUMA1
8 32 8
(GB) VM7 #Cores
NUMA1
Memory (GB) 8 2
VM10 #Cores
NUMA1
Memory (GB) 8 2
VM11 #Cores
S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21
IP 192.168.122.37
openair-cn(hss)
VCPU-CPU: c3po:
0-5, 1-6 freediameter, cpp driver,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.122.146
Interface type db
IP 192.168.112.61
VCPU-CPU: Cassandra
0-7, 1-8, 2-9, 3- c3po:
freediameter, cpp driver,
10 utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.122.97
VCPU-CPU: c3po-
0-11, 1-12 bind, utils[c-ares dns]
Interface type Mgmt, ddns
Linux dev ens3
IP 192.168.100.183
VCPU-CPU:
ngic-cp1
0-13, 1-14, 2-15,
c3po: utils[c-ares dns]
3-16, 4-17
VCPU-CPU: fpc-odl1
0-19, 1-20, 2-21, c3po:
3-22 memcached, utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238
VCPU-CPU:
0-23, 1-24, 2-25, ngic-dp1
3-26, 4-27, 5-28, c3po: utils[c-ares dns]
6-29, 7-30
Interface type Mgmt
Linux dev ens3
IP 192.168.100.171
CTF
VCPU-CPU: c3po:
0-31, 1-32 freediameter, memcached,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.170
CDF
VCPU-CPU: c3po:
0-33, 1-34 freediameter, utils[c-ares
dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.216
VM3: Cassandra VM10: ctf VM11: cdf
CORES=4, MEM=24GB, CORES=2, MEM=16GB, CORES=2, MEM=16GB,
DISK=40GB DISK=16GB DISK=16GB
c3po: c3po: c3po:
freediameter, cpp driver,
freediameter, utils freediameter, utils
utils
ssh IP 10.212.93.42
user root
passwd intel123
HWBrPF
HWBrPF ||
SRIOV-VF4.10
SRIOV-VF4.10
NUMA node: 0
Total #of Cores 18
#of Cores used 17
PCI Addr 0000:83:00.1
PF | MAC 90:E2:BA:7C:5D:DD
SRIOV-VFs Linux Dev ens801f1
IP 13.1.1.100
NUMA node: 1
#of Cores 18
#of Cored used 16
10GbE
Switch
Linux dev
<1st || IP range ||
13.1.1.174
last> (**)
4 DPDK device
<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)
Linux dev
<1st || IP range ||
13.1.2.14 13.1.2.45
last> (**)
10G Vlan
Servername RAN10
Function AppServ
NG40 OS Specs
NUMA node1
Intel S/PGW test network configuration
Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label
NG40 OS Specs
11.1.2.4
11.1.2.84
10.1.12.224/16
11.1.2.164
11.1.2.244
11.1.2.244
11.1.2.244
penssh selected on NG40 servers
DPDK device 5
NUMA node1
20
0000:81:00.0
90:e2:ba:7f:d5:64
ens802f0
0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0
11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte
NUMA0
Memory (GB) 8 4
VM1 #Cores=
MAC 52:54:00:f7:cd:0c
Linux dev ens4
S1-MME 10.0.10.20
HWBr
HWBr PF
PF ||
SRIOV-VF1.2
SRIOV-VF1.2
NUMA0
Memory (GB) 8 2
VM2 #Cores=
HWBr
HWBr PF
PF
|
SRIOV-VF3.2
SRIOV-VF3.2
NUMA0
Memory (GB) 8 4
VM3 #Cores=
Disk (GB) 16 Interface type hss, scef
Linux dev ens7
IP 192.168.112.60
NUMA0
Memory (GB) 8 2
VM4 #Cores=
Disk (GB) 16
Memory NUMA0
8 16 5
(GB) VM5 #Cores=
S11ExtMACVTAP
16 Disk (GB16 Interface type
S11IntPCI_dev
PCI Addr 0000:00:04.0
MAC 52:54:00:49:d2:6a
Linux dev ens4, ens9
Total HWBr Ports SGW S11 IP 10.1.10.20
HWBr PCI HWBr PF |
SRIOV-VF5.4
SRIOV-VF5.4
MAC
Linux Dev
IP
Memory NUMA1
8 8 4
(GB) VM6 #Cores=
Memory NUMA1
8 32 8
(GB) VM7 #Cores
NUMA1
Memory (GB) 8 2
VM10 #Cores
NUMA1
Memory (GB) 8 2
VM11 #Cores
S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21
cord-epc:mme
VCPU-CPU:
c3po:
0-1, 1-2, 2-3,
freediameter, utils[c-ares
3-4
dns]
Interface type Mgmt
IP 192.168.100.142
openair-cn(hss)
VCPU-CPU: c3po:
0-5, 1-6 freediameter, cpp driver,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.143
Interface type db
IP 192.168.112.61
VCPU-CPU: Cassandra
0-7, 1-8, 2-9, 3- c3po:
freediameter, cpp driver,
10 utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.215
VCPU-CPU: c3po-
0-11, 1-12 bind, utils[c-ares dns]
Interface type Mgmt, ddns
Linux dev ens3
IP 192.168.100.183
VCPU-CPU:
ngic-cp1
0-13, 1-14, 2-15,
c3po: utils[c-ares dns]
3-16, 4-17
VCPU-CPU: fpc-odl1
0-19, 1-20, 2-21, c3po:
3-22 memcached, utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238
VCPU-CPU:
0-23, 1-24, 2-25, ngic-dp1
3-26, 4-27, 5-28, c3po: utils[c-ares dns]
6-29, 7-30
Interface type Mgmt
Linux dev ens3
IP 192.168.100.171
CTF
VCPU-CPU: c3po:
0-31, 1-32 freediameter, memcached,
utils[c-ares dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.170
CDF
VCPU-CPU: c3po:
0-33, 1-34 freediameter, utils[c-ares
dns]
Interface type Mgmt
Linux dev ens3
IP 192.168.100.216
VM3: Cassandra VM10: ctf VM11: cdf
CORES=4, MEM=24GB, CORES=2, MEM=16GB, CORES=2, MEM=16GB,
DISK=40GB DISK=16GB DISK=16GB
c3po: c3po: c3po:
freediameter, cpp driver,
freediameter, utils freediameter, utils
utils
ssh IP 10.212.93.42
user root
passwd intel123
HWBrPF |
SRIOV-VF4.10
NUMA node: 0
Total #of Cores 18
#of Cores used 17
PCI Addr 0000:83:00.1
PF | MAC 90:E2:BA:7C:5D:DD
SRIOV-VFs Linux Dev ens801f1
IP 13.1.1.100
NUMA node: 1
#of Cores 18
#of Cored used 16
10GbE
Switch
Linux dev
<1st || IP range ||
13.1.1.174
last> (**)
4 DPDK device
<1st || IP range ||
13.1.1.238 13.1.2.13
last> (**)
Linux dev
<1st || IP range ||
13.1.2.14 13.1.2.45
last> (**)
10G Vlan
Servername RAN10
Function AppServ
NG40 OS Specs
NUMA node1
Intel S/PGW test network configuration
Fill in values
Filled values
NG40 Install Ubuntu 14.04.5 64 bit Server edition with openssh selected on NG40 serve
Autofilled value
Preconfigured value
Ethernet connection label
NG40 OS Specs
11.1.2.4
11.1.2.84
10.0.12.224/16
11.1.2.164
11.1.2.244
11.1.2.244
11.1.2.244
penssh selected on NG40 servers
NUMA node0
3GPP Interface S1-U
DPDK device 3
PCI Addr 0000:81:00.1
MAC 90:e2:ba:7f:cd:a5 10G Vlan: -
Linux dev eth11 0000:81:00.0
<last || IP range ||
11.1.2.85/16 90:e2:ba:7f:d5:64
1st> (*)
ens802f0
3GPP Interface S1-U
DPDK device 5
DPDK device
PCI Addr
MAC
Linux dev
<last || IP range ||
11.1.2.245/16
1st> (*)
NUMA node1
0000:83:00.0
10G Vlan 90:E2:BA:7C:5D:DC
ens801f0
11.1.1.100
Interface Mgmt / O&M
DEV Linux eth0
PCI Address 0000:03:00.0
MAC 00:1e:67:c9:bd:a8
ssh IP 10.212.93.45
user lte1
passwd lte
PF
PCI Addr 0000:03:00.1
MAC 00:1E:67:C9:BC:59
Linux Dev eno2
IP 10.1.100.200
Memory
32 32 VM1 #Cores= 5
(GB)
Memory
16 16 VM1 #Cores= 4
(GB)
Memory
8 32 VM3 #Cores 8
(GB)
MAC 00:00:00:00:01:02
PF | Linux dev ens8
PCI Addr
SRIOV-VFs SGW S1U IP 11.1.1.93
MAC
Linux Dev
IP
Servername RAN10
Function MME
S11
0000:03:00.1
00:1e:67:c9:bd:a9
eth1
10.1.10.21
1G Switch
Servername
Function
MACVTAP Interface
DEV Linux
PCI Addres
MAC
VCPU-CPU:
0-1, 1-2, 2-3, ngic-cp ssh IP
3-4, 4-5
Interface type Mgmt user
Linux dev ens3 passwd
IP 192.168.100.224
VCPU-CPU:
0-6, 1-7, 2-8, fpc-odl
3-9
Interface type Mgmt
Linux dev ens3
IP 192.168.100.238
VCPU-CPU:
0-19, 1-20, 2-21,
3-22, 4-23, 5-24,
ngic-dp
6-25, 7-26
MAC 00:00:00:00:02:02
Linux dev ens9 PF |
SGW SGI IP 13.1.1.93 SRIOV-VFs PCI Addr
MAC
Linux Dev
IP
NUMA node:
#of Cores
#of Cored used
10GbE
Switch
<1st || IP range ||
10.212.93.41 13.1.1.174
last> (**)
root
intel123 SGi 3GPP Interface
2 DPDK device
0000:81:00.0 PCI Addr
10G Vlan: - 90:e2:ba:7f:cd:a4 MAC
eth10 Linux dev
<1st || IP range ||
13.1.1.206
last> (**)
4 DPDK device
Linux dev
<1st || IP range ||
13.1.2.14
last> (**)
0000:83:00.1
90:E2:BA:7C:5D:DD 10G Vlan
ens801f1
13.1.1.100
1
18
8
Servername RAN10
Function AppServ
13.1.1.173
NG40 OS Specs
13.1.1.205
NUMA node0
13.1.1.237
13.1.2.13
13.1.2.13
13.1.2.45
NUMA node1
Step by Step Process for VM creation and NW Configuration of:
<S1U>
NGIC-CP| <FPC-ODL| NGIC-
<S11>
VM VM> DP|VM
<SGi>
Refer:
README.MD @
https://<user_name>@ilpm.intel-research.net/stash/scm/vccbbk/ngicvm_install_pkg.git
#1:
Target Machine ilepc3:
// Virtualization enaled in BIOS
// VT-D enables in BIOS
root@ilepc3:# vim /etc/default/grub
After:
GRUB_CMDLINE_LINUX=""
Add:
GRUB_CMDLINE_LINUX="intel_iommu=on"
root@ilepc3:~/ng-core_mc-nd# update-grub
$reboot server for grub config to take effect
To check if VT-D is enabled:
root@ilepc3:# dmesg | grep -i dmar
E.g.:
Note:
// Virtualization enaled in BIOS:
DMAR: IOMMU enabled
// VT-D enables in BIOS
DMAR: Intel(R) Virtualization Technology for Directed I/O
#2:
root@ilepc3:# apt-get install qemu-kvm libvirt-bin virtinst bridge-utils cpu-checker libguestfs-tools virt-m
root@ilepc3:# adduser root libvirtd; // Then logout and login back before running virt-manager
To check if kvm is loaded:
root@ilepc3:# lsmod | grep kvm
E.g.:
root@ilepc3:# lsmod | grep -i kvm
kvm_intel 172032 25
kvm 544768 1 kvm_intel
irqbypass 16384 16 kvm,vfio_pci
#3:
root@ilepc3:# git clone <TBD> ngicvm_installer.pkg
root@ilepc3:# cd ngicvm_gen/
#4:
wget ubuntu iso image
root@ilepc3:# wget http://releases.ubuntu.com/16.04.3/ubuntu-16.04.3-server-amd64.iso?_ga=2.57437
NOTE: Ensure:
login is root
All other VM/Guests on the host are shutdown
#5:
root@ilepc3:~# vim ngicvm_defs.cfg
Refer sheet 'NetworkCfg-SRIOV-VM-RAN10' & Define:
# Define Control plane S11 MACVTAP IF name
# Define Control plane + FPC VFs SRIOV IF
# Define Data Plane PCI Devices
# Interface file name prefixes
# VM names
#6:
root@ilepc3:~# vim ngicvm_install_all.sh
# Uncomment/select VMs to be creaeted
#7:
Generate the VMs
root@ilepc3:~# ./ngicvm_install_all.sh
#8:
Login to the VMs
root@ilepc3:~# ./sshvm.sh
use: ./sshvm.sh <login> <domain>
use a domain in: ngic-cp1
#9:
Guest OS standard configuration:
// Install Guest OS
Hostname: ngic-cp1; fpc-odl1; ngic-dp1; ngic-dp2
User Account: ngic
User Name: ngic
Password: ngic
Encrypt Home Directory: No
Partitioning Method:
Guided: use entire disk
Install Security updates automatically
Software Selections:
DNS Server; Standard system utilities; Virtual Machine host; OpenSSH server
# ############################################################
# TODO List:
# #############################################
#1:
ERROR on virt-install --graphics vnc,keymap=en-us (virt-viewer:14543): gtk-vnc-WARNING **: Un
Note: virt-viewer launch can be avoided. Need to figure out a way of killing virt-viewer once the gu
#2:
Remove the virbr0 and virbr0-nic interfaces from being created by default on the Guest VM
#3:
Remove need to type in password on sudo su
#4:
For the vcpupin <domain> vcpu cpuset --config to take effect, after first boot of the guest, shutdown the gues a
vcpu- cpuset start does not work when ngic-dp1 is the only VM that is installed. The vcpu pinning do
vcpupin ngic-dp1 vcpu:0::cpu:19
vcpupin ngic-dp1 vcpu:1::cpu:20
…
vcpupin ngic-dp1 vcpu:7::cpu:26
#5:
Pre create the necessary guest:/etc/network/interface files with the required IP assignments
#6:
Pre install vimtoolkit w/ the guest file system
#7:
Make the Guest Hostnames, User Account, User Name and Password configurable
Keep in view/resolve:
1 Issue with past VMs that have been destroyed showing up on the net-dhcp-leases defa
Note: This apparently seems to be due to the dhcp-lease live times
3 Test the need to shutdown all the guests running on the host to ensure:
- There are no vcpu pinning or other conflicts as the new guest in generated
- There is no conflict in the tearing down & re-creating of previous macvtap interfaces
- Ther is no cobflict in the creation of the sriov VFs
m_install_pkg.git
_ga=2.57437098.1222487909.1502812146-866320519.1491943997
lt on the Guest VM
ired IP assignments
st to ensure:
uest in generated
revious macvtap interfaces
& socket memory