MCRNC Troubleshooting PDF

mcrnc - troubleshooting
MCRNC - Troubleshooting
Copyright 2012 Mika Karento, Juha Malmi. All rights reserved.
complete page in a pdf format: mcrnc troubleshooting
Hardware
1. howto check mcrnc cabling

2. howto check mcrnc clustering
3. howto check port state
4. howto check port config
5. howto mirror ports
6. mcrnc hw configuration
7. how warm is my rnc
8. howto release serial connections
9. howto list PCI devices
10. howto check LMPs IP connectivity

11. howto check LMPs HW events
12. howto to change hdd
13. howto to check filesystem usage
14. LMP flash bank change
15. MAC addresses
Installation
1. commissioning FAILED - lock file exists

2. commissioning FAILED - make_partition failed
3. howto mount sw iso
4. what is storage location for esw delivery
5. where to find initial switch configs
6. howto install patches

7. few useful rpm tricks
8. .versionlabelinfo, section in binaries
Integration
1. default "zipconfig"
2. defautl "zss7config"
3. howto check IUCS/IUPS connectivity
4. howto check IUB connectivity
5. howto check OMS connectivity
6. howto check btsom connections (WBTS)
7. howto check ntp status
8. howto see (actually guess) cell states
MCRNC - Troubleshooting 1
9. how to see RNW DB content
10. reference interface caps (IU,IUB)
11. reference interface caps (OMS,WBTS OAM)
12. interfaces @site routers
13. my rnwdb is not starting
14. IPMGMT roles and how to use them
Troubleshooting
1. howto check interface states

2. howto see routing config
3. howto see BFD session states
4. VRFs change the normal commands
5. howto translate dx error codes

6. zcommand - collection
7. tcpdumping
8. octeon ethernet stats
9. port counters
10. eitputil - eitp troubleshooting utility
11. my wireshark settings
12. RTE location of a process
13. ZJANE
14. ruoste
15. core dump handling in (RELEASE_MODE) builds
16. fsddiag - fastdist diag tool
17. iltrmcli - troubleshooting tool for cacprb
18. test_responder connectivity for licenses
Q: commissioning failed - lock file exists
DEBUG:lock file exists

ERR:Note that only one CLA node should be commissioned!
ERR:If you wish to recommission then first reset the session
ERR:by executing "fsetupcli session reset 2boksi"
DEBUG:Debug is on, you'll have to unmount all mounts manually.
#=============================================#
# COMMISSIONING: FAILED (1)
# START DATE: 2011-12-29-123131
# END DATE: 2011-12-29-123131
# ELAPSED TIME: 00:00:00
#=============================================#
remember to reset your session before you try to reinstall
[root@myfews ~]# fsetupcli session reset mc455
Integration 2
Q: commissioning failed - make_partition failed
check the HDD
Q: howto mount RNC SW delivery (ISO image)
[root@myfews ~]# mkdir -p /mnt/mypoint/v

[root@myfews ~]# mount -o loop /opt/nokiasiemens/fews/deliveries/R_QNCB.11.41.1_27.WR.mips.bv/R
** when you are done REMEMBER to unmount

[root@myfews ~]# umount /mnt/mypoint/v
** hint: use losetup for loop device control (man losetup) **

[root@a1fews_pomi ~]# losetup -a
/dev/loop0: [fd00]:62029830 (/opt/nokiasiemens/fews/deliveries/R_QNCB.11.41.1_26.WR.mips.bv*)
what is the storage location for esw
root@a1fews_hp2 script]# mount | grep 1_31

/opt/nokiasiemens/fews/deliveries/R_QNCB.11.41.1_31.WR.mips.bv/R_QNCB.11.41.1_31.WR.mips.rv.img
** esw delivery is located @

[root@a1fews_hp2 esw_file]# pwd
/mnt/mypoint/v/opt/nokiasiemens/SS_FirmwareBCN/esw_file
[root@a1fews_hp2 esw_file]# ls
BCN1_eSW_baseline_R_BCNESW_11_51.txt R_BCNESW_11_51.tar.gz
howto find initial switch configs
** switch initial scripts can be found from:

root@a1fews_hp2 script]# mount | grep 1_31
/opt/nokiasiemens/fews/deliveries/R_QNCB.11.41.1_31.WR.mips.bv/R_QNCB.11.41.1_31.WR.mips.rv.img
root@a1fews_hp2 script]# pwd; ls bcn*initial*

/mnt/mika/v/opt/nokiasiemens/SS_QNDDQNRefConfigs/script
bcn_ext_initial.scr bcn_main_initial.scr
howto install patches
[root@CFPU-0(RNC-451) /root/jee]
# fsswcli -p --skip-mount -i @/@/wnd:/root/jee/pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_r
WARNING: You used --skip-mount.

You MUST RESTART the system after the patching is done.
Before restart the new changes won't be applied.
2 patch(es) applied under tags:pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm

# fsswcli -p -l
Source : /tmp/tmp.GvYEG31287/rekove
Patch : /srv/rte/patches/R_QNCB.11.41.1_33.WR.mips.bv-mips64-wnd/rekove
Target : /mnt/sysimg/opt/nokiasiemens/pac_rek_qx_e1/bin/rekove
Image : R_QNCB.11.41.1_33.WR.mips.bv-mips64-wnd
Time : 15.02.2012 14:34:14
Version : pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.mips
TAG : pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm
Troubleshooting 3
Source : /tmp/tmp.GvYEG31287/pac_rek_qx_e1_processtypes.ldif
Patch : /srv/rte/patches/R_QNCB.11.41.1_33.WR.mips.bv-mips64-wnd/pac_rek_qx_e1_processtypes.l
Target : /etc/opt/nokiasiemens/ldapfiles/ldif_in/pac_rek_qx_e1_processtypes.ldif
Image : R_QNCB.11.41.1_33.WR.mips.bv-mips64-wnd
Time : 15.02.2012 14:34:14
Version : pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.mips
TAG : pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm
** patch DB, patch history

# cat /srv/rte/patches/R_QNCB.11.41.1_33.WR.mips.bv-mips64-wnd/db
[rekove]
comment=
target=/mnt/sysimg/opt/nokiasiemens/pac_rek_qx_e1/bin/rekove
variant=wnd
delivery=R_QNCB.11.41.1_33.WR.mips.bv
source=/tmp/tmp.GvYEG31287/rekove
tag=pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm
version=pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.mips
time=1329309254.0
arch=mips64
id=rekove
[pac_rek_qx_e1_processtypes.ldif]
comment=
target=/etc/opt/nokiasiemens/ldapfiles/ldif_in/pac_rek_qx_e1_processtypes.ldif
variant=wnd
delivery=R_QNCB.11.41.1_33.WR.mips.bv
source=/tmp/tmp.GvYEG31287/pac_rek_qx_e1_processtypes.ldif
tag=pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm
version=pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.mips
time=1329309254.0
arch=mips64
id=pac_rek_qx_e1_processtypes.ldif
few useful RPM tricks
** query all installed RPMs

[root@CFPU-0(RNC-454) /opt/nokiasiemens/SS_SCLI/etc/features]
# rpm -qa | grep SCLI
SS_DSPSCLI-1.32.2.5-R_FSPR5LYNX_1.27.1.37.mips
SS_IPMgmtSCLI-1.10.1.5-R_FSPR5LYNX_1.27.1.37.mips
SS_IPSecMgmtSCLI-1.6.1.1-R_FSPR5LYNX_1.27.1.37.mips
...
** RPM contents
[root@CFPU-0(RNC-454) /opt/nokiasiemens/SS_SCLI/etc/features]
# rpm -qil SS_LDAPSCLI-1.25-R_FSPR5LYNX_1.27.1.37.mips
Name : SS_LDAPSCLI Relocations: (not relocatable)
Version : 1.25 Vendor: Nokia Siemens Networks
Release : R_FSPR5LYNX_1.27.1.37 Build Date: Thu Jan 26 18:14:49 2012
Install Date: Fri Feb 3 12:51:15 2012 Build Host: trling20.emea.nsn-net.net
Group : Nokia Siemens Networks/Flexi Source RPM: SS_LDAPSCLI-1.25-R_FSPR5LYNX_1.27.1.37
Size : 1174768 License: Commercial
Signature : (none)
Summary :
Description :
Imagevariant: wnd
Troubleshooting 4
*** No component version info available
/opt/nokiasiemens/SS_SCLI/etc/cli_wrappers/fslistnodes.sh
/opt/nokiasiemens/SS_SCLI/etc/commands_xml/LdapCommands.cli.xml
/opt/nokiasiemens/SS_SCLI/etc/commands_xml/LdapLocalCommands.cli.xml
/opt/nokiasiemens/SS_SCLI/etc/commands_xml/LdapRemoteCommands.cli.xml
/opt/nokiasiemens/SS_SCLI/etc/commands_xml/LdapTransaction.cli.xml
/opt/nokiasiemens/SS_SCLI/etc/commands_xml/transaction.view.xml
/opt/nokiasiemens/SS_SCLI/etc/modules/libsclifwkLdapCommands.so
/opt/nokiasiemens/SS_SCLI/etc/unsupported_cmds/ext_ldap_unsupported.cfg
** to which RPM this file belongs?

[root@CFPU-0(RNC-454) /opt/nokiasiemens/lib64]
# rpm -qf libilcosite.so
SS_ILCoSiting-ipal1110.1718-R_IL_3.10.1.15.mips
** verify TAGS
** S file Size differs
** M Mode differs (includes permissions and file type)
** 5 MD5 sum differs
** D Device major/minor number mismatch
** L readLink(2) path mismatch
** U User ownership differs
** G Group ownership differs
** T mTime differs
# rpm -V pac_rrc_qx_e1-promoted.31663-R_QNCB.11.41.1_31.mips
Unsatisfied dependencies for pac_rrc_qx_e1-promoted.31663-R_QNCB.11.41.1_31.mips:
/opt/nokiasiemens
.M...... /etc/opt/nokiasiemens/ldapfiles/ldif_in/pac_rrc_qx_e1_processtypes.ldif
....L... /opt/nokiasiemens/pac_rrc_qx_e1
** RPM dump, including md5sums

[root@CFPU-0(RNC-453) /root]
# rpm -q --dump pac_nba_qx_e1-promoted.1808-R_QNCB.11.41.1_26.mips
/etc/opt/nokiasiemens/ldapfiles/ldif_in/pac_nba_qx_e1_processtypes.ldif 2326 1326861797 538f937
/opt/nokiasiemens/pac_nba_qx_e1 4096 1326861797 00000000000000000000000000000000 040755 root ro
/opt/nokiasiemens/pac_nba_qx_e1/bin 4096 1326861797 00000000000000000000000000000000 040755 roo
/opt/nokiasiemens/pac_nba_qx_e1/bin/nbaprb 8227677 1326861797 e71369e95e0037e6d91bacf54a5c31dc
** for DIY guys

# rpm --querytags
ARCH
ARCHIVESIZE
BASENAMES
BLINKHDRID
BLINKNEVRA
....
** tailor your own query output

# rpm --qf "%{ARCH}-%{NAME}-%{BUILDHOST}-%{ARCH}-%{VERSION}\n" -qa
mips64_octeon-bash-osbuild-mips64_octeon-3.1
mips64_octeon-filesystem-osbuild-mips64_octeon-2.4.0
noarch-setup-osbuild-noarch-2.6.3
mips64_octeon-rpm-osbuild-mips64_octeon-5.0_20070714
mips64_n32_octeon-glibc-osbuild-mips64_n32_octeon-2.5
mips64_octeon-glibc-osbuild-mips64_octeon-2.5
mips64_octeon-glibc-common-osbuild-mips64_octeon-2.5
mips64_n32_octeon-glibc-debuginfo-osbuild-mips64_n32_octeon-2.5
Troubleshooting 5
mips64_octeon-glibc-debuginfo-osbuild-mips64_octeon-2.5
mips64_octeon-glibc-utils-osbuild-mips64_octeon-2.5
mips64_octeon-perl-osbuild-mips64_octeon-5.8.7
mips64_octeon-pam-osbuild-mips64_octeon-0.99.6.2
mips64_octeon-coreutils-osbuild-mips64_octeon-6.9
...
# rpm -q --queryformat '%{NAME}: [%{FILENAMES} (%{FILESIZES} bytes) (md5sum: %{FILEMD5S})\n]' p
pac_nba_qx_e1: /etc/opt/nokiasiemens/ldapfiles/ldif_in/pac_nba_qx_e1_processtypes.ldif (2326 by
/opt/nokiasiemens/pac_nba_qx_e1 (4096 bytes) (md5sum: )
/opt/nokiasiemens/pac_nba_qx_e1/bin (4096 bytes) (md5sum: )
/opt/nokiasiemens/pac_nba_qx_e1/bin/nbaprb (8227677 bytes) (md5sum: e71369e95e0037e6d91bacf54a5
.versionlabelinfo section in binaries
# readelf -S /opt/nokiasiemens/pac_boi_qx_e1/bin/boimed | grep version
[ 6] .gnu.version VERSYM 000000012000d940 0000d940
[ 7] .gnu.version_r VERNEED 000000012000e110 0000e110
[31] .versionlabelinfo PROGBITS 0000000000000000 00081308
# readelf --hex-dump=31 /opt/nokiasiemens/pac_boi_qx_e1/bin/boimed
Hex dump of section '.versionlabelinfo':

0x00000000 3c766572 73696f6e 5f626f69 6d65643e &lt version_boimed&gt
0x00000010 0a72656c 65617365 3a525f51 4e43422e .release:R_QNCB.
0x00000020 31312e34 312e315f 33312073 75627379 11.41.1_31 subsy
0x00000030 7374656d 3a687474 70733a2f 2f626873 stem:https://bhs
0x00000040 636d652e 696e7369 64652e6e 6f6b6961 cme.inside.nokia
0x00000050 7369656d 656e736e 6574776f 726b732e siemensnetworks.
0x00000060 636f6d2f 69736f75 7263652f 73766e72 com/isource/svnr
0x00000070 6f6f742f 7061632d 626f695f 71782d65 oot/pac-boi_qx-e
0x00000080 312f6d63 2f627261 6e636865 732f525f 1/mc/branches/R_
0x00000090 514e4342 2e31312e 34312e30 5f32282d QNCB.11.41.0_2(-
0x000000a0 72203237 38362920 686f7374 6e616d65 r 2786) hostname
0x000000b0 3a62686c 696e6733 322e6170 61632e6e :bhling32.apac.n
0x000000c0 736e2d6e 65742e6e 65742064 6174653a sn-net.net date:
0x000000d0 28467269 20466562 20203320 31343a33 (Fri Feb 3 14:3
0x000000e0 323a3438 20323031 32292075 7365723a 2:48 2012) user:
0x000000f0 6d63726e 636d616e 5f635f69 6e207376 mcrncman_c_in sv
0x00000100 6e656e76 6f707473 3a282d77 202d6120 nenvopts:(-w -a
0x00000110 6d697073 202d6720 76202d6a 206d616b mips -g v -j mak
0x00000120 65207265 6c656173 655f7270 6d20534b e release_rpm SK
0x00000130 49505f4c 4942533d 54203e20 2f766172 IP_LIBS=T &gt /var
0x00000140 2f667077 6f726b2f 4d43524e 435f4144 /fpwork/MCRNC_AD
0x00000150 412f4765 6e657261 6c2f2f42 55494c44 A/General//BUILD
0x00000160 532f6263 6e5f525f 514e4342 2e31312e S/bcn_R_QNCB.11.
0x00000170 34312e31 5f33312f 2f70726f 64756374 41.1_31//product
0x00000180 2f627569 6c642f62 636e5f62 6f695f71 /build/bcn_boi_q
0x00000190 786d632e 6c6f6720 323e2631 2920646d xmc.log 2&gt&1) dm
0x000001a0 78736163 6b3a282f 64617461 2f65655f xsack:(/data/ee_
0x000001b0 70646573 77622f71 6e656e76 2f31315f pdeswb/qnenv/11_
0x000001c0 34315f31 3a2f6461 74612f65 655f7064 41_1:/data/ee_pd
0x000001d0 65737762 2f696d65 6e762f31 315f3130 eswb/imenv/11_10
0x000001e0 5f313a2f 64617461 2f65655f 70646573 _1:/data/ee_pdes
0x000001f0 77622f69 6d656e76 2f31315f 31305f31 wb/imenv/11_10_1
0x00000200 3a290a3c 2f766572 73696f6e 5f626f69 :).&lt/version_boi
0x00000210 6d65643e 0a med&gt
Troubleshooting 6
Hardware
howto check mcrnc cabling (@after commissioning)
[root@CFPU-0(RNC-455) /opt/nokiasiemens/SS_QNTools/script]
# ./zcablecheck.sh
Found 2 lmps: lmp-1-1-1 lmp-1-2-1
Target schema:
BCN1 BCN2 BCN3 BCN4 BCN5 BCN6

---- ---- ---- ---- ---- ----
SFP+1 SFP+1
SFP+2 SFP+2
Checking that all relevant SFP+-ports are up, exit if not:

BCN1/SFP+1 :OK.
BCN1/SFP+2 :OK.
BCN2/SFP+1 :OK.
BCN2/SFP+2 :OK.
Check1: OK, all SFP+-ports are UP.
Checking the cables are connected according to the schema:

BCN1/SFP+1 BCN2/SFP+1 :OK.
BCN1/SFP+2 BCN2/SFP+2 :OK.
Check2: OK, cables connected according to the schema.
howto check mcrnc clustering
# /opt/nokiasiemens/SS_QNTools/script/zbackb.sh
RNC backplane configuration Sat Feb 11 10:20:50 EET 2012
*** LMP-1-1-1 ***
SFP1 Enable 10G Full 10G Full Up Enable Enable long
*** LMP-1-2-1 ***
*** LMP-1-3-1 ***
*** LMP-1-4-1 ***
*** LMP-1-5-1 ***
Hardware 7
*** LMP-1-6-1 ***
howto check port state (external SFP states)
** m10 and m40 SFP states below.

** @zjane 1=m10, 2=m20, 3=m30, 4=m40, 5=m50, 6=m60
# zjane 1 ZLAI
Sat Feb 11 10:22:36 EET 2012 : BCM: show SFP ports:
Admin Physical Physical Link Link LACP Actor
Intf Type Mode Mode Status Status Trap Mode Timeout
------ ------ ------- ---------- ---------- ------ ------- ------ --------
SFP6 Disable Auto 10G Full Up Enable Enable long
SFP7 Enable Auto 1000 Full Up Enable Enable long
SFP9 Disable Auto Down Enable Enable long
# zjane 4 ZLAI
Sat Feb 11 10:22:41 EET 2012 : BCM: show SFP ports:
------ ------ ------- ---------- ---------- ------ ------- ------ --------
SFP6 Disable Auto 1000 Full Up Enable Enable long
Hardware 8
howto check port config
** m10 LMPs main switch interface (eth0.800) config
# zjane 1 i m 0/25
Target is MAIN(230) switch port 0/25.
interface 0/25
no shutdown
description 'mgmt'
classofservice dot1p-mapping 0 0
mtu 9022
vlan acceptframe vlanonly
vlan ingressfilter
vlan participation exclude 1,7-8,15-16,801-899
vlan participation include 800
vlan tagging 800
vlan priority 6
mode dvlan-tunnel
exit
** m60 external SFP20 (megamon port) config
# zjane 6 i SFP20
Target is EXT switch port SFP20(0/14).
interface 0/14
service-policy in dscp_to_phb_mapping_policy_ext
shutdown
description 'sfp20'
mtu 1522
vlan participation exclude 1,7-8,15-16
exit
howto mirror ports
See also: my wireshark settings
Hardware 9
** create port mirroring. in this case all of the 12 EIPUs
** and their external traffic will be mirrored to box m10 port SFP6
**
# zjane cp m "10/14 10/6 20/14 20/6 30/14 30/6 40/14 40/6 50/14 50/6 60/14 60/6" 10/2 all
Sat Feb 11 10:33:49 EET 2012 : Set port monitor
INFO, port LMP-1-1-1 main/0/2 active.
Connecting to LMP-1-1-1.managementnet.localdomain...
m10: Mirroring ready and active.
** how to check mirroring state

# zjane m
Sat Feb 11 14:27:02 EET 2012 : BCM: show monitor (mirroring) session 1:
Port monitoring MAIN SWITCH 10:
Session ID Admin Mode Probe Port Mirrored Port Type
---------- ---------- ---------- ------------- ------
1 Enable 10/2 10/14 all
10/6 all
Bit Pattern monitoring MAIN SWITCH 10:

Session ID Admin Mode Probe Port Mask and bit pattern match udf_offset Chunks
---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
---------- ---------- ---------- ------------- ------
1 Enable 10/2 20/14 all
20/6 all

---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
---------- ---------- ---------- ------------- ------
1 Enable 10/2 30/14 all
30/6 all
Hardware 10
---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
---------- ---------- ---------- ------------- ------
1 Enable 10/2 40/14 all
40/6 all

---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
---------- ---------- ---------- ------------- ------
1 Enable 10/2 50/14 all
50/6 all

---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
---------- ---------- ---------- ------------- ------
1 Enable 10/2 60/14 all
60/6 all

---------- ---------- ---------- -------------------------------- ---------- ---------
1 Disabled
EXTENSION switch:
show monitor session 1

---------- ---------- ---------- ------------- -----
1 Disable
Hardware 11
---------- ---------- ---------- ------------- -----
1 Disable

---------- ---------- ---------- ------------- -----
1 Disable

---------- ---------- ---------- ------------- -----
1 Disable

---------- ---------- ---------- ------------- -----
1 Disable

---------- ---------- ---------- ------------- -----
1 Disable
** NOTE: LAN1,LAN2 cannot be monitored using zjane.

** Ports and their carrying traffic should be snooped
** by using some other means (like tcpdump @CFPUs)
mcrnc hw configuration
# hwcli --t
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
| [..] | [..] | [..] | [..] | [..] | [..] | [..] |
+------------+------------+------------+------------+------------+------------+------------+---
01 02 03 04 05 06 07
[..] -- multiple nodes linked with this addin
Green color indicates available nodes

Red color indicates that the node is powered off or in unknown state
Hardware 12
Total:
1 cabinet(s)
6 chassis(s)
48 addin(s)
# hwcli
LMP-1-1-1 : node available /cabinet-1/chassis-1/piu-1

CFPU-0 : node available /cabinet-1/chassis-1/piu-1/addin-1/CPU-1/core-0,1,10,2,3,4,5
CSPU-0 : node available /cabinet-1/chassis-1/piu-1/addin-2/CPU-1/core-0,1,2,3,4,5
USPU-0 : node available /cabinet-1/chassis-1/piu-1/addin-3/CPU-1/core-0,1,2,3,4
EIPU-0 : node available /cabinet-1/chassis-1/piu-1/addin-4/CPU-1/core-0,1,2,3,4,5
USSR-0 : node available /cabinet-1/chassis-1/piu-1/addin-1/CPU-1/core-11
CSUP-0 : node available /cabinet-1/chassis-1/piu-1/addin-2/CPU-1/core-10,11,6,7,8,9
USUP-0 : node available /cabinet-1/chassis-1/piu-1/addin-3/CPU-1/core-10,11,5,6,7,8,
EITP-0 : node available /cabinet-1/chassis-1/piu-1/addin-4/CPU-1/core-10,11,6,7,8,9
CFPU-1 : node available /cabinet-1/chassis-2/piu-1/addin-1/CPU-1/core-0,1,10,2,3,4,5
USSR-1 : node available /cabinet-1/chassis-2/piu-1/addin-1/CPU-1/core-11
Hardware 13
how warm is my rnc
root@mcrnc-454_lmp-1-1-1:~# ipmitool sdr

PEX Temp | 49 degrees C | ok
LMP Temp | 49 degrees C | ok
BCM56512 Temp | 48 degrees C | ok
BCM56820 Temp | 69 degrees C | ok
Inlet1 Temp | 28 degrees C | ok
Outlet Temp | 28 degrees C | ok
Hardware 14
Fan 1 | 3920 RPM | ok
Fan 2 | 1680 RPM | ok
Fan 3 | 3710 RPM | ok
Fan 4 | 1540 RPM | ok
Fan 5 | 12880 RPM | ok
Fan 6 | 6440 RPM | ok
3.3SB | 3.33 Volts | ok
1.1V | 1.10 Volts | ok
1.8V | 1.83 Volts | ok
0.9V | 0.92 Volts | ok
12V | 12.03 Volts | ok
VCC5 | 5.11 Volts | ok
VCC3 | 3.30 Volts | ok
1.25V_XG | 1.25 Volts | ok
1.25V_GE | 1.27 Volts | ok
1.0V | 1.01 Volts | ok
VCCA | 3.30 Volts | ok
PSU1 INPUT | 230 Volts | ok
PSU2 INPUT | 234 Volts | ok
PSU1 OUT_12V | 12.03 Volts | ok
PSU2 OUT_12V | 11.97 Volts | ok
PSU1 OUT_3V3 | 3.28 Volts | ok
PSU2 OUT_3V3 | 3.25 Volts | ok
PSU1 OUT_Curr | 18.50 Amps | ok
PSU2 OUT_Curr | 22 Amps | ok
PSU1 Status | 0 unspecified | cr
PSU2 Status | 0 unspecified | cr
PSU1 Temp 1 | 0 degrees C | ok
PSU1 Fan 1 | 10200 RPM | ok
PSU2 Fan 1 | 9500 RPM | ok
PSU1 Fan 2 | disabled | ns
PSU2 Fan 2 | disabled | ns
PSU1 IN_Curr | 1.07 Amps | ok
PSU2 IN_Curr | 1.32 Amps | ok
Reset Button | 0 unspecified | ok
PSU_IRQ | 0 unspecified | cr
CLOCK_IRQ | 0 unspecified | ok
Hot Swap AMC 1 | 0 unspecified | cr
Hot Swap AMC 10 | 0 unspecified | nc
BMC Watchdog | 0 unspecified | nc
SEL status | 0 unspecified | ok
LMP Reset | 0 unspecified | cr
Hardware 15
howto release serial connections
** 2 ways to quit telnets
# ssh lmp-1-2-1 service ser2netd restart
Shutting down ser2netd: [ OK ]
Starting ser2netd: [ OK ]
** via port 2000 (ser2netd control port)

# telnet lmp-1-2-1 2000
Trying 169.254.240.21...
Connected to lmp-1-2-1.
Escape character is '^]'.
-> disconnect 3004
Port not connected: 3004
->
** CPU console connections and their states

# telnet lmp-1-1-1 2000
Trying 169.254.240.52...
Connected to lmp-1-1-1.
Escape character is '^]'.
-> showport
TCP Port 3001
enable state: telnet
timeout: 0
connected to (or last connection): 192.168.54.250:37885
device: /dev/ttyS2
device config: 115200 1STOPBIT 8DATABITS NONE
device controls: RTSHI DTRHI
tcp to device state: waiting input
device to tcp state: waiting input
bytes read from TCP: 309
bytes written to TCP: 540045
bytes read from device: 540045
bytes written to device: 300
TCP Port 3002
timeout: 0
device: /dev/ttyS3
TCP Port 3003
timeout: 0
device: /dev/ttyS4
Hardware 16
TCP Port 3004
timeout: 0
device: /dev/ttyS5
TCP Port 3005
timeout: 0
device: /dev/ttyS6
TCP Port 3006
timeout: 0
device: /dev/ttyS7
TCP Port 3007
timeout: 0
device: /dev/ttyS8
TCP Port 3008
timeout: 0
device: /dev/ttyS9
Hardware 17
->
howto list PCI devices @LMP
root@mcrnc-454_lmp-1-1-1:~# lspci
00:00.0 Power PC: Motorola Unknown device 0013 (rev 21)
00:11.0 Network controller: Broadcom Corporation Unknown device b820 (rev 11)
00:12.0 Network controller: Broadcom Corporation Unknown device b512 (rev 01)
00:13.0 USB Controller: NEC Corporation USB (rev 44)
00:13.1 USB Controller: NEC Corporation USB 2.0 (rev 05)
00:14.0 PCI bridge: PLX Technology, Inc. PEX8112 x1 Lane PCI Express-to-PCI Bridge (rev aa)
00:15.0 ISA bridge: Advantech Co. Ltd Unknown device 4e20 (rev 03)
01:00.0 Serial controller: Oxford Semiconductor Ltd Unknown device c308
howto check LMPs IP connectivity
** LMP CFPU connectivity

LMP-1-1-1 eth0.800 (0/25) (0/19) xaui0 CFPU-0 (m10)
LMP-1-2-1 eth0.800 (0/25) (0/19) xaui0 CFPU-1 (m20)
...
** dhcp settings
** trust the text below. DO NOT MANUALLY ALTER LMP's DHCLIENT config
** RackNumber and NodeNumber are part of the identifier string
**
[root@CFPU-0(RNC-454) /srv/Log/log]
# ssh lmp-1-1-1 cat /etc/dhclient.conf
# DON'T EDIT THIS FILE MANUALLY, UNLESS YOU HAVE OTHER PLAN
timeout 10;
retry 30;
interface "eth0.800" {
send host-name "mcrnc-454_lmp-1-1-1";
send dhcp-client-identifier 00:ff:ff:ff:ff:fe:ff:ff:01:01:0d:20:01:ff:ff:ff;
send dhcp-lease-time 3600;
}
[root@CFPU-0(RNC-454) /srv/Log/log]
# ssh lmp-1-2-1 cat /etc/dhclient.conf
# DON'T EDIT THIS FILE MANUALLY, UNLESS YOU HAVE OTHER PLAN
timeout 10;
retry 30;
interface "eth0.800" {
send host-name "mcrnc-454_lmp-1-2-1";
send dhcp-client-identifier 00:ff:ff:ff:ff:fe:ff:ff:02:01:0d:20:01:ff:ff:ff;
send dhcp-lease-time 3600;
}
** eth0.800 should get the IP from the CFPUs

root@mcrnc-454_lmp-1-1-1:~# ip a s eth0.800
3: eth0.800@eth0: mtu 1500 qdisc noqueue
link/ether 00:d0:c9:bf:13:fb brd ff:ff:ff:ff:ff:ff
Hardware 18
inet 169.254.240.52/24 brd 169.254.240.255 scope global eth0.800
inet6 fe80::2d0:c9ff:febf:13fb/64 scope link
valid_lft forever preferred_lft forever
** 6 box LMP IPs are

[root@CFPU-0(RNC-454) /mnt/QNOMU/plan]
# grep LMP /etc/hosts
169.254.240.52 LMP-1-1-1.managementnet.localdomain LMP-1-1-1
** dhcp reqs are visible @syslog under CFPUs

Feb 12 21:12:48.596460 info CFPU-0 dhcpd: DHCPREQUEST for 169.254.240.52 from 00:d0:c9:bf:13:fb
Feb 12 21:12:48.599342 info CFPU-0 dhcpd: DHCPACK on 169.254.240.52 to 00:d0:c9:bf:13:fb (mcrnc
** interface 0/25 connects LMP to main switch

** interface 0/19 connects CPU1 (CFPU-*) to main switch
# zjane 1 i m 0/25
interface 0/25
no shutdown
description 'mgmt'
mtu 9022
vlan acceptframe vlanonly
vlan ingressfilter
vlan participation exclude 1,7-8,15-16,801-899
vlan participation include 800
vlan tagging 800
vlan priority 6
mode dvlan-tunnel
exit
# zjane 1 i m 0/19
interface 0/19
no auto-negotiate
no shutdown
description 'addin-1-xaui0'
mtu 9022
Hardware 19
vlan pvid 800
vlan participation exclude 1,7-8,15-16
vlan participation include 800-899
vlan tagging 801-899
mode dvlan-tunnel
exit
howto check LMPs HW events
# ssh lmp-1-1-1 mch_cli SEL list
1 | 02/07/2012 | 12:43:50 | FRU Hot Swap #0x32 | Transition to M2 | Asserted
6 | 02/07/2012 | 12:43:52 | Reset Type #0x5d | hard reset | Asserted
8 | 02/07/2012 | 12:43:52 | Reset Type #0x6d | hard reset | Asserted
... clip ...
howto change hdd
*** from CFPU-0 to CFPU-1

# fshascli -ln /CFPU-1
[root@CFPU-0(RNC-454) /var/opt/nokiasiemens]
# hwcli -np on CFPU-1
# hwcli -nr -B 3 CFPU-1
*** replace box2 hdd
root@CFPU-0 [RNC-454] > initialise hw verbose 3
# hwcli -nr -B 2 CFPU-1
# fshascli -un /CFPU-1
filesystem check
** state full, how to debug

[root@CFPU-0(RNC-455) /mnt/state]
# df .
Filesystem 1K-blocks Used Available Use% Mounted on
/dev/VG_CFPU-0_FP5LYNX/state
2015824 1853860 59564 97% /mnt/state
[root@CFPU-0(RNC-455) /mnt/state]
# du -hc --max-depth=1
385M ./CFPU-0
20K ./CLA-0
16K ./lost+found
Hardware 20
1.4G ./_global
1.8G .
1.8G total
[root@CFPU-0(RNC-455) /mnt/state/_global]
# du -hc --max-depth=1
556K ./etc
80M ./usr
1.3G ./root
4.0M ./srv
372K ./tftpboot
24K ./var
1.4G .
1.4G total
[root@CFPU-0(RNC-455) /mnt/state/_global]
# du -hc --max-depth=1 root/
28K root/.ssh
1.3G root/SW_builds
1.3G root/
1.3G total
LMP flash bank change
LMP has to be rebooted and dropped to uboot, in order to change the bootflashbank
** @LMP UBOOT, issue the following ipmi commands to change the bank
USE Bank 1
============
=> ipmi raw 2e 04 2a 6f 00 00 00 80 00 00
60 bc e4 20 68 04 00 2a 6f 00 db
=> reset
# USE Bank 0
============
=> ipmi raw 2e 04 2a 6f 00 00 00 00 00 00
60 bc e4 20 6c 04 00 2a 6f 00 d7
MAC addressing
** BASE MAC is stored under LMPs

# ssh lmp-1-1-1 mch_cli GetMacAddress
00:D0:C9:BF:13:FB
00:D0:C9:BF:0B:7B
00:D0:C9:BF:06:7B
00:D0:C9:BF:0F:3B
00:D0:C9:BB:AC:34
00:D0:C9:BF:09:BB
Hardware 21
# cat /var/log/dmesg | grep PROM
PROM command line: coremask=0x07FF panic=15 rd_start=0xa800000005000000 rd_size=11927463 FRU=BC
vrt=6w host=CFPU-0 rel=R_QNCB.11.41.1_31.WR.mips.bv-mips64-wnd hw=BCN mac_addr=00:d0:c9:bf:14:0
# ssh cfpu-1 "grep PROM /var/log/dmesg"
PROM command line: coremask=0x07FF panic=15 rd_start=0xa800000005000000 rd_size=11927463 FRU=BC
vrt=6w host=CFPU-1 rel=R_QNCB.11.41.1_31.WR.mips.bv-mips64-wnd hw=BCN mac_addr=00:d0:c9:bf:0b:8
# ps -ef | grep Network
root 7924 7722 0 Feb07 ? 00:02:03 /opt/nokiasiemens/SS_NetworkManager/bin/Network
--exec-path /opt/nokiasiemens/SS_NetworkManager/bin/start-NetworkManager.sh -L NetGraphSocket -
-w EthTool:priority=65535:bld=cavium-ethernet -l Iface:forbid=.:vrf=yes:bypassaclrules=yes -l E
-l 6WLinkAggrIface -l IPv4InIPv4Iface:probe-module=no:alias-IPv6=yes:alias-xin4=yes:vrf=yes:all
-l 6WGREIface -l IPv4Addr -l IPv6Addr:peer=yes -l IPv4Neigh -l IPv6Neigh -l 6WVRF -l 6WIPv4ACLR
-l Ignore:IPv4Route:IPv6Route --baseMACAddress 00:D0:C9:BF:13:FE --baseIndex 0 --baseMACIndexRa
# ssh cfpu-1 "ps -ef | grep Network"
root 7927 7758 0 Feb07 ? 00:01:58 /opt/nokiasiemens/SS_NetworkManager/bin/Network
--exec-path /opt/nokiasiemens/SS_NetworkManager/bin/start-NetworkManager.sh -L NetGraphSocket -
-w EthTool:priority=65535:bld=cavium-ethernet -l Iface:forbid=.:vrf=yes:bypassaclrules=yes -l E
-l 6WLinkAggrIface -l IPv4InIPv4Iface:probe-module=no:alias-IPv6=yes:alias-xin4=yes:vrf=yes:all
-l 6WGREIface -l IPv4Addr -l IPv6Addr:peer=yes -l IPv4Neigh -l IPv6Neigh -l 6WVRF -l 6WIPv4ACLR
-l Ignore:IPv4Route:IPv6Route --baseMACAddress 00:D0:C9:BF:0B:7E --baseIndex 0 --baseMACIndexRa
default "zipconfig"
** not the complete config, few points to check

** and make sure they are correct
** RULE
** VLAN / EIPU / SERVICE TYPE
** interface creation (SFP7-SFP22)

** remember to use the outqset rncdefault
add networking ether /EIPU-0 iface ethsfp7 port sfp7 outqset rncdefault
** vlan interface
** note the mapping vlandscptopcp
add networking vlan /EIPU-0 realiface ethsfp7 vid 2000 vlaniface iucscp1_r1 mapping vlandscptop
** IP addresses
** interface addresses
add networking address dedicated /EIPU-0 iface iucscp1_r1 ip-address 10.16.230.2/28 user /SS7SG
** loopbacks
add networking address dedicated /QNUP-0 iface lo ip-address 10.16.231.64/32 role iucsup
** static routing
set routing instance default node EIPU-0 static-route 10.20.153.48/32 nexthop gateway address 1
** loopback internal routing

set routing instance default node CFPU-0 static-route 10.16.231.124/32 nexthop gateway address
set routing instance default node CFPU-1 static-route 10.16.231.124/32 nexthop gateway address
Hardware 22
advanced topics
** BFD routing (applies to iub + up routing), when BFD is in use

set routing instance default node EIPU-0 static-route 10.16.225.224/28 nexthop gateway address
-rx-interval 150 bfd-tx-interval 150 bfd-monitoring enabled on
d-rx-interval 150 bfd-tx-interval 150 bfd-monitoring enabled on
**
default "zss7config"
** GET RID OF THE OLD CONFIGS, DO check them once again

** sccp timers can be used
** RNC default values for SCCP timers, SCTP profile: RNCDEF
# time ./mcrnc-454_a1_ss7_6box.scli
start transaction
add signaling sccp sccp-timer-profile from-template RNCDEF name MSSDEF t-iar 660 t-ias 90 netwo
add signaling sccp sccp-timer-profile from-template RNCDEF name SGSNDEF t-iar 270 t-ias 90 netw
add signaling sccp sccp-timer-profile from-template RNCDEF name RNCIURDEF t-iar 270 t-ias 90 ne
add signaling service-access-point id 1 name sap_iucs network-appearance 1 network-indicator NA
add signaling service-access-point id 2 name sap_iups network-appearance 2 network-indicator NA
add signaling service-access-point id 3 name sap_iur network-appearance 9 network-indicator NA0
add signaling ss7 local-as id 1 name las_iucs routing-context 2 routing-key-dpc 1108 service-ac
add signaling ss7 local-as id 2 name las_iups routing-context 3 routing-key-dpc 1108 service-ac
add signaling ss7 remote-as id 1 name ras_iucs communication-type ipsp pending-timer 3 routing-
add signaling ss7 remote-as id 2 name ras_iups communication-type ipsp pending-timer 3 routing-
add signaling ss7 association id 10 local-as-name las_iucs communication-type ipsp local-ip-add
add signaling ss7 association id 11 local-as-name las_iucs communication-type ipsp local-ip-add
add signaling ss7 association id 30 local-as-name las_iups communication-type ipsp local-ip-add
add signaling ss7 association id 31 local-as-name las_iups communication-type ipsp local-ip-add
add signaling sccp own-point-code id 1 local-as-name las_iucs
add signaling sccp own-point-code id 2 local-as-name las_iups
add signaling sccp destination-point-code id 6 remote-as-name ras_iucs
add signaling sccp destination-point-code id 7 remote-as-name ras_iups
add signaling sccp subsystem id 1 name ssnopciucs point-code-name las_iucs ssn 142
add signaling sccp subsystem id 2 name ssnopciups point-code-name las_iups ssn 142
add signaling sccp subsystem id 6 name ssndpciucs point-code-name ras_iucs ssn 142
add signaling sccp subsystem id 7 name ssndpciups point-code-name ras_iups ssn 142
add signaling sccp concerned-subsystem name css_iucs subsystem-name ssnopciucs affected-subsyst
add signaling sccp concerned-subsystem name css_iups subsystem-name ssnopciups affected-subsyst
add signaling sccp concerned-point-code name cpc_iucs point-code-name ras_iucs affected-subsyst
add signaling sccp concerned-point-code name cpc_iups point-code-name ras_iups affected-subsyst
set signaling ss7 association admin-state enabled id 10
commit transaction
howto check IU connectivity
# fsclish -c "show signaling ss7 association all" | egrep "local-as-name|status"
local-as-name : las_iucs
status : asp_state_active
local-as-name : las_iucs
Hardware 23
local-as-name : las_iups
# fsclish -c "show signaling sccp subsystem all" | egrep "Status|REM|LOC"
LOCAL SUBSYSTEMS
Status : CONFIGURED , REGISTERED , ALLOWED
LOCAL SUBSYSTEMS
Status : CONFIGURED , REGISTERED , ALLOWED
REMOTE SUBSYSTEMS
Status : CONFIGURED , ALLOWED
REMOTE SUBSYSTEMS
Status : CONFIGURED , ALLOWED
howto check sctp associations
** "*"-mark together with IP address marks the active endpoint
# zassoc
RNC-451 SCTP association information Mon Feb 13 14:40:13 EET 2012
*** EIPU-0
*10.16.224.6 10.16.224.22 (49225) *10.20.153.48 10.20.153.188 (2905)
*10.16.225.193 (49152) *10.16.225.229 (49152)
*10.16.225.193 (49153) *10.16.225.229 (49153)
*** EIPU-1
*10.16.224.7 10.16.224.23 (49225) *10.20.153.47 10.20.153.187 (2905)
*10.16.225.197 (49152) *10.16.225.230 (49152)
*10.16.225.197 (49153) *10.16.225.230 (49153)
*** EIPU-2
*10.16.224.40 10.16.224.56(49225) *10.16.8.85 (2905)
*** EIPU-3
# zassoc
*** EIPU-0
*10.16.230.2 10.16.230.18 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-1
*10.16.230.3 10.16.230.19 (49225) *10.20.153.47 10.20.153.187 (2905)
*** EIPU-2
*10.16.230.4 10.16.230.20 (49225) *10.20.153.47 10.20.153.187 (2905)
*** EIPU-3
*10.16.230.37 10.16.230.53 (49225) *10.16.8.84 10.16.228.84 (2905)
*10.16.230.5 10.16.230.21 (49225) *10.20.153.47 10.20.153.187 (2905)
*** EIPU-4
*10.16.230.6 10.16.230.22 (49225) *10.20.153.47 10.20.153.187 (2905)
*** EIPU-5
*10.16.230.7 10.16.230.23 (49225) *10.20.153.47 10.20.153.187 (2905)
*** EIPU-6
*10.16.230.8 10.16.230.24 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-7
*10.16.230.9 10.16.230.25 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-8
*10.16.230.10 10.16.230.26 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-9
*10.16.230.11 10.16.230.27 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-10
*10.16.230.12 10.16.230.28 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-11
Hardware 24
*10.16.230.13 10.16.230.29 (49225) *10.20.153.48 10.20.153.188 (2905)
** SCCP connection information

root@CFPU-0 [RNC-451] > show sccp-connections info
sccp connection number:
----------------------------------------------------------
UNIT_NAME ALL IU IUR IUPC MAX
========== ====== ====== ====== ====== =======
QNIU-0 1 1 0 0 142463
QNIU-3 0 0 0 0 142463
QNIU-4 0 0 0 0 142463
QNIU-7 0 0 0 0 142463
TOTAL 1 1 0 0 569852
----------------------------------------------------------
USCP-0 1 n/a n/a n/a n/a
TOTAL 1 n/a n/a n/a n/a
----------------------------------------------------------
** to determinen RANAP state

** (WO-EX + ENABLED) = OK
# /opt/nokiasiemens/SS_QNTools/script/start_rnwdbview.sh -TextOn -iucs -iups
IUCSId|CNDomainVersion|SignPointCode|IuState|IuLinkStatus|IUCSIPId|IPBasedRouteIdCS|IPQMIdCS|De
1|4 (Rel6)|913|0 (WO-EX)|1 (Enabled)|1|1|1|10.16.8.128|255.255.255.224
IUPSId|CNDomainVersion|SignPointCode|IuState|IuLinkStatus|IUPSIPId|IPBasedRouteIdPS|IPQMIdPS|De
1|4 (Rel6)|2008|0 (WO-EX)|1 (Enabled)|1|2|1|10.16.8.160|255.255.255.224
** sctp statistics
# ssh eipu-0 cat /proc/net/sctp/snmp
SctpCurrEstab 3
SctpActiveEstabs 3
SctpPassiveEstabs 0
SctpAborteds 0
SctpShutdowns 0
SctpOutOfBlues 0
SctpChecksumErrors 0
SctpOutCtrlChunks 241441
SctpOutOrderChunks 1892
SctpOutUnorderChunks 53
SctpInCtrlChunks 151723
SctpInOrderChunks 91689
SctpInUnorderChunks 0
SctpFragUsrMsgs 0
SctpReasmUsrMsgs 0
SctpOutSCTPPacks 243384
SctpInSCTPPacks 243357
SctpT1InitExpireds 0
SctpT1CookieExpireds 0
SctpT2ShutdownExpireds 0
SctpT3RtxExpireds 0
SctpT4RtoExpireds 0
SctpT5ShutdownGuardExpireds 0
SctpDelaySackExpireds 89763
SctpAutocloseExpireds 0
Hardware 25
SctpT3Retransmits 0
SctpPmtudRetransmits 0
SctpFastRetransmits 0
SctpInPktSoftirq 243357
SctpInPktBacklog 0
SctpInPktDiscards 0
SctpInDataChunkDiscards 0
howto check IUB connectivity
** wbts-83, using ipnb-83
# zdbindex
...
wbts_id | ipnb_id
---------+---------
83 | 83
lcr_id | cid | wbts_id | wcel_state | cs_cn_index | ps_cn_index | cs_iu_item_id | ps_iu_item_

--------+------+---------+------------+-------------+-------------+---------------+------------
8301 | 8301 | 83 | 0 | 1 | 2 | 1 |
** sctp info under /proc (ports start normally from 49152)

** here EIPU-1 is having the channels of wbts-83
# zassoc
*** EIPU-0
*10.16.13.6 10.16.14.38 (49225) *10.20.153.48 10.20.153.188 (2905)
*** EIPU-1
*10.16.14.248 (49152) *10.16.5.23 (49152)
*10.16.14.248 (49153) *10.16.5.23 (49153)
*** EIPU-2
*10.16.13.40 (49225) *10.16.8.85 (2905)
*** EIPU-3
** looking for CSPU termination and the cell services

**
fsclish -c "show troubleshooting call call-list unit *"
... clip ...
CSCP-0002(physical_addr:0x4; owner_id:0x3c)
CALL_INFO: call_id:444f 4b4 2 0, cell_id:0x206d

res_type | service_type | serv_id | conn_id | local_ip_addr | remote_i
CELL_SERV 0 ,3 ,0 0X2000006 NO NO NO
TERM-00 0 ,0 ,0 0X2000007 0X10103692 10.16.14.246:10021:10 10.16.5.
TERM-01 0 ,1 ,0 0X2000008 0X1010368B 10.16.14.246:10022:10 10.16.5.
TERM-02 0 ,1 ,0 0X2000009 0X1010368C 10.16.14.246:10023:10 10.16.5.
TERM-03 0 ,2 ,0 0X200000A 0X1010369D 10.16.14.246:10024:10 10.16.5.
LGU exited at 2012-2-13 23:16:16:620

# fsclish -c "show troubleshooting upm config" | grep "0,0,0"
[ 0,0,0 ] CSUP [ CCH,RACH,NONE ] [ 0, 0, -, -, -, -, -, -, -, -, -, -,
[ 0,3,0 ] CSUP [ CCH,CELL,NONE ] [ 84, 0, -, -, -, -, -, -, -, -, -, -
Hardware 26
[ 0,1,0 ] CSUP [ CCH,FACH,NONE ] [ 0, 0, -, -, -, -, -, -, -, -, -, -,
[ 0,2,0 ] CSUP [ CCH,PCH,NONE ] [ 0, 0, -, -, -, -, -, -, -, -, -, -,
** IL MFS part: SIGIUBGX
# ilsigiubcli --unit /CFPU-0/QNOMUServer-0 -F -d all
FILE NAME: SIGIUBGX
=====================================================================
group_id.............83
remote_ip/port.......10.16.5.23/49152
local_ip.............10.16.14.248
iubsnt_id............1
QNIUB_index..........QNIUB-3
CSCP_index...........CSCP-2
vrf..................10
dscp.................34
link_status..........connected
down_counter:
connect_err......0
notify_timeout...2
enotconn.........0
shutdown.........0
comm_lost........1
cscp_down........0
release..........0
last_down_reason.....notify_timeout
est_req_counter......4
last_down_time: 2012/01/26 07:59:39
last_up_time: 2012/01/26 07:59:44
=====================================================================
group_id.............83
remote_ip/port.......10.16.5.23/49153
local_ip.............10.16.14.248
iubsnt_id............1
QNIUB_index..........QNIUB-3
CSCP_index...........CSCP-2
vrf..................10
dscp.................34
link_status..........connected
down_counter:
connect_err......0
notify_timeout...2
enotconn.........0
shutdown.........0
comm_lost........1
cscp_down........0
release..........0
last_down_reason.....notify_timeout
est_req_counter......4
last_down_time: 2012/01/26 07:59:39
last_up_time: 2012/01/26 07:59:44
=====================================================================
** same, but for real men (lets search for "0a 10")
# hexdump -C /var/opt/nokiasiemens/SS_ILOMU/SS_ILMFS/_active/SIGIUBGX
Hardware 27
00000000 00 11 ea 78 10 00 10 00 ff ff ff ff 00 00 00 00 |...x............|
00000010 00 00 00 b4 53 49 47 49 55 42 47 58 00 00 00 00 |....SIGIUBGX....|
00000020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
*
000000b0 00 00 00 00 02 00 00 d8 0c 36 00 00 00 00 01 c0 |.........6......|
000000c0 00 00 00 00 00 00 00 00 00 00 00 58 00 00 00 00 |...........X....|
000000d0 00 00 34 1c 00 00 00 00 01 03 40 02 04 ef 00 1e |..4.......@.....|
000000e0 00 00 44 4c 03 c6 00 01 00 00 4c 10 09 a8 00 00 |..DL......L.....|
000000f0 00 00 44 4f 04 fe 00 00 00 00 00 00 00 00 00 53 |..DO...........S|
00000100 00 0a c0 00 00 0a 10 05 17 00 00 00 00 00 00 00 |................|
00000110 00 00 00 00 00 00 0a 10 0e f8 00 00 00 01 20 1c |.............. .|
00000120 7f a0 2f 51 4e 49 22 00 00 01 00 03 06 00 00 00 |../QNI".........|
00000130 01 03 40 02 04 ef 00 1e 00 00 44 4c 03 c6 00 02 |..@.......DL....|
00000140 00 00 4c 10 09 a8 00 00 00 00 44 4f 04 fe 00 00 |..L.......DO....|
00000150 00 00 00 00 00 00 00 53 00 0a c0 01 00 0a 10 05 |.......S........|
00000160 17 00 00 00 00 00 00 00 00 00 00 00 00 00 0a 10 |................|
00000170 0e f8 00 00 00 01 20 1c 7f a0 2f 51 4e 49 22 00 |...... .../QNI".|
00000180 00 01 00 02 06 00 00 00 00 00 00 00 00 00 00 00 |................|
00000190 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................|
*
0011ea70 00 00 00 00 00 00 00 00 |........|
0011ea78
howto see cell states
** zdbindex
# zdbindex
Wed Feb 15 14:41:30 EET 2012
rnc_id
--------
451
(1 row)
wbts_id | ipnb_id
---------+---------
86 | 86
87 | 87
(2 rows)
lcr_id | cid | wbts_id | wcel_state | cs_cn_index | ps_cn_index | cs_iu_item_id | ps_iu_item_

--------+------+---------+------------+-------------+-------------+---------------+------------
8701 | 8701 | 87 | 0 | 1 | 2 | 1 |
8601 | 8601 | 86 | 0 | 1 | 2 | 1 |
(2 rows)
ipnb_id
---------
86
87
(2 rows)
iu_item_id
------------
1
1
(2 rows)
iur_id
--------
Hardware 28
(0 rows)
** ruoste
# /opt/nokiasiemens/pac_ruoste_e1/script/mcruoste.sh -rncwcel
WBTS WCEL (LCRId) CellId State

--------------------------------------------------
WBTS-86 WCEL-8601 CId:8601 0 (Working)
WBTS-87 WCEL-8701 CId:8701 0 (Working)
2 WCELs found.
** rnwdbview
# /opt/nokiasiemens/SS_QNTools/script/start_rnwdbview.sh -TextOn -wcel
WBTSId|LcrId|CId|AdminCellState|WCelState|OngoingCalls|PriScrCode|UARFCN|CellRange|LAC|HSDPAena
86|8601|8601|1 (Unlocked)|0 (Working)|NA|86|10700|100|45110|1 (Enabled)|0 (HSDPA capable)|0 (En
87|8701|8701|1 (Unlocked)|0 (Working)|NA|87|10700|100|45110|1 (Enabled)|0 (HSDPA capable)|0 (En
howto check RNW DB content
** plan upload is needed.

** use zplan to trigger
**
upload?, to continue
/opt/nokiasiemens/bin/zplan: info upload started
Sent message header: 0012 7002 0777 0000 00 00 0000 6034 0000
Waiting response from rayman

Got following response: Operation succeeded
Feb 12 20:56:00.416818 notice CFPU-0 rayman: RU:OMU-0|PNAME:QNRAYMAN|LPID:12006|PID:0x523 0x1 0
Got following response: Operation succeeded
Feb 12 20:56:00.426139 notice CFPU-1 rayman: RU:OMU-1|PNAME:QNRAYMAN|LPID:28707|PID:0x523 0x1 0
Sending upload end (rnw_plan_upload_end_s) message:
Sent message header: 0170 7002 0523 0001 00 00 0000 D7F5 0000
** unzip
# gunzip RNWPLANU.XML.gz
** few new lines needed - zrnwuparser

# /opt/nokiasiemens/SS_QNTools/script/zrnwuparser.py RNWPLANU.XML | grep managedObject
&ltmanagedObjectt distName="RNC-454" operation="update" version="mcRN2.0" class="RNC"&gt
&lt/managedObject&gt
&ltmanagedObjectt distName="RNC-454/RNAC-1" operation="update" version="mcRN2.0" class="RNAC"
&ltmanagedObjectt distName="RNC-454/RNPS-1" operation="update" version="mcRN2.0" class="RNPS"
&ltmanagedObjectt distName="RNC-454/RNHSPA-1" operation="update" version="mcRN2.0" class="RNH
...
See also: ruoste
Hardware 29
howto check ntp state
** 1 CFPU is connected to external NTP, rest of the nodes

** are synchronized to the master CFPU
**
# ntpstat
synchronised to NTP server (10.16.224.249) at stratum 3
time correct to within 32 ms
polling server every 64 s
# ssh cfpu-1 ntpstat
synchronised to NTP server (169.254.241.67) at stratum 4
time correct to within 37 ms
polling server every 16 s
** misc other commands

# ntptrace
localhost.localdomain: stratum 3, offset -0.000342, synch distance 0.028220
10.16.224.249: stratum 2, offset 0.000000, synch distance 0.022090
# ntptime
ntp_gettime() returns code 0 (OK)
time d2e471bd.5e221000 Tue, Feb 14 2012 7:38:05.367, (.367707),
maximum error 61091 us, estimated error 315 us
ntp_adjtime() returns code 0 (OK)
modes 0x0 (),
offset -325.000 us, frequency 128.302 ppm, interval 1 s,
maximum error 61091 us, estimated error 315 us,
status 0x1 (PLL),
time constant 6, precision 1.000 us, tolerance 512 ppm,
# ntpq
ntpq> peers
remote refid st t when poll reach delay offset jitter
==============================================================================
*10.16.224.249 CHU_AUDIO(1) 2 u 45 64 377 0.297 -0.342 0.034
LOCAL(0) .LOCL. 0 u 12 16 377 0.000 0.000 0.004
reference interface caps
IU interface
** MSC addresses: 10.20.153.48, 10.20.153.188 (assoc 1)

: 10.20.153.47, 10.20.153.187 (assoc 2)
** RNC addresses: 10.16.224.6 10.16.224.22 (assoc 1)
: 10.16.224.7 10.16.224.23 (assoc 2)
[root@localhost faq]# tshark -r Core_CSCN.cap

1 0.000000 10.16.224.6 -> 10.20.153.48 SCTP INIT
2 0.000585 10.20.153.48 -> 10.16.224.6 SCTP INIT_ACK
3 0.000723 10.16.224.6 -> 10.20.153.48 SCTP COOKIE_ECHO
4 0.001430 10.20.153.48 -> 10.16.224.6 SCTP COOKIE_ACK
5 0.002097 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) HEARTBEAT ASPUP
6 0.002142 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
7 0.002231 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT_ACK SACK
8 0.002282 10.16.224.22 -> 10.20.153.188 SCTP HEARTBEAT_ACK
Hardware 30
9 0.355871 10.16.224.6 -> 10.20.153.48 M3UA (RFC 3332) ASPUP_ACK
10 0.356102 10.20.153.48 -> 10.16.224.6 SCTP SACK
11 0.356221 10.16.224.6 -> 10.20.153.48 M3UA (RFC 3332) NTFY
12 0.356332 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) NTFY
13 0.356445 10.16.224.6 -> 10.20.153.48 SCTP SACK
14 0.356458 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) SACK ASPAC
15 0.356589 10.16.224.6 -> 10.20.153.48 SCTP SACK
16 0.356866 10.16.224.6 -> 10.20.153.48 M3UA (RFC 3332) ASPAC_ACK
17 0.472458 10.20.153.48 -> 10.16.224.6 SCTP SACK
18 0.472591 10.16.224.6 -> 10.20.153.48 M3UA (RFC 3332) NTFY ASPAC
19 0.473093 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) SACK ASPAC_ACK
20 0.473219 10.16.224.6 -> 10.20.153.48 SCTP SACK
21 0.473433 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) NTFY
22 0.473545 10.16.224.6 -> 10.20.153.48 SCTP SACK
23 1.152471 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
25 1.287042 913 -> 1105 MTP3MG (Int. ITU) TFP
26 1.287175 10.16.224.6 -> 10.20.153.48 SCTP SACK
27 1.287675 913 -> 1105 MTP3MG (Int. ITU) TFP TFP TFP TFP TFP TFP TFP TFP T
28 1.287826 10.16.224.6 -> 10.20.153.48 SCTP SACK
30 1.288743 10.16.224.6 -> 10.20.153.48 SCTP SACK
32 1.289492 10.16.224.6 -> 10.20.153.48 SCTP SACK
33 1.289955 913 -> 1105 MTP3MG (Int. ITU) TFP TFP TFP TFP TFP TFP TFP TRA
34 1.290085 10.16.224.6 -> 10.20.153.48 SCTP SACK
35 1.299739 10.16.224.6 -> 10.20.153.48 SCTP SACK
36 1.591664 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
38 2.462466 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
40 2.717737 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
42 2.995499 10.16.224.7 -> 10.20.153.47 SCTP INIT
43 2.996135 10.20.153.47 -> 10.16.224.7 SCTP INIT_ACK
44 2.996280 10.16.224.7 -> 10.20.153.47 SCTP COOKIE_ECHO
45 2.996961 10.20.153.47 -> 10.16.224.7 SCTP COOKIE_ACK
46 2.997672 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) HEARTBEAT ASPUP
47 2.997716 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
48 2.997795 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT_ACK SACK
50 3.782473 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
52 3.814159 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
54 3.930517 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) ASPUP_ACK
55 3.930740 10.20.153.47 -> 10.16.224.7 SCTP SACK
56 3.930863 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) NTFY
57 3.930963 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) NTFY
58 3.931077 10.16.224.7 -> 10.20.153.47 SCTP SACK
59 3.931103 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) SACK ASPAC
60 3.931224 10.16.224.7 -> 10.20.153.47 SCTP SACK
61 3.931391 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) ASPAC_ACK
62 4.043452 10.20.153.47 -> 10.16.224.7 SCTP SACK
63 4.043594 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) NTFY ASPAC
64 4.044128 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) SACK ASPAC_ACK
65 4.044264 10.16.224.7 -> 10.20.153.47 SCTP SACK
66 4.044482 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) NTFY
67 4.044597 10.16.224.7 -> 10.20.153.47 SCTP SACK
68 4.093466 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
Hardware 31
70 4.892051 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
72 5.172471 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
74 5.255149 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
76 5.343463 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
78 5.364368 1105 -> 913 SCCPMG (Int. ITU) SST
80 5.373063 913 -> 1105 SCCPMG (Int. ITU) SACK SSA
81 5.373204 1105 -> 913 SCCPMG (Int. ITU) SACK SST
83 5.374012 1105 -> 913 SCCPMG (Int. ITU) SACK SST
85 5.383143 10.16.224.6 -> 10.20.153.48 SCTP SACK
86 5.383366 913 -> 1105 SCCPMG (Int. ITU) SSA
87 5.383466 10.16.224.6 -> 10.20.153.48 SCTP SACK
88 5.483499 10.20.153.47 -> 10.16.224.7 SCTP SACK
89 6.442639 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
91 6.526469 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
93 6.552473 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
95 6.683505 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
97 7.535423 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
99 7.752952 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
101 7.772471 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
103 8.033459 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
105 8.086168 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) BEAT
106 8.086289 10.16.224.7 -> 10.20.153.47 SCTP SACK
107 8.086428 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) BEAT_ACK
108 8.203518 10.20.153.47 -> 10.16.224.7 SCTP SACK
109 8.926434 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
111 8.992463 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
113 9.219619 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
115 9.363467 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
117 10.126578 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
119 10.182465 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
121 10.382382 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
123 10.683465 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
125 11.344803 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
127 11.562459 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
129 11.643001 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
Hardware 32
131 12.003466 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
134 12.487326 10.16.224.6 -> 10.20.153.48 SCTP SACK
135 12.497828 1105 -> 913 SCCPMG (Int. ITU) SSA
136 12.612447 10.20.153.48 -> 10.16.224.6 SCTP SACK
137 12.822469 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
139 12.834306 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
141 13.243472 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
143 13.593066 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
145 14.010803 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
147 14.122462 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
149 14.146309 10.20.153.48 -> 10.16.224.6 M3UA (RFC 3332) BEAT
150 14.146423 10.16.224.6 -> 10.20.153.48 SCTP SACK
151 14.146587 10.16.224.6 -> 10.20.153.48 M3UA (RFC 3332) BEAT_ACK
152 14.262714 10.20.153.48 -> 10.16.224.6 SCTP SACK
153 14.603479 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
155 15.188750 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
157 15.355193 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
159 15.422463 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
161 16.003465 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
163 16.403071 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
165 16.553402 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
167 16.772463 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
169 17.233482 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
171 17.526835 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
173 17.815494 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
175 17.962466 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
177 18.463499 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
179 18.667790 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
181 19.040156 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
183 19.202466 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
185 19.713471 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
187 19.744791 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
189 20.171755 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
191 20.452466 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
Hardware 33
193 20.955591 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
195 21.053463 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
197 21.366555 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
199 21.702475 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
201 22.089063 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
203 22.463473 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
205 22.556346 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
207 23.032465 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
209 23.283491 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
211 23.756171 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
213 23.783475 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
215 24.302458 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
217 24.355974 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
219 24.852311 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
221 25.103479 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
223 25.411415 1105 -> 913 RANAP id-Reset , Reset
224 25.444555 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
226 25.522448 10.20.153.48 -> 10.16.224.6 SCTP SACK
227 25.702508 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
229 26.313464 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
231 26.566584 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
233 26.640214 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
235 26.892459 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
237 27.533469 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
239 27.744827 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
241 27.808648 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
243 28.082519 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
245 28.286189 10.20.153.47 -> 10.16.224.7 M3UA (RFC 3332) BEAT
246 28.286322 10.16.224.7 -> 10.20.153.47 SCTP SACK
247 28.286465 10.16.224.7 -> 10.20.153.47 M3UA (RFC 3332) BEAT_ACK
248 28.403449 10.20.153.47 -> 10.16.224.7 SCTP SACK
249 28.933472 10.20.153.187 -> 10.16.224.23 SCTP HEARTBEAT
251 28.947433 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
Hardware 34
253 29.292461 10.20.153.48 -> 10.16.224.6 SCTP HEARTBEAT
255 29.445894 10.16.224.7 -> 10.20.153.47 SCTP HEARTBEAT
257 30.124935 10.16.224.6 -> 10.20.153.48 SCTP HEARTBEAT
259 30.303462 10.20.153.47 -> 10.16.224.7 SCTP HEARTBEAT
261 30.419602 913 -> 1105 RANAP id-Reset , ResetAcknowledge
262 30.419744 10.16.224.6 -> 10.20.153.48 SCTP SACK
263 30.492466 10.20.153.188 -> 10.16.224.22 SCTP HEARTBEAT
IUB interface
** RNC addresses: 10.16.225.197 (SCTP control plane)

** : 10.16.225.199 (user plane)
** WBTS address: 10.16.225.230
**
[root@localhost faq]# tshark -r NodeB.cap
1 0.000000 10.16.225.197 -> 10.16.225.230 SCTP INIT
2 1.054767 10.16.225.197 -> 10.16.225.230 SCTP INIT
3 20.011862 10.16.225.197 -> 10.16.225.230 SCTP INIT
4 21.009908 10.16.225.197 -> 10.16.225.230 SCTP INIT
5 21.011456 10.16.225.230 -> 10.16.225.197 SCTP INIT_ACK
6 21.011626 10.16.225.197 -> 10.16.225.230 SCTP COOKIE_ECHO
7 21.014018 10.16.225.230 -> 10.16.225.197 SCTP COOKIE_ACK
8 21.014876 10.16.225.197 -> 10.16.225.230 NBAP id-dedicatedMeasurementTermination , Dedicat
9 21.016215 10.16.225.230 -> 10.16.225.197 SCTP SACK
10 21.077275 10.16.225.197 -> 10.16.225.230 SCTP INIT
11 21.079113 10.16.225.230 -> 10.16.225.197 SCTP INIT_ACK
12 21.079251 10.16.225.197 -> 10.16.225.230 SCTP COOKIE_ECHO
13 21.082069 10.16.225.230 -> 10.16.225.197 SCTP COOKIE_ACK
14 23.014190 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
16 23.024406 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
18 23.082195 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
20 23.168429 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
22 24.211127 10.16.225.197 -> 10.16.225.230 NBAP id-dedicatedMeasurementInitiation , Dedicate
23 24.412160 10.16.225.230 -> 10.16.225.197 SCTP SACK
24 24.636597 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
26 25.014419 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
28 25.082411 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
30 26.137147 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
32 26.409636 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
34 26.764735 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
36 26.832585 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
38 27.729328 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
40 27.852965 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
Hardware 35
43 28.224678 10.16.225.230 -> 10.16.225.197 SCTP SACK
44 28.514761 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
46 28.582942 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
48 29.602868 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
50 29.982919 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
53 30.264948 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
55 30.332950 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
57 30.433764 10.16.225.230 -> 10.16.225.197 SCTP SACK
58 31.430208 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
60 32.015113 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
62 32.083127 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
64 32.234515 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
66 33.490423 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
68 33.765299 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
70 33.833313 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
72 34.115385 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
75 34.244049 10.16.225.230 -> 10.16.225.197 SCTP SACK
76 35.335991 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
78 35.515511 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
80 35.583494 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
82 36.046949 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
85 36.450483 10.16.225.230 -> 10.16.225.197 SCTP SACK
86 37.063718 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
88 37.266038 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
90 37.333867 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
92 37.939164 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
94 39.006224 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
96 39.017015 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
98 39.083837 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
100 39.398252 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
Hardware 36
103 40.262111 10.16.225.230 -> 10.16.225.197 SCTP SACK
104 40.460091 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
106 40.767015 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
108 40.834027 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
110 41.950928 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
112 42.250954 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
115 42.325368 10.16.225.230 -> 10.16.225.197 NBAP id-reset , ResetRequest
116 42.325498 10.16.225.197 -> 10.16.225.230 SCTP SACK
117 42.328878 10.16.225.230 -> 10.16.225.197 NBAP SACK id-dedicatedMeasurementInitiation , Ded
118 42.329013 10.16.225.197 -> 10.16.225.230 SCTP SACK
119 42.365471 10.16.225.197 -> 10.16.225.230 NBAP id-reset , ResetResponse
120 42.368313 10.16.225.230 -> 10.16.225.197 SCTP SACK
121 42.370818 10.16.225.230 -> 10.16.225.197 NBAP id-auditRequired , AuditRequiredIndication
122 42.371270 10.16.225.197 -> 10.16.225.230 NBAP id-privateMessageForCommon , PrivateMessage
123 42.566993 10.16.225.197 -> 10.16.225.230 NBAP SACK id-audit , AuditRequest
124 42.574935 10.16.225.230 -> 10.16.225.197 SCTP SACK
126 42.582182 10.16.225.230 -> 10.16.225.197 NBAP id-audit , AuditResponse
127 42.582307 10.16.225.197 -> 10.16.225.230 SCTP SACK
129 42.665473 10.16.225.230 -> 10.16.225.197 NBAP SACK id-privateMessageForCommon , PrivateMes
130 42.672764 10.16.225.197 -> 10.16.225.230 NBAP id-cellSetup , CellSetupRequestFDD
131 42.676005 10.16.225.230 -> 10.16.225.197 SCTP SACK
132 42.866652 10.16.225.197 -> 10.16.225.230 SCTP SACK
133 43.992499 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
135 44.112979 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
137 44.267411 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
139 45.882186 10.16.225.230 -> 10.16.225.197 NBAP id-cellSetup , CellSetupResponse
140 45.895355 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
142 46.004715 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
144 46.017598 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
146 46.080735 10.16.225.197 -> 10.16.225.230 SCTP SACK
147 46.942978 10.16.225.197 -> 10.16.225.230 NBAP id-commonTransportChannelSetup , CommonTrans
148 47.013931 10.16.225.230 -> 10.16.225.197 NBAP SACK id-commonTransportChannelSetup , Common
150 47.028131 10.16.225.230 -> 10.16.225.197 SCTP SACK
152 47.064164 10.16.225.197 -> 10.16.225.230 SCTP SACK
153 47.070000 10.16.225.199 -> 10.16.225.230 FP FACH_FDD [Control] DL SYNCHRONISATION CFN=0
155 47.070864 10.16.225.199 -> 10.16.225.230 FP PCH [Control] DL SYNCHRONISATION CFN=0
157 47.370195 10.16.225.230 -> 10.16.225.199 FP FACH_FDD [Control] UL SYNCHRONISATION CFN=30
161 47.371089 10.16.225.230 -> 10.16.225.199 FP PCH [Control] UL SYNCHRONISATION CFN=30, ToA
163 47.372106 10.16.225.230 -> 10.16.225.199 FP PCH [Control] UL SYNCHRONISATION CFN=2971, T
Hardware 37
168 47.491175 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
170 47.515020 10.16.225.199 -> 10.16.225.230 FP RACH_FDD [Control] DL SYNCHRONISATION CFN=0
171 47.515546 10.16.225.230 -> 10.16.225.199 FP RACH_FDD [Control] UL SYNCHRONISATION CFN=0,
172 47.768740 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
187 48.389689 10.16.225.230 -> 10.16.225.199 FP FACH_FDD [Control] UL SYNCHRONISATION CFN=0,
188 48.411663 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
193 48.755735 10.16.225.230 -> 10.16.225.197 SCTP SACK
201 48.952890 10.16.225.197 -> 10.16.225.230 NBAP id-physicalSharedChannelReconfiguration , Ph
202 48.958614 10.16.225.230 -> 10.16.225.197 SCTP SACK
204 48.990038 10.16.225.197 -> 10.16.225.230 SCTP SACK
209 49.137076 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
211 49.201074 10.16.225.197 -> 10.16.225.230 SCTP SACK
212 49.216692 10.16.225.230 -> 10.16.225.197 SCTP SACK
215 49.337291 10.16.225.230 -> 10.16.225.197 SCTP SACK
217 49.363563 10.16.225.197 -> 10.16.225.230 SCTP SACK
Hardware 38
225 49.407277 10.16.225.230 -> 10.16.225.197 NBAP SACK id-physicalSharedChannelReconfiguration
227 49.434981 10.16.225.230 -> 10.16.225.197 SCTP SACK
230 49.518962 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
232 49.605606 10.16.225.197 -> 10.16.225.230 SCTP SACK
240 49.913605 10.16.225.197 -> 10.16.225.230 NBAP id-systemInformationUpdate , SystemInformati
241 49.969787 10.16.225.230 -> 10.16.225.197 NBAP SACK id-systemInformationUpdate , SystemInfo
242 49.969940 10.16.225.197 -> 10.16.225.230 SCTP SACK
243 49.990273 10.16.225.199 -> 10.16.225.230 RRC systemInformationChangeIndication
246 50.050311 10.16.225.199 -> 10.16.225.230 RRC systemInformationChangeIndication
247 50.052195 10.16.225.199 -> 10.16.225.230 FP PCH [Data] CFN=3239 (0 bits in 0 tbs)
248 50.062198 10.16.225.199 -> 10.16.225.230 RRC pagingType1
249 50.072184 10.16.225.199 -> 10.16.225.230 RRC pagingType1
250 50.082183 10.16.225.199 -> 10.16.225.230 RRC pagingType1
251 50.092174 10.16.225.199 -> 10.16.225.230 RRC pagingType1
252 50.102168 10.16.225.199 -> 10.16.225.230 RRC pagingType1
253 50.112169 10.16.225.199 -> 10.16.225.230 RRC pagingType1
254 50.122164 10.16.225.199 -> 10.16.225.230 RRC pagingType1
255 50.132322 10.16.225.199 -> 10.16.225.230 RRC pagingType1
256 50.142235 10.16.225.199 -> 10.16.225.230 RRC pagingType1
257 50.152226 10.16.225.199 -> 10.16.225.230 RRC pagingType1
258 50.162224 10.16.225.199 -> 10.16.225.230 RRC pagingType1
259 50.172218 10.16.225.199 -> 10.16.225.230 RRC pagingType1
260 50.182212 10.16.225.199 -> 10.16.225.230 RRC pagingType1
261 50.192208 10.16.225.199 -> 10.16.225.230 RRC pagingType1
262 50.202214 10.16.225.199 -> 10.16.225.230 RRC pagingType1
263 50.212204 10.16.225.199 -> 10.16.225.230 RRC pagingType1
264 50.222195 10.16.225.199 -> 10.16.225.230 RRC pagingType1
266 50.232192 10.16.225.199 -> 10.16.225.230 RRC pagingType1
267 50.242186 10.16.225.199 -> 10.16.225.230 RRC pagingType1
268 50.252184 10.16.225.199 -> 10.16.225.230 RRC pagingType1
269 50.262340 10.16.225.199 -> 10.16.225.230 RRC pagingType1
270 50.272256 10.16.225.199 -> 10.16.225.230 RRC pagingType1
271 50.282254 10.16.225.199 -> 10.16.225.230 RRC pagingType1
272 50.292246 10.16.225.199 -> 10.16.225.230 RRC pagingType1
273 50.302240 10.16.225.199 -> 10.16.225.230 RRC pagingType1
274 50.312234 10.16.225.199 -> 10.16.225.230 RRC pagingType1
275 50.322232 10.16.225.199 -> 10.16.225.230 RRC pagingType1
276 50.332227 10.16.225.199 -> 10.16.225.230 RRC pagingType1
277 50.342223 10.16.225.199 -> 10.16.225.230 RRC pagingType1
278 50.352219 10.16.225.199 -> 10.16.225.230 RRC pagingType1
279 50.362222 10.16.225.199 -> 10.16.225.230 RRC pagingType1
280 50.372212 10.16.225.199 -> 10.16.225.230 RRC pagingType1
283 50.382207 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 39
286 50.392203 10.16.225.199 -> 10.16.225.230 RRC pagingType1
287 50.402197 10.16.225.199 -> 10.16.225.230 RRC pagingType1
288 50.412362 10.16.225.199 -> 10.16.225.230 RRC pagingType1
289 50.422272 10.16.225.199 -> 10.16.225.230 RRC pagingType1
290 50.427507 10.16.225.197 -> 10.16.225.230 SCTP SACK
291 50.432264 10.16.225.199 -> 10.16.225.230 RRC pagingType1
292 50.442260 10.16.225.199 -> 10.16.225.230 RRC pagingType1
293 50.452262 10.16.225.199 -> 10.16.225.230 RRC pagingType1
294 50.462251 10.16.225.199 -> 10.16.225.230 RRC pagingType1
295 50.472243 10.16.225.199 -> 10.16.225.230 RRC pagingType1
296 50.482240 10.16.225.199 -> 10.16.225.230 RRC pagingType1
297 50.492236 10.16.225.199 -> 10.16.225.230 RRC pagingType1
298 50.502231 10.16.225.199 -> 10.16.225.230 RRC pagingType1
299 50.512224 10.16.225.199 -> 10.16.225.230 RRC pagingType1
302 50.522221 10.16.225.199 -> 10.16.225.230 RRC pagingType1
303 50.532231 10.16.225.199 -> 10.16.225.230 RRC pagingType1
304 50.542213 10.16.225.199 -> 10.16.225.230 RRC pagingType1
305 50.552373 10.16.225.199 -> 10.16.225.230 RRC pagingType1
306 50.562294 10.16.225.199 -> 10.16.225.230 RRC pagingType1
307 50.572283 10.16.225.199 -> 10.16.225.230 RRC pagingType1
308 50.582277 10.16.225.199 -> 10.16.225.230 RRC pagingType1
309 50.592278 10.16.225.199 -> 10.16.225.230 RRC pagingType1
310 50.602269 10.16.225.199 -> 10.16.225.230 RRC pagingType1
311 50.612261 10.16.225.199 -> 10.16.225.230 RRC pagingType1
312 50.622258 10.16.225.199 -> 10.16.225.230 RRC pagingType1
314 50.632255 10.16.225.199 -> 10.16.225.230 RRC pagingType1
315 50.642251 10.16.225.199 -> 10.16.225.230 RRC pagingType1
316 50.652245 10.16.225.199 -> 10.16.225.230 RRC pagingType1
317 50.662241 10.16.225.199 -> 10.16.225.230 RRC pagingType1
318 50.672236 10.16.225.199 -> 10.16.225.230 RRC pagingType1
319 50.682231 10.16.225.199 -> 10.16.225.230 RRC pagingType1
320 50.692395 10.16.225.199 -> 10.16.225.230 RRC pagingType1
321 50.702314 10.16.225.199 -> 10.16.225.230 RRC pagingType1
322 50.712298 10.16.225.199 -> 10.16.225.230 RRC pagingType1
323 50.717729 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
325 50.722294 10.16.225.199 -> 10.16.225.230 RRC pagingType1
326 50.732290 10.16.225.199 -> 10.16.225.230 RRC pagingType1
327 50.742283 10.16.225.199 -> 10.16.225.230 RRC pagingType1
328 50.752280 10.16.225.199 -> 10.16.225.230 RRC pagingType1
329 50.762275 10.16.225.199 -> 10.16.225.230 RRC pagingType1
330 50.772272 10.16.225.199 -> 10.16.225.230 RRC pagingType1
331 50.782266 10.16.225.199 -> 10.16.225.230 RRC pagingType1
332 50.792263 10.16.225.199 -> 10.16.225.230 RRC pagingType1
333 50.802257 10.16.225.199 -> 10.16.225.230 RRC pagingType1
334 50.812252 10.16.225.199 -> 10.16.225.230 RRC pagingType1
335 50.822247 10.16.225.199 -> 10.16.225.230 RRC pagingType1
336 50.827548 10.16.225.197 -> 10.16.225.230 SCTP SACK
337 50.832418 10.16.225.199 -> 10.16.225.230 RRC pagingType1
338 50.842324 10.16.225.199 -> 10.16.225.230 RRC pagingType1
339 50.852317 10.16.225.199 -> 10.16.225.230 RRC pagingType1
340 50.862313 10.16.225.199 -> 10.16.225.230 RRC pagingType1
341 50.872310 10.16.225.199 -> 10.16.225.230 RRC pagingType1
344 50.882305 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 40
347 50.892300 10.16.225.199 -> 10.16.225.230 RRC pagingType1
348 50.902297 10.16.225.199 -> 10.16.225.230 RRC pagingType1
349 50.912291 10.16.225.199 -> 10.16.225.230 RRC pagingType1
350 50.922286 10.16.225.199 -> 10.16.225.230 RRC pagingType1
351 50.932283 10.16.225.199 -> 10.16.225.230 RRC pagingType1
352 50.942275 10.16.225.199 -> 10.16.225.230 RRC pagingType1
353 50.952272 10.16.225.199 -> 10.16.225.230 RRC pagingType1
354 50.962266 10.16.225.199 -> 10.16.225.230 RRC pagingType1
355 50.972426 10.16.225.199 -> 10.16.225.230 RRC pagingType1
356 50.982347 10.16.225.199 -> 10.16.225.230 RRC pagingType1
357 50.992335 10.16.225.199 -> 10.16.225.230 RRC pagingType1
358 51.002328 10.16.225.199 -> 10.16.225.230 RRC pagingType1
359 51.012331 10.16.225.199 -> 10.16.225.230 RRC pagingType1
362 51.022322 10.16.225.199 -> 10.16.225.230 RRC pagingType1
364 51.032316 10.16.225.199 -> 10.16.225.230 RRC pagingType1
365 51.042313 10.16.225.199 -> 10.16.225.230 RRC pagingType1
366 51.052305 10.16.225.199 -> 10.16.225.230 RRC pagingType1
367 51.062302 10.16.225.199 -> 10.16.225.230 RRC pagingType1
368 51.072296 10.16.225.199 -> 10.16.225.230 RRC pagingType1
369 51.082291 10.16.225.199 -> 10.16.225.230 RRC pagingType1
370 51.092290 10.16.225.199 -> 10.16.225.230 RRC pagingType1
371 51.102284 10.16.225.199 -> 10.16.225.230 RRC pagingType1
372 51.112447 10.16.225.199 -> 10.16.225.230 RRC pagingType1
373 51.122356 10.16.225.199 -> 10.16.225.230 RRC pagingType1
374 51.132350 10.16.225.199 -> 10.16.225.230 RRC pagingType1
375 51.142346 10.16.225.199 -> 10.16.225.230 RRC pagingType1
376 51.152341 10.16.225.199 -> 10.16.225.230 RRC pagingType1
377 51.162337 10.16.225.199 -> 10.16.225.230 RRC pagingType1
378 51.172337 10.16.225.199 -> 10.16.225.230 RRC pagingType1
379 51.182328 10.16.225.199 -> 10.16.225.230 RRC pagingType1
380 51.192334 10.16.225.199 -> 10.16.225.230 RRC pagingType1
381 51.202319 10.16.225.199 -> 10.16.225.230 RRC pagingType1
382 51.212316 10.16.225.199 -> 10.16.225.230 RRC pagingType1
383 51.222310 10.16.225.199 -> 10.16.225.230 RRC pagingType1
384 51.225321 10.16.225.197 -> 10.16.225.230 SCTP SACK
385 51.232307 10.16.225.199 -> 10.16.225.230 RRC pagingType1
386 51.242301 10.16.225.199 -> 10.16.225.230 RRC pagingType1
387 51.252307 10.16.225.199 -> 10.16.225.230 RRC pagingType1
388 51.262454 10.16.225.199 -> 10.16.225.230 RRC pagingType1
389 51.269107 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
391 51.272368 10.16.225.199 -> 10.16.225.230 RRC pagingType1
392 51.282363 10.16.225.199 -> 10.16.225.230 RRC pagingType1
393 51.292364 10.16.225.199 -> 10.16.225.230 RRC pagingType1
394 51.302356 10.16.225.199 -> 10.16.225.230 RRC pagingType1
395 51.312350 10.16.225.199 -> 10.16.225.230 RRC pagingType1
396 51.322344 10.16.225.199 -> 10.16.225.230 RRC pagingType1
397 51.327600 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
399 51.332339 10.16.225.199 -> 10.16.225.230 RRC pagingType1
400 51.342337 10.16.225.199 -> 10.16.225.230 RRC pagingType1
401 51.352335 10.16.225.199 -> 10.16.225.230 RRC pagingType1
402 51.362327 10.16.225.199 -> 10.16.225.230 RRC pagingType1
403 51.372321 10.16.225.199 -> 10.16.225.230 RRC pagingType1
406 51.382320 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 41
409 51.392321 10.16.225.199 -> 10.16.225.230 RRC pagingType1
410 51.402472 10.16.225.199 -> 10.16.225.230 RRC pagingType1
411 51.412387 10.16.225.199 -> 10.16.225.230 RRC pagingType1
412 51.422383 10.16.225.199 -> 10.16.225.230 RRC pagingType1
414 51.432377 10.16.225.199 -> 10.16.225.230 RRC pagingType1
415 51.442375 10.16.225.199 -> 10.16.225.230 RRC pagingType1
416 51.452369 10.16.225.199 -> 10.16.225.230 RRC pagingType1
417 51.462364 10.16.225.199 -> 10.16.225.230 RRC pagingType1
418 51.472367 10.16.225.199 -> 10.16.225.230 RRC pagingType1
419 51.482353 10.16.225.199 -> 10.16.225.230 RRC pagingType1
420 51.492352 10.16.225.199 -> 10.16.225.230 RRC pagingType1
421 51.502353 10.16.225.199 -> 10.16.225.230 RRC pagingType1
422 51.512343 10.16.225.199 -> 10.16.225.230 RRC pagingType1
425 51.522336 10.16.225.199 -> 10.16.225.230 RRC pagingType1
426 51.532332 10.16.225.199 -> 10.16.225.230 RRC pagingType1
427 51.542495 10.16.225.199 -> 10.16.225.230 RRC pagingType1
428 51.552406 10.16.225.199 -> 10.16.225.230 RRC pagingType1
429 51.562400 10.16.225.199 -> 10.16.225.230 RRC pagingType1
430 51.572395 10.16.225.199 -> 10.16.225.230 RRC pagingType1
431 51.582390 10.16.225.199 -> 10.16.225.230 RRC pagingType1
432 51.592386 10.16.225.199 -> 10.16.225.230 RRC pagingType1
433 51.602383 10.16.225.199 -> 10.16.225.230 RRC pagingType1
434 51.612377 10.16.225.199 -> 10.16.225.230 RRC pagingType1
435 51.622373 10.16.225.199 -> 10.16.225.230 RRC pagingType1
436 51.627642 10.16.225.197 -> 10.16.225.230 SCTP SACK
437 51.632367 10.16.225.199 -> 10.16.225.230 RRC pagingType1
438 51.642363 10.16.225.199 -> 10.16.225.230 RRC pagingType1
439 51.652358 10.16.225.199 -> 10.16.225.230 RRC pagingType1
440 51.662364 10.16.225.199 -> 10.16.225.230 RRC pagingType1
441 51.672351 10.16.225.199 -> 10.16.225.230 RRC pagingType1
442 51.682510 10.16.225.199 -> 10.16.225.230 RRC pagingType1
443 51.692432 10.16.225.199 -> 10.16.225.230 RRC pagingType1
444 51.702416 10.16.225.199 -> 10.16.225.230 RRC pagingType1
445 51.712413 10.16.225.199 -> 10.16.225.230 RRC pagingType1
446 51.722411 10.16.225.199 -> 10.16.225.230 RRC pagingType1
447 51.732404 10.16.225.199 -> 10.16.225.230 RRC pagingType1
448 51.742400 10.16.225.199 -> 10.16.225.230 RRC pagingType1
449 51.752399 10.16.225.199 -> 10.16.225.230 RRC pagingType1
450 51.762391 10.16.225.199 -> 10.16.225.230 RRC pagingType1
451 51.772388 10.16.225.199 -> 10.16.225.230 RRC pagingType1
452 51.782381 10.16.225.199 -> 10.16.225.230 RRC pagingType1
453 51.792377 10.16.225.199 -> 10.16.225.230 RRC pagingType1
454 51.802372 10.16.225.199 -> 10.16.225.230 RRC pagingType1
455 51.812368 10.16.225.199 -> 10.16.225.230 RRC pagingType1
456 51.822362 10.16.225.199 -> 10.16.225.230 RRC pagingType1
458 51.832525 10.16.225.199 -> 10.16.225.230 RRC pagingType1
459 51.842435 10.16.225.199 -> 10.16.225.230 RRC pagingType1
460 51.852432 10.16.225.199 -> 10.16.225.230 RRC pagingType1
461 51.862428 10.16.225.199 -> 10.16.225.230 RRC pagingType1
462 51.872422 10.16.225.199 -> 10.16.225.230 RRC pagingType1
463 51.882417 10.16.225.199 -> 10.16.225.230 RRC pagingType1
468 51.892414 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 42
469 51.902407 10.16.225.199 -> 10.16.225.230 RRC pagingType1
470 51.912401 10.16.225.199 -> 10.16.225.230 RRC pagingType1
471 51.922396 10.16.225.199 -> 10.16.225.230 RRC pagingType1
472 51.932392 10.16.225.199 -> 10.16.225.230 RRC pagingType1
473 51.942387 10.16.225.199 -> 10.16.225.230 RRC pagingType1
474 51.952383 10.16.225.199 -> 10.16.225.230 RRC pagingType1
475 51.962378 10.16.225.199 -> 10.16.225.230 RRC pagingType1
476 51.972538 10.16.225.199 -> 10.16.225.230 RRC pagingType1
477 51.982455 10.16.225.199 -> 10.16.225.230 RRC pagingType1
478 51.992449 10.16.225.199 -> 10.16.225.230 RRC pagingType1
479 52.002443 10.16.225.199 -> 10.16.225.230 RRC pagingType1
480 52.012449 10.16.225.199 -> 10.16.225.230 RRC pagingType1
483 52.022435 10.16.225.199 -> 10.16.225.230 RRC pagingType1
484 52.025399 10.16.225.197 -> 10.16.225.230 SCTP SACK
485 52.032429 10.16.225.199 -> 10.16.225.230 RRC pagingType1
486 52.042432 10.16.225.199 -> 10.16.225.230 RRC pagingType1
487 52.052421 10.16.225.199 -> 10.16.225.230 RRC pagingType1
488 52.062414 10.16.225.199 -> 10.16.225.230 RRC pagingType1
489 52.072412 10.16.225.199 -> 10.16.225.230 RRC pagingType1
490 52.082407 10.16.225.199 -> 10.16.225.230 RRC pagingType1
491 52.092400 10.16.225.199 -> 10.16.225.230 RRC pagingType1
492 52.102397 10.16.225.199 -> 10.16.225.230 RRC pagingType1
493 52.112556 10.16.225.199 -> 10.16.225.230 RRC pagingType1
494 52.122474 10.16.225.199 -> 10.16.225.230 RRC pagingType1
495 52.132464 10.16.225.199 -> 10.16.225.230 RRC pagingType1
496 52.142462 10.16.225.199 -> 10.16.225.230 RRC pagingType1
497 52.152455 10.16.225.199 -> 10.16.225.230 RRC pagingType1
498 52.162452 10.16.225.199 -> 10.16.225.230 RRC pagingType1
499 52.172448 10.16.225.199 -> 10.16.225.230 RRC pagingType1
500 52.182445 10.16.225.199 -> 10.16.225.230 RRC pagingType1
501 52.192438 10.16.225.199 -> 10.16.225.230 RRC pagingType1
502 52.202433 10.16.225.199 -> 10.16.225.230 RRC pagingType1
503 52.212427 10.16.225.199 -> 10.16.225.230 RRC pagingType1
504 52.222423 10.16.225.199 -> 10.16.225.230 RRC pagingType1
506 52.232427 10.16.225.199 -> 10.16.225.230 RRC pagingType1
507 52.242416 10.16.225.199 -> 10.16.225.230 RRC pagingType1
508 52.252575 10.16.225.199 -> 10.16.225.230 RRC pagingType1
509 52.262487 10.16.225.199 -> 10.16.225.230 RRC pagingType1
510 52.272483 10.16.225.199 -> 10.16.225.230 RRC pagingType1
511 52.282479 10.16.225.199 -> 10.16.225.230 RRC pagingType1
512 52.292476 10.16.225.199 -> 10.16.225.230 RRC pagingType1
513 52.302469 10.16.225.199 -> 10.16.225.230 RRC pagingType1
514 52.312474 10.16.225.199 -> 10.16.225.230 RRC pagingType1
515 52.322460 10.16.225.199 -> 10.16.225.230 RRC pagingType1
516 52.332457 10.16.225.199 -> 10.16.225.230 RRC pagingType1
517 52.342450 10.16.225.199 -> 10.16.225.230 RRC pagingType1
518 52.352451 10.16.225.199 -> 10.16.225.230 RRC pagingType1
519 52.362439 10.16.225.199 -> 10.16.225.230 RRC pagingType1
520 52.372438 10.16.225.199 -> 10.16.225.230 RRC pagingType1
521 52.382432 10.16.225.199 -> 10.16.225.230 RRC pagingType1
524 52.392435 10.16.225.199 -> 10.16.225.230 RRC pagingType1
527 52.402590 10.16.225.199 -> 10.16.225.230 RRC pagingType1
528 52.412507 10.16.225.199 -> 10.16.225.230 RRC pagingType1
529 52.422495 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 43
530 52.425919 10.16.225.197 -> 10.16.225.230 SCTP SACK
531 52.432490 10.16.225.199 -> 10.16.225.230 RRC pagingType1
532 52.442492 10.16.225.199 -> 10.16.225.230 RRC pagingType1
533 52.452483 10.16.225.199 -> 10.16.225.230 RRC pagingType1
534 52.462477 10.16.225.199 -> 10.16.225.230 RRC pagingType1
535 52.472473 10.16.225.199 -> 10.16.225.230 RRC pagingType1
536 52.482467 10.16.225.199 -> 10.16.225.230 RRC pagingType1
537 52.492462 10.16.225.199 -> 10.16.225.230 RRC pagingType1
538 52.502459 10.16.225.199 -> 10.16.225.230 RRC pagingType1
539 52.512453 10.16.225.199 -> 10.16.225.230 RRC pagingType1
542 52.522450 10.16.225.199 -> 10.16.225.230 RRC pagingType1
543 52.532448 10.16.225.199 -> 10.16.225.230 RRC pagingType1
544 52.542609 10.16.225.199 -> 10.16.225.230 RRC pagingType1
545 52.552521 10.16.225.199 -> 10.16.225.230 RRC pagingType1
546 52.562513 10.16.225.199 -> 10.16.225.230 RRC pagingType1
547 52.572508 10.16.225.199 -> 10.16.225.230 RRC pagingType1
548 52.582505 10.16.225.199 -> 10.16.225.230 RRC pagingType1
549 52.592500 10.16.225.199 -> 10.16.225.230 RRC pagingType1
550 52.602494 10.16.225.199 -> 10.16.225.230 RRC pagingType1
551 52.612489 10.16.225.199 -> 10.16.225.230 RRC pagingType1
552 52.622489 10.16.225.199 -> 10.16.225.230 RRC pagingType1
554 52.632484 10.16.225.199 -> 10.16.225.230 RRC pagingType1
555 52.642480 10.16.225.199 -> 10.16.225.230 RRC pagingType1
556 52.652473 10.16.225.199 -> 10.16.225.230 RRC pagingType1
557 52.662477 10.16.225.199 -> 10.16.225.230 RRC pagingType1
558 52.672466 10.16.225.199 -> 10.16.225.230 RRC pagingType1
559 52.682624 10.16.225.199 -> 10.16.225.230 RRC pagingType1
560 52.692536 10.16.225.199 -> 10.16.225.230 RRC pagingType1
561 52.702530 10.16.225.199 -> 10.16.225.230 RRC pagingType1
562 52.712529 10.16.225.199 -> 10.16.225.230 RRC pagingType1
563 52.722522 10.16.225.199 -> 10.16.225.230 RRC pagingType1
564 52.732516 10.16.225.199 -> 10.16.225.230 RRC pagingType1
565 52.742511 10.16.225.199 -> 10.16.225.230 RRC pagingType1
566 52.743773 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
568 52.752509 10.16.225.199 -> 10.16.225.230 RRC pagingType1
569 52.762504 10.16.225.199 -> 10.16.225.230 RRC pagingType1
570 52.772502 10.16.225.199 -> 10.16.225.230 RRC pagingType1
571 52.782494 10.16.225.199 -> 10.16.225.230 RRC pagingType1
572 52.792497 10.16.225.199 -> 10.16.225.230 RRC pagingType1
573 52.802487 10.16.225.199 -> 10.16.225.230 RRC pagingType1
574 52.812481 10.16.225.199 -> 10.16.225.230 RRC pagingType1
575 52.822644 10.16.225.199 -> 10.16.225.230 RRC pagingType1
576 52.825508 10.16.225.197 -> 10.16.225.230 SCTP SACK
577 52.832564 10.16.225.199 -> 10.16.225.230 RRC pagingType1
578 52.842549 10.16.225.199 -> 10.16.225.230 RRC pagingType1
579 52.852545 10.16.225.199 -> 10.16.225.230 RRC pagingType1
580 52.862540 10.16.225.199 -> 10.16.225.230 RRC pagingType1
581 52.872535 10.16.225.199 -> 10.16.225.230 RRC pagingType1
582 52.882529 10.16.225.199 -> 10.16.225.230 RRC pagingType1
585 52.892527 10.16.225.199 -> 10.16.225.230 RRC pagingType1
586 52.897966 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
590 52.902528 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 44
591 52.912521 10.16.225.199 -> 10.16.225.230 RRC pagingType1
592 52.922513 10.16.225.199 -> 10.16.225.230 RRC pagingType1
593 52.932510 10.16.225.199 -> 10.16.225.230 RRC pagingType1
594 52.942506 10.16.225.199 -> 10.16.225.230 RRC pagingType1
595 52.952501 10.16.225.199 -> 10.16.225.230 RRC pagingType1
596 52.962500 10.16.225.199 -> 10.16.225.230 RRC pagingType1
597 52.972654 10.16.225.199 -> 10.16.225.230 RRC pagingType1
598 52.982567 10.16.225.199 -> 10.16.225.230 RRC pagingType1
599 52.992560 10.16.225.199 -> 10.16.225.230 RRC pagingType1
600 53.002555 10.16.225.199 -> 10.16.225.230 RRC pagingType1
601 53.012554 10.16.225.199 -> 10.16.225.230 RRC pagingType1
604 53.020815 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
606 53.022551 10.16.225.199 -> 10.16.225.230 RRC pagingType1
608 53.032546 10.16.225.199 -> 10.16.225.230 RRC pagingType1
609 53.042541 10.16.225.199 -> 10.16.225.230 RRC pagingType1
610 53.052538 10.16.225.199 -> 10.16.225.230 RRC pagingType1
611 53.062529 10.16.225.199 -> 10.16.225.230 RRC pagingType1
612 53.072526 10.16.225.199 -> 10.16.225.230 RRC pagingType1
613 53.082522 10.16.225.199 -> 10.16.225.230 RRC pagingType1
614 53.092515 10.16.225.199 -> 10.16.225.230 RRC pagingType1
615 53.102511 10.16.225.199 -> 10.16.225.230 RRC pagingType1
616 53.112679 10.16.225.199 -> 10.16.225.230 RRC pagingType1
617 53.122591 10.16.225.199 -> 10.16.225.230 RRC pagingType1
618 53.132582 10.16.225.199 -> 10.16.225.230 RRC pagingType1
619 53.142575 10.16.225.199 -> 10.16.225.230 RRC pagingType1
620 53.152577 10.16.225.199 -> 10.16.225.230 RRC pagingType1
621 53.162567 10.16.225.199 -> 10.16.225.230 RRC pagingType1
622 53.172560 10.16.225.199 -> 10.16.225.230 RRC pagingType1
623 53.182559 10.16.225.199 -> 10.16.225.230 RRC pagingType1
624 53.192552 10.16.225.199 -> 10.16.225.230 RRC pagingType1
625 53.202547 10.16.225.199 -> 10.16.225.230 RRC pagingType1
626 53.212548 10.16.225.199 -> 10.16.225.230 RRC pagingType1
627 53.222545 10.16.225.199 -> 10.16.225.230 RRC pagingType1
628 53.224185 10.16.225.197 -> 10.16.225.230 SCTP SACK
629 53.232541 10.16.225.199 -> 10.16.225.230 RRC pagingType1
630 53.242531 10.16.225.199 -> 10.16.225.230 RRC pagingType1
631 53.252701 10.16.225.199 -> 10.16.225.230 RRC pagingType1
632 53.262612 10.16.225.199 -> 10.16.225.230 RRC pagingType1
633 53.272598 10.16.225.199 -> 10.16.225.230 RRC pagingType1
634 53.282592 10.16.225.199 -> 10.16.225.230 RRC pagingType1
635 53.292598 10.16.225.199 -> 10.16.225.230 RRC pagingType1
636 53.302582 10.16.225.199 -> 10.16.225.230 RRC pagingType1
637 53.312577 10.16.225.199 -> 10.16.225.230 RRC pagingType1
638 53.322574 10.16.225.199 -> 10.16.225.230 RRC pagingType1
639 53.332569 10.16.225.199 -> 10.16.225.230 RRC pagingType1
640 53.342563 10.16.225.199 -> 10.16.225.230 RRC pagingType1
641 53.352562 10.16.225.199 -> 10.16.225.230 RRC pagingType1
642 53.362554 10.16.225.199 -> 10.16.225.230 RRC pagingType1
643 53.372551 10.16.225.199 -> 10.16.225.230 RRC pagingType1
644 53.382552 10.16.225.199 -> 10.16.225.230 RRC pagingType1
647 53.392710 10.16.225.199 -> 10.16.225.230 RRC pagingType1
648 53.402624 10.16.225.199 -> 10.16.225.230 RRC pagingType1
651 53.412621 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 45
652 53.422622 10.16.225.199 -> 10.16.225.230 RRC pagingType1
654 53.432608 10.16.225.199 -> 10.16.225.230 RRC pagingType1
655 53.442604 10.16.225.199 -> 10.16.225.230 RRC pagingType1
656 53.452597 10.16.225.199 -> 10.16.225.230 RRC pagingType1
657 53.462596 10.16.225.199 -> 10.16.225.230 RRC pagingType1
658 53.472587 10.16.225.199 -> 10.16.225.230 RRC pagingType1
659 53.482581 10.16.225.199 -> 10.16.225.230 RRC pagingType1
660 53.492577 10.16.225.199 -> 10.16.225.230 RRC pagingType1
661 53.502579 10.16.225.199 -> 10.16.225.230 RRC pagingType1
662 53.512568 10.16.225.199 -> 10.16.225.230 RRC pagingType1
665 53.522564 10.16.225.199 -> 10.16.225.230 RRC pagingType1
666 53.532725 10.16.225.199 -> 10.16.225.230 RRC pagingType1
667 53.542641 10.16.225.199 -> 10.16.225.230 RRC pagingType1
668 53.552634 10.16.225.199 -> 10.16.225.230 RRC pagingType1
669 53.562631 10.16.225.199 -> 10.16.225.230 RRC pagingType1
670 53.572628 10.16.225.199 -> 10.16.225.230 RRC pagingType1
671 53.582621 10.16.225.199 -> 10.16.225.230 RRC pagingType1
672 53.592617 10.16.225.199 -> 10.16.225.230 RRC pagingType1
673 53.602613 10.16.225.199 -> 10.16.225.230 RRC pagingType1
674 53.612609 10.16.225.199 -> 10.16.225.230 RRC pagingType1
675 53.622603 10.16.225.199 -> 10.16.225.230 RRC pagingType1
676 53.624680 10.16.225.197 -> 10.16.225.230 SCTP SACK
677 53.632600 10.16.225.199 -> 10.16.225.230 RRC pagingType1
678 53.642600 10.16.225.199 -> 10.16.225.230 RRC pagingType1
679 53.652587 10.16.225.199 -> 10.16.225.230 RRC pagingType1
680 53.662580 10.16.225.199 -> 10.16.225.230 RRC pagingType1
681 53.672748 10.16.225.199 -> 10.16.225.230 RRC pagingType1
682 53.682660 10.16.225.199 -> 10.16.225.230 RRC pagingType1
683 53.692655 10.16.225.199 -> 10.16.225.230 RRC pagingType1
684 53.702650 10.16.225.199 -> 10.16.225.230 RRC pagingType1
685 53.712641 10.16.225.199 -> 10.16.225.230 RRC pagingType1
686 53.722639 10.16.225.199 -> 10.16.225.230 RRC pagingType1
687 53.732634 10.16.225.199 -> 10.16.225.230 RRC pagingType1
688 53.742631 10.16.225.199 -> 10.16.225.230 RRC pagingType1
689 53.752626 10.16.225.199 -> 10.16.225.230 RRC pagingType1
690 53.762621 10.16.225.199 -> 10.16.225.230 RRC pagingType1
691 53.772616 10.16.225.199 -> 10.16.225.230 RRC pagingType1
692 53.782613 10.16.225.199 -> 10.16.225.230 RRC pagingType1
693 53.792607 10.16.225.199 -> 10.16.225.230 RRC pagingType1
694 53.802602 10.16.225.199 -> 10.16.225.230 RRC pagingType1
695 53.812598 10.16.225.199 -> 10.16.225.230 RRC pagingType1
696 53.822760 10.16.225.199 -> 10.16.225.230 RRC pagingType1
698 53.832674 10.16.225.199 -> 10.16.225.230 RRC pagingType1
699 53.842670 10.16.225.199 -> 10.16.225.230 RRC pagingType1
700 53.852661 10.16.225.199 -> 10.16.225.230 RRC pagingType1
701 53.862654 10.16.225.199 -> 10.16.225.230 RRC pagingType1
702 53.872654 10.16.225.199 -> 10.16.225.230 RRC pagingType1
703 53.882648 10.16.225.199 -> 10.16.225.230 RRC pagingType1
706 53.892645 10.16.225.199 -> 10.16.225.230 RRC pagingType1
707 53.902637 10.16.225.199 -> 10.16.225.230 RRC pagingType1
710 53.912635 10.16.225.199 -> 10.16.225.230 RRC pagingType1
711 53.922629 10.16.225.199 -> 10.16.225.230 RRC pagingType1
712 53.932629 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 46
713 53.942627 10.16.225.199 -> 10.16.225.230 RRC pagingType1
714 53.952616 10.16.225.199 -> 10.16.225.230 RRC pagingType1
715 53.962772 10.16.225.199 -> 10.16.225.230 RRC pagingType1
716 53.972689 10.16.225.199 -> 10.16.225.230 RRC pagingType1
717 53.982685 10.16.225.199 -> 10.16.225.230 RRC pagingType1
718 53.992679 10.16.225.199 -> 10.16.225.230 RRC pagingType1
719 54.002673 10.16.225.199 -> 10.16.225.230 RRC pagingType1
720 54.012676 10.16.225.199 -> 10.16.225.230 RRC pagingType1
723 54.022667 10.16.225.199 -> 10.16.225.230 RRC pagingType1
724 54.027918 10.16.225.197 -> 10.16.225.230 SCTP SACK
725 54.032661 10.16.225.199 -> 10.16.225.230 RRC pagingType1
726 54.042658 10.16.225.199 -> 10.16.225.230 RRC pagingType1
727 54.052654 10.16.225.199 -> 10.16.225.230 RRC pagingType1
728 54.062644 10.16.225.199 -> 10.16.225.230 RRC pagingType1
729 54.072642 10.16.225.199 -> 10.16.225.230 RRC pagingType1
730 54.082638 10.16.225.199 -> 10.16.225.230 RRC pagingType1
731 54.092636 10.16.225.199 -> 10.16.225.230 RRC pagingType1
732 54.102797 10.16.225.199 -> 10.16.225.230 RRC pagingType1
733 54.112712 10.16.225.199 -> 10.16.225.230 RRC pagingType1
734 54.122701 10.16.225.199 -> 10.16.225.230 RRC pagingType1
735 54.132695 10.16.225.199 -> 10.16.225.230 RRC pagingType1
736 54.142691 10.16.225.199 -> 10.16.225.230 RRC pagingType1
737 54.152685 10.16.225.199 -> 10.16.225.230 RRC pagingType1
738 54.162686 10.16.225.199 -> 10.16.225.230 RRC pagingType1
739 54.172678 10.16.225.199 -> 10.16.225.230 RRC pagingType1
740 54.182677 10.16.225.199 -> 10.16.225.230 RRC pagingType1
741 54.192675 10.16.225.199 -> 10.16.225.230 RRC pagingType1
742 54.202671 10.16.225.199 -> 10.16.225.230 RRC pagingType1
743 54.212659 10.16.225.199 -> 10.16.225.230 RRC pagingType1
744 54.222654 10.16.225.199 -> 10.16.225.230 RRC pagingType1
746 54.232650 10.16.225.199 -> 10.16.225.230 RRC pagingType1
747 54.242649 10.16.225.199 -> 10.16.225.230 RRC pagingType1
748 54.252807 10.16.225.199 -> 10.16.225.230 RRC pagingType1
749 54.262720 10.16.225.199 -> 10.16.225.230 RRC pagingType1
750 54.272714 10.16.225.199 -> 10.16.225.230 RRC pagingType1
751 54.282721 10.16.225.199 -> 10.16.225.230 RRC pagingType1
752 54.292704 10.16.225.199 -> 10.16.225.230 RRC pagingType1
753 54.302702 10.16.225.199 -> 10.16.225.230 RRC pagingType1
754 54.312695 10.16.225.199 -> 10.16.225.230 RRC pagingType1
755 54.322692 10.16.225.199 -> 10.16.225.230 RRC pagingType1
756 54.332684 10.16.225.199 -> 10.16.225.230 RRC pagingType1
757 54.342685 10.16.225.199 -> 10.16.225.230 RRC pagingType1
758 54.352679 10.16.225.199 -> 10.16.225.230 RRC pagingType1
759 54.356782 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
761 54.362673 10.16.225.199 -> 10.16.225.230 RRC pagingType1
762 54.372668 10.16.225.199 -> 10.16.225.230 RRC pagingType1
763 54.382829 10.16.225.199 -> 10.16.225.230 RRC pagingType1
766 54.392745 10.16.225.199 -> 10.16.225.230 RRC pagingType1
767 54.402738 10.16.225.199 -> 10.16.225.230 RRC pagingType1
770 54.412738 10.16.225.199 -> 10.16.225.230 RRC pagingType1
771 54.422725 10.16.225.199 -> 10.16.225.230 RRC pagingType1
772 54.424774 10.16.225.197 -> 10.16.225.230 SCTP SACK
773 54.432723 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 47
774 54.442719 10.16.225.199 -> 10.16.225.230 RRC pagingType1
775 54.452714 10.16.225.199 -> 10.16.225.230 RRC pagingType1
776 54.462709 10.16.225.199 -> 10.16.225.230 RRC pagingType1
777 54.472702 10.16.225.199 -> 10.16.225.230 RRC pagingType1
778 54.482705 10.16.225.199 -> 10.16.225.230 RRC pagingType1
779 54.492695 10.16.225.199 -> 10.16.225.230 RRC pagingType1
780 54.502690 10.16.225.199 -> 10.16.225.230 RRC pagingType1
781 54.512685 10.16.225.199 -> 10.16.225.230 RRC pagingType1
784 54.522681 10.16.225.199 -> 10.16.225.230 RRC pagingType1
785 54.532841 10.16.225.199 -> 10.16.225.230 RRC pagingType1
786 54.542772 10.16.225.199 -> 10.16.225.230 RRC pagingType1
787 54.552748 10.16.225.199 -> 10.16.225.230 RRC pagingType1
788 54.562745 10.16.225.199 -> 10.16.225.230 RRC pagingType1
789 54.572742 10.16.225.199 -> 10.16.225.230 RRC pagingType1
790 54.582746 10.16.225.199 -> 10.16.225.230 RRC pagingType1
791 54.592731 10.16.225.199 -> 10.16.225.230 RRC pagingType1
792 54.602727 10.16.225.199 -> 10.16.225.230 RRC pagingType1
793 54.612721 10.16.225.199 -> 10.16.225.230 RRC pagingType1
794 54.622718 10.16.225.199 -> 10.16.225.230 RRC pagingType1
796 54.632715 10.16.225.199 -> 10.16.225.230 RRC pagingType1
797 54.642707 10.16.225.199 -> 10.16.225.230 RRC pagingType1
798 54.652706 10.16.225.199 -> 10.16.225.230 RRC pagingType1
799 54.662699 10.16.225.199 -> 10.16.225.230 RRC pagingType1
800 54.672857 10.16.225.199 -> 10.16.225.230 RRC pagingType1
801 54.682769 10.16.225.199 -> 10.16.225.230 RRC pagingType1
802 54.692765 10.16.225.199 -> 10.16.225.230 RRC pagingType1
803 54.702762 10.16.225.199 -> 10.16.225.230 RRC pagingType1
804 54.712759 10.16.225.199 -> 10.16.225.230 RRC pagingType1
805 54.722752 10.16.225.199 -> 10.16.225.230 RRC pagingType1
806 54.732747 10.16.225.199 -> 10.16.225.230 RRC pagingType1
807 54.742743 10.16.225.199 -> 10.16.225.230 RRC pagingType1
808 54.752739 10.16.225.199 -> 10.16.225.230 RRC pagingType1
809 54.762734 10.16.225.199 -> 10.16.225.230 RRC pagingType1
810 54.771909 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
812 54.772729 10.16.225.199 -> 10.16.225.230 RRC pagingType1
813 54.782725 10.16.225.199 -> 10.16.225.230 RRC pagingType1
814 54.792721 10.16.225.199 -> 10.16.225.230 RRC pagingType1
815 54.802720 10.16.225.199 -> 10.16.225.230 RRC pagingType1
816 54.812712 10.16.225.199 -> 10.16.225.230 RRC pagingType1
817 54.822868 10.16.225.199 -> 10.16.225.230 RRC pagingType1
818 54.828001 10.16.225.197 -> 10.16.225.230 SCTP SACK
819 54.832784 10.16.225.199 -> 10.16.225.230 RRC pagingType1
820 54.842784 10.16.225.199 -> 10.16.225.230 RRC pagingType1
821 54.848369 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
823 54.852779 10.16.225.199 -> 10.16.225.230 RRC pagingType1
824 54.862772 10.16.225.199 -> 10.16.225.230 RRC pagingType1
825 54.872766 10.16.225.199 -> 10.16.225.230 RRC pagingType1
826 54.882761 10.16.225.199 -> 10.16.225.230 RRC pagingType1
829 54.892762 10.16.225.199 -> 10.16.225.230 RRC pagingType1
830 54.902752 10.16.225.199 -> 10.16.225.230 RRC pagingType1
833 54.912748 10.16.225.199 -> 10.16.225.230 RRC pagingType1
834 54.922742 10.16.225.199 -> 10.16.225.230 RRC pagingType1
Hardware 48
835 54.932738 10.16.225.199 -> 10.16.225.230 RRC pagingType1
836 54.942733 10.16.225.199 -> 10.16.225.230 RRC pagingType1
837 54.952728 10.16.225.199 -> 10.16.225.230 RRC pagingType1
838 54.962892 10.16.225.199 -> 10.16.225.230 RRC pagingType1
839 54.972801 10.16.225.199 -> 10.16.225.230 RRC pagingType1
840 54.982795 10.16.225.199 -> 10.16.225.230 RRC pagingType1
841 54.992791 10.16.225.199 -> 10.16.225.230 RRC pagingType1
842 55.002787 10.16.225.199 -> 10.16.225.230 RRC pagingType1
843 55.012784 10.16.225.199 -> 10.16.225.230 RRC pagingType1
846 55.022776 10.16.225.199 -> 10.16.225.230 RRC pagingType1
848 55.032775 10.16.225.199 -> 10.16.225.230 RRC pagingType1
849 55.042773 10.16.225.199 -> 10.16.225.230 RRC pagingType1
850 55.052769 10.16.225.199 -> 10.16.225.230 RRC pagingType1
851 55.062760 10.16.225.199 -> 10.16.225.230 RRC pagingType1
852 55.072754 10.16.225.199 -> 10.16.225.230 RRC pagingType1
853 55.082751 10.16.225.199 -> 10.16.225.230 RRC pagingType1
854 55.092745 10.16.225.199 -> 10.16.225.230 RRC pagingType1
855 55.102905 10.16.225.199 -> 10.16.225.230 RRC pagingType1
856 55.112825 10.16.225.199 -> 10.16.225.230 RRC pagingType1
857 55.122814 10.16.225.199 -> 10.16.225.230 RRC pagingType1
858 55.132809 10.16.225.199 -> 10.16.225.230 RRC pagingType1
859 55.142803 10.16.225.199 -> 10.16.225.230 RRC pagingType1
860 55.152802 10.16.225.199 -> 10.16.225.230 RRC pagingType1
861 55.162795 10.16.225.199 -> 10.16.225.230 RRC pagingType1
862 55.172793 10.16.225.199 -> 10.16.225.230 RRC pagingType1
865 55.224418 10.16.225.197 -> 10.16.225.230 SCTP SACK
873 55.624926 10.16.225.197 -> 10.16.225.230 SCTP SACK
883 56.024504 10.16.225.197 -> 10.16.225.230 SCTP SACK
884 56.056144 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
893 56.426363 10.16.225.197 -> 10.16.225.230 SCTP SACK
894 56.523235 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
Hardware 49
899 56.632214 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
903 56.825937 10.16.225.197 -> 10.16.225.230 SCTP SACK
913 57.225981 10.16.225.197 -> 10.16.225.230 SCTP SACK
921 57.557153 10.16.225.197 -> 10.16.225.230 SCTP HEARTBEAT
923 57.626027 10.16.225.197 -> 10.16.225.230 SCTP SACK
933 58.028376 10.16.225.197 -> 10.16.225.230 SCTP SACK
937 58.274336 10.16.225.230 -> 10.16.225.197 SCTP HEARTBEAT
interface states @site routers
** BCN m10 LAN1 port connection

**
A1-OSR1#sh run
...
interface GigabitEthernet2/17
description ***mcRNC_455_BCN0_LAN1***
switchport
switchport trunk encapsulation dot1q
switchport trunk allowed vlan 541
switchport mode trunk
!
Hardware 50
** SSH loopback address
A1-OSR1#sh ip route 10.16.229.112
Routing entry for 10.16.229.112/32
Known via "static", distance 1, metric 0
Redistributing via ospf 100
Advertised by ospf 100 subnets
Routing Descriptor Blocks:
* 10.16.229.98
Route metric is 0, traffic share count is 1
** RNC OAM interface

root@CFPU-0 [RNC-455] > show networking interface runtime iface oam_r1 node CFPU-0
VRF name(ID) : default (0)
Node name : CFPU-0
oam_r1
index : 11
node : CFPU-0
type : VLAN
flags : UP BROADCAST RUNNING MULTICAST
MAC : 00:d0:c9:bf:25:fe
vid : 541
realiface : eth0
MTU : 1500
admin state : up
oper state : up
Rx packets :
total : 2320834
bytes : 134365966
error : 0
Tx packets :
total : 1789453
bytes : 497669874
error : 0
**
root@CFPU-0 [RNC-455] > show networking address role ssh
IP addresses in default instance:
lo
type : dedicated
address : 10.16.229.112/32
owner : /SSH
role : ssh
** RNC interface goes down

root@CFPU-0 [RNC-455] > set networking interface /CFPU-0 iface eth0 admin down
root@CFPU-0 [RNC-455] > show networking interface runtime node CFPU-0 iface oam_r1
Node name : CFPU-0
oam_r1
index : 11
node : CFPU-0
type : VLAN
flags : UP BROADCAST MULTICAST
MAC : 00:d0:c9:bf:25:fe
vid : 541
realiface : eth0
Hardware 51
MTU : 1500
admin state : up
oper state : down
Rx packets :
total : 2321524
bytes : 134405234
error : 0
Tx packets :
total : 1789883
bytes : 497774923
error : 3
** gi int goes down

A1-OSR1#sh int gi 2/17
GigabitEthernet2/17 is down, line protocol is down (notconnect)
Hardware is C7600 1Gb 802.3, address is 68ef.bdff.bbac (bia 68ef.bdff.bbac)
Description: ***mcRNC_455_BCN0_LAN1***
** vlan int goes down

A1-OSR1#sh int vlan 541
Vlan541 is down, line protocol is down
Hardware is EtherSVI, address is 8843.e1dc.4480 (bia 8843.e1dc.4480)
Description: mcRNC-455-OAM-R1
** routing points to OSR-2

A1-OSR1#sh ip route 10.16.229.112
Routing entry for 10.16.229.112/32
Known via "ospf 100", distance 110, metric 20, type extern 2, forward metric 1
Last update from 10.16.224.242 on Vlan500, 00:01:38 ago
Routing Descriptor Blocks:
* 10.16.224.242, from 10.16.225.150, 00:01:38 ago, via Vlan500
Route metric is 20, traffic share count is 1
my rnwdb is not starting
** it is time to check the resource states of DB RUs

** if RESOURCE_STATE = UNKNOWN
** force them to be FUNCTIONAL
# fshascli -S RESOURCE_STATE=FUNCTIONAL /CFPU-1/QNDBRNWServer
** proper situation
# fshascli -s /CFPU-*/QNDBR*
/CFPU-0/QNDBRNWServer:
administrative(UNLOCKED)
operational(ENABLED)
usage(ACTIVE)
procedural()
availability()
unknown(FALSE)
alarm()
role(ACTIVE)
Dynamic attributes:
RESOURCE_STATE = FUNCTIONAL
/CFPU-1/QNDBRNWServer:
administrative(UNLOCKED)
operational(ENABLED)
Hardware 52
usage(ACTIVE)
procedural()
availability()
unknown(FALSE)
alarm()
role(HOTSTANDBY)
Dynamic attributes:
RESOURCE_STATE = FUNCTIONAL
IPMGMT roles - howto use them
** my roles
root@CFPU-0 [RNC-453] > show networking address role
[X] - role(s) for the address.
[X] btsom -
[X] cfeigw -
[X] iub -
[X] iubcp -
[X] iubup -
[X] iucscp -
[X] iucsup -
[X] iupscp -
[X] iupsup -
[X] iurcp -
[X] iurup -
[X] oms -
[X] rnchanet -
[X] ssh -
** to see my iucsup termination points

root@CFPU-0 [RNC-453] > show networking address iface lo role iucsup
IP addresses in iucsup instance:
lo
type : dedicated
address : 10.16.14.244/32
owner : /QNUP-0
role : iucsup
** to see my iupscp interface addresses

root@CFPU-0 [RNC-453] > show networking address role iupscp
IP addresses in iucp instance:
iupscp1_r1
type : dedicated
address : 10.16.13.40/28
owner : /EIPU-2
user : /SS7SGU
role : iupscp
iupscp2_r2
type : dedicated
address : 10.16.14.72/28
owner : /EIPU-2
user : /SS7SGU
role : iupscp
iupscp1_r1
type : dedicated
address : 10.16.13.41/28
owner : /EIPU-3
user : /SS7SGU
Hardware 53
role : iupscp
iupscp2_r2
type : dedicated
address : 10.16.14.73/28
owner : /EIPU-3
user : /SS7SGU
role : iupscp
reference interface caps - (OMS,WBTS OAM)
** RNC - GOMS interface (btsom)

** IP addresses
RNC: 10.16.14.251
OMS: 10.16.4.9
[karento@lostballs caps]$ tshark -r rncoam.cap -R "om&&ip.addr==10.16.14.251"

27101 108.775070 10.16.14.251 -> 10.16.4.9 OM 146 connectionEstablishedIndication
27141 108.934203 10.16.4.9 -> 10.16.14.251 OM 105 connectionEstablishedReply
27145 108.940738 10.16.14.251 -> 10.16.4.9 OM 95 supervision
27147 108.941101 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
27156 108.980994 10.16.4.9 -> 10.16.14.251 OM 152 fileLoadRequest
27171 109.022133 10.16.14.251 -> 10.16.4.9 OM 93 operationFeedback
27228 109.223123 10.16.14.251 -> 10.16.4.9 OM 664 operationFeedback
27276 109.331956 10.16.4.9 -> 10.16.14.251 OM 172 fileLoadCompleted
27283 109.356189 10.16.14.251 -> 10.16.4.9 OM 90 ackNack
27287 109.359262 10.16.14.251 -> 10.16.4.9 OM 652 configurationChangeNotification
27289 109.361131 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
27507 110.216125 10.16.14.251 -> 10.16.4.9 OM 778 alarmObservation
27510 110.220464 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
27526 110.274979 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
27653 110.786561 10.16.4.9 -> 10.16.14.251 OM 152 fileLoadRequest
27798 111.354090 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
28063 112.404981 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
28247 113.126231 10.16.4.9 -> 10.16.14.251 OM 93 alarmStatusRequest
28270 113.204175 10.16.14.251 -> 10.16.4.9 OM 599 ackNack
28272 113.208217 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28290 113.259708 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28307 113.310906 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28330 113.370972 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28343 113.425076 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28363 113.476884 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28379 113.528395 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28397 113.578865 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28417 113.630485 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28430 113.678848 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28449 113.731664 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
Hardware 54
28467 113.784812 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28486 113.837080 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28502 113.889015 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28521 113.942169 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28538 113.990541 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28555 114.040827 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28569 114.090794 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28588 114.144692 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28605 114.194855 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28625 114.250681 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28637 114.297870 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28657 114.346884 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28678 114.397744 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28687 114.445841 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28708 114.494865 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28728 114.546911 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28743 114.597816 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28761 114.649156 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28776 114.699859 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28796 114.750783 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28817 114.801367 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28831 114.851167 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28849 114.901762 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28867 114.949616 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28883 114.997820 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28898 115.045729 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28936 115.093667 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28947 115.141825 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28964 115.190749 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
28984 115.243039 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
Hardware 55
29000 115.297822 10.16.4.9 -> 10.16.14.251 OM 93 ackNack
29017 115.339189 10.16.14.251 -> 10.16.4.9 OM 90 alarmStatusReply
29529 117.310739 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
29798 118.374191 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
30061 119.434607 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
30325 120.486675 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
30586 121.546807 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
30854 122.598467 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
31119 123.659462 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
31393 124.711611 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
31654 125.772326 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
34938 138.984073 10.16.14.251 -> 10.16.4.9 OM 95 supervision
34940 138.984497 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
37696 150.133655 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
38468 153.229416 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
38487 153.282360 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
38501 153.336235 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
38767 154.395557 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39031 155.447495 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39308 156.500619 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39326 156.558646 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39345 156.616534 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39366 156.673181 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39385 156.734401 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39405 156.788113 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39666 157.839552 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
39934 158.896171 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
40203 159.956625 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
40223 160.013622 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
40249 160.074532 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
41941 166.846063 10.16.14.251 -> 10.16.4.9 OM 618 configurationChangeNotification
41947 166.852496 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
42316 168.308968 10.16.14.251 -> 10.16.4.9 OM 93 targetIdCheck
42489 168.948729 10.16.14.251 -> 10.16.4.9 OM 95 supervision
42491 168.949119 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
Hardware 56
42871 170.453034 10.16.4.9 -> 10.16.14.251 OM 249 fileLoadPrepare
42929 170.639057 10.16.14.251 -> 10.16.4.9 OM 181 fileLoadCompleted
49985 198.952989 10.16.14.251 -> 10.16.4.9 OM 95 supervision
49987 198.953459 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
57446 228.954470 10.16.14.251 -> 10.16.4.9 OM 95 supervision
57448 228.955316 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
64884 259.002949 10.16.14.251 -> 10.16.4.9 OM 95 supervision
64886 259.003446 10.16.4.9 -> 10.16.14.251 OM 92 ackNack
** RNC - WBTS OAM interface (btsom)

** IP addresses
RNC: 10.16.14.251
OMS: 10.16.6.26
[karento@lostballs caps]$ tshark -r rncoam.cap -R "om&&ip.addr==10.16.6.26"

41759 166.187087 10.16.6.26 -> 10.16.14.250 OM 152 connectionEstablishedIndication
41911 166.757304 10.16.14.250 -> 10.16.6.26 OM 106 connectionEstablishedReply
41919 166.764951 10.16.14.250 -> 10.16.6.26 OM 94 alarmStatusRequest
42030 167.177038 10.16.6.26 -> 10.16.14.250 OM 98 supervision
42053 167.260529 10.16.14.250 -> 10.16.6.26 OM 92 ackNack
42357 168.449601 10.16.6.26 -> 10.16.14.250 OM 281 ackNack
42571 169.277092 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
42823 170.285279 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
43097 171.290497 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
43353 172.298646 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
43608 173.306760 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
43861 174.314928 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
44113 175.323061 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
44375 176.331207 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
44636 177.339350 10.16.14.250 -> 10.16.6.26 OM 94 ackNack
50042 199.133622 10.16.6.26 -> 10.16.14.250 OM 98 supervision
50139 199.532269 10.16.14.250 -> 10.16.6.26 OM 92 ackNack
57746 230.133671 10.16.6.26 -> 10.16.14.250 OM 98 supervision
57788 230.300272 10.16.14.250 -> 10.16.6.26 OM 92 ackNack
65412 261.135778 10.16.6.26 -> 10.16.14.250 OM 98 supervision
65516 261.557956 10.16.14.250 -> 10.16.6.26 OM 92 ackNack
howto check interface states
** interface
# ssh eipu-0 ip a s iucscp1_r1
16: iucscp1_r1: &ltBROADCAST,MULTICAST,UP,RUNNING&gt mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:ba:64:b3 brd ff:ff:ff:ff:ff:ff
IPv4 forwarding: on IPv6 forwarding: off
IPv4 force reassembly: no IPv6 force reassembly: no
inet 10.16.224.6/28 brd 10.16.224.15 scope global iucscp1_r1
inet6 fe80::d0:c900:10ba:64b3/64 scope link
Hardware 57
root@CFPU-0 [RNC-451] > show networking interface runtime node EIPU-0 iface iucscp1_r1
Node name : EIPU-0
iucscp1_r1
index : 16
node : EIPU-0
type : VLAN
flags : UP BROADCAST RUNNING MULTICAST
MAC : 00:d0:c9:ba:64:b3
vid : 10
realiface : ethsfp7
MTU : 1500
admin state : up
oper state : up
Rx packets :
total : 156758
bytes : 14779548
error : 0
Tx packets :
total : 156740
bytes : 14736992
error : 0
** counters
# zjane 1 ss SFP7
Wed Feb 15 21:39:01 EET 2012 : Getting L2 statistics:
###############################################
show interface ethernet 0/1
Total Packets Received (Octets)................ 10395661119

Packets Received 64 Octets..................... 21222306
Packets Received 65-127 Octets................. 99239365
Packets Received 128-255 Octets................ 5914031
Packets Received 512-1023 Octets............... 426606
Packets Received 1024-1518 Octets.............. 7689
Packets Received > 1522 Octets................. 0
Packets RX and TX 64 Octets.................... 38436660
Packets RX and TX 65-127 Octets................ 183328035
Packets RX and TX 128-255 Octets............... 6348750
Packets RX and TX 512-1023 Octets.............. 959733
Packets RX and TX 1024-1518 Octets............. 8686149
Total Packets Received Without Errors.......... 127299234

Unicast Packets Received....................... 105018550
Multicast Packets Received..................... 1124836
Broadcast Packets Received..................... 21155848
Total Packets Received with MAC Errors......... 0

Jabbers Received............................... 0
Hardware 58
Fragments Received............................. 0
Undersize Received............................. 0
Alignment Errors............................... 0
FCS Errors..................................... 0
Overruns....................................... 0
Total Received Packets Not Forwarded........... 0

Local Traffic Frames........................... 0
802.3x Pause Frames Received................... 0
Unacceptable Frame Type........................ 0
Multicast Tree Viable Discards................. 0
Reserved Address Discards...................... 0
Broadcast Storm Recovery....................... 0
CFI Discards................................... 0
Upstream Threshold............................. 0
Total Packets Transmitted (Octets)............. 20764095486

Packets Transmitted 64 Octets.................. 17214354
Packets Transmitted 65-127 Octets.............. 84088670
Packets Transmitted 128-255 Octets............. 434719
Packets Transmitted 512-1023 Octets............ 533127
Packets Transmitted 1024-1518 Octets........... 8678460
Max Frame Size................................. 1522
Total Packets Transmitted Successfully......... 111187846

Unicast Packets Transmitted.................... 111185963
Multicast Packets Transmitted.................. 568
Broadcast Packets Transmitted.................. 1315
Total Transmit Errors.......................... 0

FCS Errors..................................... 0
Tx Oversized................................... 0
Underrun Errors................................ 0
Total Transmit Packets Discarded............... 0

Single Collision Frames........................ 0
Multiple Collision Frames...................... 0
Excessive Collision Frames..................... 0
Port Membership Discards....................... 0
802.3x Pause Frames Transmitted................ 0

GVRP PDUs received............................. 0
GVRP PDUs Transmitted.......................... 0
GVRP Failed Registrations...................... 0
GMRP PDUs Received............................. 0
GMRP PDUs Transmitted.......................... 0
GMRP Failed Registrations...................... 0
STP BPDUs Transmitted.......................... 0

STP BPDUs Received............................. 0
RSTP BPDUs Transmitted......................... 0
RSTP BPDUs Received............................ 0
MSTP BPDUs Transmitted......................... 0
MSTP BPDUs Received............................ 0
EAPOL Frames Transmitted....................... 0

EAPOL Start Frames Received.................... 0
Time Since Counters Last Cleared............... 26 day 8 hr 18 min 11 sec
Hardware 59
** link state
# zjane 1 ZLAI SFP7
Wed Feb 15 21:39:59 EET 2012 : BCM: show SFP ports:
------ ------ ------- ---------- ---------- ------ ------- ------ --------
...
howto see routing config
** active routing
# ssh eipu-0 ip r s | grep via
10.20.153.48 via 10.16.224.1 dev iucscp1_r1 proto gated
10.16.225.199 via 169.254.0.7 dev cfeigw proto gated
1.2.3.4 via 10.16.225.81 dev iubc_r1 proto gated
10.16.225.234 via 10.16.225.49 dev oam_wbts_r1 proto gated
1.2.3.5 via 10.16.225.97 dev iubc_r2 proto gated
10.20.153.188 via 10.16.224.17 dev iucscp2_r2 proto gated
10.16.225.233 via 10.16.224.97 dev iub_r1 proto gated
10.16.225.240/29 via 10.16.225.49 dev oam_wbts_r1 proto gated
10.16.225.248/29 via 10.16.225.49 dev oam_wbts_r1 proto gated
nexthop via 10.16.224.1 dev iucscp1_r1 weight 1
nexthop via 10.16.224.17 dev iucscp2_r2 weight 1
10.16.225.216/29 via 10.16.224.161 dev iucsup_r1 proto gated
10.16.225.224/28 via 10.16.224.97 dev iub_r1 proto gated
10.16.8.128/27 via 10.16.224.161 dev iucsup_r1 proto gated
** device routes
# ssh eipu-0 ip r s | grep -v via
10.16.225.208/29 proto gated
10.16.224.176/28 dev iucsup_r2 proto kernel scope link src 10.16.224.182
10.16.224.160/28 dev iucsup_r1 proto kernel scope link src 10.16.224.166
10.16.225.48/28 dev oam_wbts_r1 proto kernel scope link src 10.16.225.52
10.16.224.16/28 dev iucscp2_r2 proto kernel scope link src 10.16.224.22
10.16.224.0/28 dev iucscp1_r1 proto kernel scope link src 10.16.224.6
10.16.224.112/28 dev iub_r2 proto kernel scope link src 10.16.224.118
10.16.224.96/28 dev iub_r1 proto kernel scope link src 10.16.224.102
10.16.225.96/28 dev iubc_r2 proto kernel scope link src 10.16.225.100
10.16.225.80/28 dev iubc_r1 proto kernel scope link src 10.16.225.84
10.16.225.64/28 dev oam_wbts_r2 proto kernel scope link src 10.16.225.68
169.254.241.0/24 dev internal proto kernel scope link src 169.254.241.7
169.254.240.0/24 dev xaui0 proto kernel scope link src 169.254.240.7
169.254.0.0/24 dev cfeigw proto kernel scope link src 169.254.0.6
169.254.239.0/24 dev rnchanet proto kernel scope link src 169.254.239.6
** static-routes config
root@CFPU-0 [RNC-451] > show routing instance default node EIPU-0 static-route config
BFD hold time: 0
Static route: 10.20.153.48/32 Next hop type: normal Rank: not defined
Gateway: 10.16.224.1 Preference: not defined
Hardware 60
BFD monitoring: disabled BFD tx interval: 1000 BFD rx interval: 1000 BFD
BFD monitoring: enabled BFD tx interval: 150 BFD rx interval: 150 BFD det
Gateway: 10.16.224.113 Preference: 4
Hardware 61
** show routing
root@CFPU-0 [RNC-451] > show routing node EIPU-0 route
Codes: C - Connected, S - Static, I - IGRP, R - RIP, B - BGP, O - OSPF
E - OSPF external, A - Aggregate, K - Kernel Remnant, H - Hidden
P - Suppressed
S 1.2.3.4/32 via 10.16.225.81 iubc_r1 cost 0 age 115090

S 1.2.3.5/32 via 10.16.225.97 iubc_r2 cost 0 age 36200
S 10.16.8.128/27 via 10.16.224.161 iucsup_r1 cost 0 age 115090
C 10.16.224/28 is directly connected iucscp1_r1
C 10.16.224.16/28 is directly connected iucscp2_r2
C 10.16.224.96/28 is directly connected iub_r1
C 10.16.224.112/28 is directly connected iub_r2
C 10.16.224.160/28 is directly connected iucsup_r1
C 10.16.224.176/28 is directly connected iucsup_r2
C 10.16.225.48/28 is directly connected oam_wbts_r1
C 10.16.225.64/28 is directly connected oam_wbts_r2
C 10.16.225.80/28 is directly connected iubc_r1
C 10.16.225.96/28 is directly connected iubc_r2
S 10.16.225.152/32 via 169.254.0.133 cfeigw cost 0 age 115092
C 10.16.225.193/32 is directly connected lo
Hardware 62
S 10.16.225.208/29 via 10.16.224.1 iucscp1_r1 cost 0 age 115091
via 10.16.224.17 iucscp2_r2
S 10.16.225.216/29 via 10.16.224.161 iucsup_r1 cost 0 age 115090
S 10.16.225.224/28 via 10.16.224.97 iub_r1 cost 0 age 115090
S 10.16.225.233/32 via 10.16.224.97 iub_r1 cost 0 age 115090
S 10.16.225.234/32 via 10.16.225.49 oam_wbts_r1 cost 0 age 115089
C 169.254/24 is directly connected cfeigw
C 169.254.239/24 is directly connected rnchanet
C 169.254.240/24 is directly connected xaui0
C 169.254.241/24 is directly connected internal
howto see BFD session states
** singlehop BFD states

root@CFPU-0 [RNC-451] > show routing node EIPU-0 bfd
Codes: O -OSPF S -Static
Source Address NextHop Address State Diagnostic

S 10.16.225.84 10.16.225.81 Up No Diagnostic
S 10.16.225.68 10.16.225.65 Up Control Detection Time Expired
** multihop BFD sessions

root@CFPU-0 [RNC-451] > show networking bfd runtime node /EIPU-0
No BFD sessions found on this node
howto translate dxerror codes
** OMS connection command fails, ERROR code reveiced.

** use dxserrcli to check the meaning of error
# fsclish
root@CFPU-0 [RNC-454] > show omsconn
/*** ERROR: 1379 ***/

/*** RNCGEN NOT FOUND ***/
root@CFPU-0 [RNC-454] > quit
# dxserrcli 1379
/*** ERROR: 1379 ***/

/*** RNCGEN NOT FOUND ***/
Hardware 63
zcommand collection
** VRFs in use,
[root@EIPU-0(RNC-453) /root]
# ip r s vrfid 10
10.16.14.246 vrfid 10 proto gated
nexthop via 10.16.14.119 dev iub_r1 weight 1
10.16.14.248 vrfid 10 proto gated
10.16.14.160/28 dev iub_r2 vrfid 10 proto kernel scope link src 10.16.14.166
10.16.14.112/28 dev iub_r1 vrfid 10 proto kernel scope link src 10.16.14.118
169.254.10.0/24 dev cfeigw10 vrfid 10 proto kernel scope link src 169.254.10.6
default vrfid 10 proto gated
# ip a s iub_r1
26: iub_r1: &ltBROADCAST,MULTICAST,UP,RUNNING&gt vrfid 10 mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:b9:93:8e brd ff:ff:ff:ff:ff:ff
inet 10.16.14.118/28 brd 10.16.14.127 scope global vrfid 10 iub_r1
inet6 fe80::d0:c900:1ab9:938e/64 scope link vrfid 10
# ip a s iub_r2
27: iub_r2: &ltBROADCAST,MULTICAST,UP,RUNNING&gt vrfid 10 mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:b9:93:8f brd ff:ff:ff:ff:ff:ff
inet 10.16.14.166/28 brd 10.16.14.175 scope global vrfid 10 iub_r2
inet6 fe80::d0:c900:1bb9:938f/64 scope link vrfid 10
# ip a s iucsup_r1
28: iucsup_r1: &ltBROADCAST,MULTICAST,UP,RUNNING&gt vrfid 12 mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:b9:93:8e brd ff:ff:ff:ff:ff:ff
inet 10.16.13.134/28 brd 10.16.13.143 scope global vrfid 12 iucsup_r1
inet6 fe80::d0:c900:1cb9:938e/64 scope link vrfid 12
# ip a s iucsup_r2
29: iucsup_r2: &ltBROADCAST,MULTICAST,UP,RUNNING&gt vrfid 12 mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:b9:93:8f brd ff:ff:ff:ff:ff:ff
inet 10.16.13.150/28 brd 10.16.13.159 scope global vrfid 12 iucsup_r2
inet6 fe80::d0:c900:1db9:938f/64 scope link vrfid 12
# ping 10.16.14.119 -V 10
PING 10.16.14.119 (10.16.14.119) 56(84) bytes of data.
64 bytes from 10.16.14.119: icmp_seq=1 vrfid=10 ttl=64 time=0.252 ms
64 bytes from 10.16.14.119: icmp_seq=2 vrfid=10 ttl=64 time=0.235 ms
Hardware 64
zcommand collection
** zcommands date back to 2004, when they were intended to be

** a joke, how things can be done in a difficult way.
** they turned to be useful...
** hint: try "man " @RNC
zaho - Print active alarms in readable format

zassoc - show sctp associations under /proc
zcluster-id - modify RNC cluster-id
zdbindex - to view RNV DB objects + few unbinary fields
zdbrnw - access to rnw database
zdoi - Report memory map of a process
zifo - List measurement files.
zindex - false copy of zdbindex
ziwx - component version information
zjane - traffic mirroring, switch configs, counters
zldap - access to ldap
zler - log entry reader
zlic - feature admin state changes
zmon - message monitoring
znode - node states
zplan - RNW plan operation (download,activate,upload)
zpr - process states
zrg - recovery group states
zrole - preferred active roles of RNC SW
zru - recovery unit states
zsxp - convert PRB names to FAM ids.
zsxpi - convert FAM ids to PRB names
ztail - tail the active master-syslog
zusi - state information
zuss - system restart
tcpdumping
*** HOWTO monitor thisandthat using tcpdump

** use tcpdump always with the option -n
** -n Don't convert host addresses to names.
** This can be used to avoid DNS lookups.
** node heartbeats
# tcpdump -i internal port 54000 and host USPU-23.internalnet.localdomain
listening on internal, link-type EN10MB (Ethernet), capture size 96 bytes
08:17:57.846532 (FP) IP USPU-23.internalnet.localdomain.54000 &gt ClusterHA.internalnet.localdo
08:17:57.846527 IP USPU-23.internalnet.localdomain.54000 &gt ClusterHA.internalnet.localdomain.
08:17:58.595500 IP ClusterHA.internalnet.localdomain.58188 &gt USPU-23.internalnet.localdomain.
08:17:58.869032 IP USPU-23.internalnet.localdomain.54000 &gt ClusterHA.internalnet.localdomain.
08:17:59.606315 IP ClusterHA.internalnet.localdomain.58188 &gt USPU-23.internalnet.localdomain.
** external vlan interface, BFD traffic

# tcpdump -i iub_r2 -n port 3784
listening on iub_r2, link-type EN10MB (Ethernet), capture size 96 bytes
11:30:32.533542 IP 10.16.230.116.54000 &gt 10.16.230.113.3784: BFDv1, Control, Flags: [Demand],
Hardware 65
** HAS heartbeats (fullHA) processes **
** HAS DRSP messaging

# tcpdump port 49299 and ip multicast
** useful ports
bfd-control port 3784
btsom 8002/8003
hasnodeagent ( 49299
octeon ethernet stats
** rx_dropped for xaui1 grows fast when external networking

** is suffering
# ssh eipu-2 cat /proc/octeon_ethernet_stats
Octeon Port 0 (xaui0)

rx_packets: 9254977 tx_packets: 7296253
rx_bytes: 1316252543 tx_bytes: 786996373
rx_errors: 0 tx_errors: 0
rx_dropped: 57 tx_dropped: 0
rx_length_errors: 0 tx_aborted_errors: 0
rx_over_errors: 0 tx_carrier_errors: 0
rx_crc_errors: 1 tx_fifo_errors: 0
rx_frame_errors: 0 tx_heartbeat_errors: 0
rx_fifo_errors: 37924497 tx_window_errors: 0
rx_missed_errors: 0 multicast: 1101146
Octeon Port 16 (xaui1)

rx_bytes: 46947447 tx_bytes: 264805782
Octeon Port 40 (fpn0)

rx_bytes: 12044 tx_bytes: 372552784
Hardware 66
interface stats
# ip -s link show oam_r1
13: oam_r1: mtu 1500 qdisc noqueue
link/ether mode virtual 00:d0:c9:bf:2f:fe brd ff:ff:ff:ff:ff:ff
RX: bytes packets errors dropped overrun mcast
218590685 4067287 0 0 0 0
TX: bytes packets errors dropped carrier collsns
408582728 4189798 0 0 0 0
eitputil - packet interface statistics
# eitputil error show
EIPU-0:
----------------- Packet Error Statistics ---------------------------

UDP input IP header length error: 0
UDP input packet total length error: 0
UDP input IP payload length error: 0
UDP input UDP chksum error: 0
GTP downlink packet(mbuf) null: 0
GTP downlink GTP header null error: 0
GTP downlink invalid GTPU packet error: 0
GTP downlink local IP error: 0
GTP downlink DL_TEID error: 0
GTP downlink extended header error: 0
GTP downlink inactive queue full: 0
GTP downlink indication packet error: 0
GTP downlink gtp echo response error: 0
GTP downlink gtp echo request error: 0
GTP downlink data indication timer error: 0
GTP downlink inactive informed queue full: 0
GTP downlink packet sending error: 0
GTP downlink no share memory error: 0
GTP downlink flush over the PS capacity: 0
GTP downlink active over the PS capacity: 0
GTP downlink packet forward error: 0
GTP save data(pool empty): 0
GTP save data(packet number error): 0
TF downlink no entry error: 0
TF downlink flow sending error: 0
TF entry found error: 0
TF UDP sending error: 0
TF MUX MBUF error: 0
TF DMUX preparation error: 0
TF DMUX sending error: 0
Qos process packet(mbuf) null error: 0
Qos process add UDP header error: 0
Qos process add IP header error: 0
Qos process sending packet error: 0
Qos entry invalid scheduler id error: 0
Qos entry invalid queue id error: 0
Qos entry rq ef tail drop: 0
Qos entry rq wfq drop: 0
Qos entry rq wfq red drop: 0
Hardware 67
Qos entry vq drop: 0
Qos dequeue error: 0
Qos to6wind destination ip is 0 error: 0
Qos to6wind prepare exception error: 0
Qos to6wind next hop not found error: 0
Qos to6wind ip output error: 0
UDP output packet error: 0
UDP output add UDP header error: 0
UDP output add IP header error: 0
UDP output DST IP zero error: 0
UDP output find route error: 0
UDP output next hop found error: 0
UDP output forward packet error: 0
TF input entry found error: 4
TF input packet sending error: 0
GTP output packet error: 0
GTP output header error: 0
GTP output packet error: 0
GTP output message type error: 0
GTP output no tunnel error: 0
GTP output no local IP for DL_TEID error: 0
GTP output ip version error: 0
IP addresses:
MGW: 10.16.8.140
SGSN: 10.16.8.181
WBTS-86: 10.16.225.229
WBTS-87: 10.16.225.230
[root@CFPU-0(RNC-451) /root/debug]
# eitputil tae show
EIPU-0:
======
group status connection local-ip local-port dl-teid remote-ip remote-port mux

0X4BED WORK 0X80284 10.16.225.198 10049 NA 10.16.225.229 49651 NO
0X4BED WORK 0X80283 10.16.225.195 1041 NA 10.16.8.140 7161 NO
0X4BED WORK 0X80282 10.16.225.195 1040 NA 10.16.8.140 7160 NO
0X4BED WORK 0X80281 10.16.225.198 10048 NA 10.16.225.229 49650 NO
0X4BED WORK 0XA0204 10.16.225.198 10042 NA 10.16.225.229 49643 NO
0X4BED WORK 0XA0203 10.16.225.198 10041 NA 10.16.225.229 49644 NO
0X4BED WORK 0XA0201 10.16.225.198 10040 NA 10.16.225.229 49642 NO
0X4BED WORK 0X1010CC9C 10.16.225.198 10003 NA 10.16.225.229 49605 NO
0X4BED WORK 0X1010CC8A 10.16.225.198 10001 NA 10.16.225.229 49604 NO
0X4BED WORK 0X1010CC8B 10.16.225.198 10002 NA 10.16.225.229 49603 NO
0X4BED WORK 0X1010CC91 10.16.225.198 10000 NA 10.16.225.229 49602 NO
0X4BEE BACKUP 0X1010FE9C 10.16.225.199 10003 NA 10.16.225.230 49163 NO
0X4BEE BACKUP 0X1010FE8A 10.16.225.199 10001 NA 10.16.225.230 49162 NO
0X4BEE BACKUP 0X1010FE8B 10.16.225.199 10002 NA 10.16.225.230 49161 NO
0X4BEE BACKUP 0X1010FE91 10.16.225.199 10000 NA 10.16.225.230 49160 NO
EIPU-2:
======

0X4BEF WORK 0XA0202 10.16.225.194 2152 0XBEF00002 10.16.8.181 0 NO
EIPU-1:
======
Hardware 68
0X4BED BACKUP 0X80284 10.16.225.198 10049 NA 10.16.225.229 49651 NO
0X4BED BACKUP 0XA0204 10.16.225.198 10042 NA 10.16.225.229 49643 NO
0X4BED BACKUP 0X1010CC9C 10.16.225.198 10003 NA 10.16.225.229 49605 NO
0X4BED BACKUP 0X1010CC8A 10.16.225.198 10001 NA 10.16.225.229 49604 NO
0X4BED BACKUP 0X1010CC8B 10.16.225.198 10002 NA 10.16.225.229 49603 NO
0X4BED BACKUP 0X1010CC91 10.16.225.198 10000 NA 10.16.225.229 49602 NO
0X4BEE WORK 0X1010FE9C 10.16.225.199 10003 NA 10.16.225.230 49163 NO
0X4BEE WORK 0X1010FE8A 10.16.225.199 10001 NA 10.16.225.230 49162 NO
0X4BEE WORK 0X1010FE8B 10.16.225.199 10002 NA 10.16.225.230 49161 NO
0X4BEE WORK 0X1010FE91 10.16.225.199 10000 NA 10.16.225.230 49160 NO
EIPU-3:
======

0X4BEF BACKUP 0XA0202 10.16.225.194 2152 0XBEF00002 10.16.8.181 0 NO
interface stats
** eitputil
# eitputil bootlog show
EIPU-0:
Cavium Networks Octeon SDK version 1.8.1, build 290 ,CPU HZ 800000000
PP6-> 10677 ms after startup, EITP EXCEPTION shared memory start address : 0x94ef80, size: 2112
PP6-> 10739 ms after startup, UDP RANGE shared memory start address : 0x954280, size: 520 .
PP6-> 10739 ms after startup, UDP IPBUF shared memory start address : 0x954500, size: 11776 .
PP6-> 10743 ms after startup, UDP is Initialized successfully.
PP6-> 10754 ms after startup, TAE shared memory start address : 0x190400000, size: 18133088 .
PP6-> 10779 ms after startup, TAE IPBR CONF shared memory start address : 0x957300, size: 32760
PP6-> 10779 ms after startup, TAE is initialized sucessfully.
PP6-> 10797 ms after startup, GTP shared memory start address : 0x19194b080, size: 60099712 .
PP6-> 10837 ms after startup, GTP queue shared memory start address : 0x19529bd00, size: 168001
PP6-> 10872 ms after startup, GTP timer shared memory start address : 0x19529bd00, size: 120000
PP6-> 10880 ms after startup, GTP is initialized sucessfully.
PP6-> 10895 ms after startup, FPA POOL 4 start address : 0x196e13200, size: 860160000 .
PP6-> 10912 ms after startup, FPA POOL 6 start address : 0x1ca263200, size: 27443200 .
PP6-> 10922 ms after startup, FPA POOL 1 start address : 0x1cbc8f200, size: 53760000 .
PP6-> 10938 ms after startup, FPA POOL 3 start address : 0x1cefd4200, size: 6144000 .
... clip ...
# eitputil tae diag
EIPU-0:
======
Base address is 0x55559e1000

TF version is 0X10
TAE version is 0X10
Routing table number for each node is 2
Minimum MTU is 1500.
Delay to send multiplexing packet is 2
Memory consumption is 18133088 bytes.
Diagnosis on routing table 0...
Hardware 69
Routing status is 0X0.
Routing group is 0XFFFF.
Routing unit is 0XFFFF.
Diagnosis on simple table...
Have simple entry 60000
Configure simple entry 60000
60000 entries is free.
0 entries is in use.
Diagnosis on connection table...
Diagnosis on address table...
Diagnosis on one of multiplexing...
First free Multiplexing is 0
Have multiplexing entry 4096
Configure multiplexing entry 4096
Get free Multiplexing entry...
4096 multiplexing entries is free.
Get used Multiplexing entry...
0 multiplexing entries is in use.
Check all Multiplexing entry...
Diagnosis on routing table 1...
Routing status is 0X0.
Routing group is 0XFFFF.
Routing unit is 0XFFFF.
Diagnosis on simple table...
Have simple entry 60000
Configure simple entry 60000
60000 entries is free.
0 entries is in use.
Diagnosis on connection table...
Diagnosis on address table...
Diagnosis on one of multiplexing...
First free Multiplexing is 0
Have multiplexing entry 4096
Configure multiplexing entry 4096
Get free Multiplexing entry...
4096 multiplexing entries is free.
Get used Multiplexing entry...
0 multiplexing entries is in use.
Check all Multiplexing entry...
my wireshark settings
14.02.2012, wireshark version in use:
[root@lostdell software]# rpm -qa | grep wireshark

wireshark-11.1.0-2.i386
** few changes to default settings

--- .wireshark/preferences ---
# Ports on which the packets received by SCTP should be identified as NBAP packet
# A string denoting an positive integer range (e.g., "1-20,30-40").
nbap.sctp.port: 49152-49200
# Use Ciphering for Signaling Radio Bearer establishment (default is FALSE)

# TRUE or FALSE (case-insensitive).
rlc.rlccipher.flag: TRUE
Hardware 70
# The dynamic payload type which will be interpreted as IuUP
# The value should be in the range 96 - 127
# A string denoting an positive integer range (e.g., "1-20,30-40").
iuup.dynamic.payload.type: 96-127
-----
I am still waiting for a proper x86_64 version...
RTE location of a process
** how to find process location?
# fshascli --bare process | grep -i rc3
/CFPU-0/QNCFCPServer-0/QNRC3CFCPPRB
/USPU-0/QNUSCPServer-0/QNRC3USCPPRB
/CFPU-1/QNCFCPServer-1/QNRC3CFCPPRB
** how to search upper level MOIDs

** process is part of the recovery unit: QNUSCPServer-12
** running @USPU-12
# fshascli --parent /USPU-12/QNUSCPServer-12/QNRC3USCPPRB
/USPU-12/QNUSCPServer-12
** Recovery Unit: QNUSCPServer-12

** belongs to Recovery Group: /QNUSCP
# fshascli --parent /USPU-12/QNUSCPServer-12
/USPU-12
/QNUSCP
Hardware 71
ZJANE
** BCN HW MAP
# zjane map
Tue Feb 14 15:35:52 EET 2012 : Show port map
-------------
| BCM56512 |
| extension |
| |
HG0e:-----|0/25 |
HG1e:-----|0/24 |
| |
SFP7:-----|0/1 |
SFP8:-----|0/2 |
SFP9:-----|0/3 |
SFP10:----|0/4 |
SFP11:----|0/5 |
SFP12:----|0/6 |
SFP13:----|0/7 |
SFP14:----|0/8 |
SFP15:----|0/9 |
SFP16:----|0/10 |
SFP17:----|0/11 |
SFP18:----|0/12 |
SFP19:----|0/13 |
SFP20:----|0/14 |
SFP21:----|0/15 |
SFP22:----|0/16 |
-------------
-------------
| BCM56820 |
| main |
SFP1:-----|0/21 |
SFP2:-----|0/22 |
SFP3:-----|0/23 |
SFP4:-----|0/24 |
SFP5:-----|0/1 |
SFP6:-----|0/2 |
| |
CPU1:-----|0/19 xaui0 |
CPU1:-----|0/20 xaui1 |
CPU2:-----|0/17 xaui0 |
CPU2:-----|0/18 xaui1 |
CPU3:-----|0/15 xaui0 |
CPU3:-----|0/16 xaui1 |
CPU4:-----|0/13 xaui0 |
CPU4:-----|0/14 xaui1 |
CPU5:-----|0/11 xaui0 |
CPU5:-----|0/12 xaui1 |
CPU6:-----|0/9 xaui0 |
CPU6:-----|0/10 xaui1 |
CPU7:-----|0/7 xaui0 |
CPU7:-----|0/8 xaui1 |
CPU8:-----|0/5 xaui0 |
CPU8:-----|0/6 xaui1 |
| |
HG0m:-----|0/3 |
Hardware 72
HG1m:-----|0/4 |
-------------
** L2 statistics, SFP7 counters
# zjane ss SFP7
Wed Feb 15 20:01:08 EET 2012 : Getting L2 statistics:
###############################################
show interface ethernet 0/1
Total Packets Received (Octets)................ 10358106464

Packets Received 64 Octets..................... 21167182
Packets Received 65-127 Octets................. 98967722
Packets Received 512-1023 Octets............... 414905
Packets Received 1024-1518 Octets.............. 7676
Packets Received > 1522 Octets................. 0
Packets RX and TX 64 Octets.................... 38328201
Packets RX and TX 65-127 Octets................ 182832025
Packets RX and TX 512-1023 Octets.............. 938314
Total Packets Received Without Errors.......... 126940982

Unicast Packets Received....................... 104718184
Multicast Packets Received..................... 1121901
Broadcast Packets Received..................... 21100897
Total Packets Received with MAC Errors......... 0

Jabbers Received............................... 0
Fragments Received............................. 0
Undersize Received............................. 0
Alignment Errors............................... 0
FCS Errors..................................... 0
Overruns....................................... 0
Total Received Packets Not Forwarded........... 0

Local Traffic Frames........................... 0
802.3x Pause Frames Received................... 0
Unacceptable Frame Type........................ 0
Multicast Tree Viable Discards................. 0
Reserved Address Discards...................... 0
Broadcast Storm Recovery....................... 0
CFI Discards................................... 0
Upstream Threshold............................. 0
Total Packets Transmitted (Octets)............. 20731629524

Packets Transmitted 64 Octets.................. 17161019
Packets Transmitted 65-127 Octets.............. 83864303
Packets Transmitted 512-1023 Octets............ 523409
Packets Transmitted 1024-1518 Octets........... 8677158
Hardware 73
Max Frame Size................................. 1522
Total Packets Transmitted Successfully......... 110882440

Unicast Packets Transmitted.................... 110880557
Multicast Packets Transmitted.................. 568
Broadcast Packets Transmitted.................. 1315
Total Transmit Errors.......................... 0

FCS Errors..................................... 0
Tx Oversized................................... 0
Underrun Errors................................ 0
Total Transmit Packets Discarded............... 0

Single Collision Frames........................ 0
Multiple Collision Frames...................... 0
Excessive Collision Frames..................... 0
Port Membership Discards....................... 0
802.3x Pause Frames Transmitted................ 0

GVRP PDUs received............................. 0
GVRP PDUs Transmitted.......................... 0
GVRP Failed Registrations...................... 0
GMRP PDUs Received............................. 0
GMRP PDUs Transmitted.......................... 0
GMRP Failed Registrations...................... 0
STP BPDUs Transmitted.......................... 0

STP BPDUs Received............................. 0
RSTP BPDUs Transmitted......................... 0
RSTP BPDUs Received............................ 0
MSTP BPDUs Transmitted......................... 0
MSTP BPDUs Received............................ 0
EAPOL Frames Transmitted....................... 0

EAPOL Start Frames Received.................... 0
Time Since Counters Last Cleared............... 26 day 6 hr 40 min 18 sec
(mcrnc-451_lmp-1-1-1_ext) #
ruoste
[root@CFPU-0(RNC-451) /opt/nokiasiemens/pac_ruoste_e1/script]
# ./start_ruoste.sh
Usage: ./start_mcruoste.sh [-wbts(=)] [-help|?]

[-dist] ([-distunit=]) ([-nonmap])
[-rncwcel -sortbts|-sortcid|-sortlcr]
------ Detailed switch explanations ------
-help|? prints out this help text
-dist prints out BTS distribution to CSPUs
-distunit= prints out BTS info related to certain CSPU
-nonmap prints out also BTSs that are not mapped to
any CSPU
-rncinfo prints out RNC-OMS connection related parameters
-wcelstatus prints out WCEL runtime data, suboptions
-blocked outputs only WCELs in some blocked state
-state= outputs only WCELs with given state bits on,
enter value as hex bitmask of one or more of below
Hardware 74
values
0x0000: WO
0x0001: BL-USER (U)
0x0002: BL-WF-COCO (W)
0x0004: BL-FL-COCO (C)
0x0008: BL-WBTS (B)
0x0010: BL-SHUTDOWN (H)
0x0020: BL-SYSTEM (S)
0x0040: BL-INIT (I)
0x0080: BL-FL-LINK (L)
0x0100: BL-FL-MEAS (M)
0x0200: BL-LO-WBTS (Ub)
0x0400: BL-NO-CELL (N)
0x0800: BL-POWER (P)
-wbts= list of WBTSs to be included in the WCEL printout,
separated with commas (if omitted, all the WBTSs
found are selected)
-cid= list of CId values for WCELs to be printed out,
separated with commas (if omitted, all the WCELs
found are selected)
-wbtsstatus prints out WBTS runtime data, suboptions
-wbts= list of WBTSs to be included in the WBTS printout,
separated with commas (if omitted, all the WBTSs
found are selected)
-rncwcel prints out WCEL states in RNC level, suboptions:
-sortbts sorts WCEL list based on BTS ID (default)
-sortcid sorts WCEL list based on Cell ID
-sortlcr sorts WCEL list based on LCR ID
Examples:
./start_mcruoste.sh -wcelstatus -wbts=1
./start_mcruoste.sh -dist
./start_mcruoste.sh -distunit=0,1,2
./start_mcruoste.sh -wcelstatus -state=2
[root@CFPU-0(RNC-451) /opt/nokiasiemens/pac_ruoste_e1/script]
# ./start_ruoste.sh -wcelstatus
-------------------------------------------------------------------------------
Operation starting at: 15-02-2012 09:44:10.12
-------------------------------------------------------------------------------
- WCEL related information from RNW database -
- WBTS: Shows the WBTS ID -
- WCEL: Shows the WCEL Local Cell Identifier (LCRId) -
- C-ID: Shows the WCEL Cell Identifier (C-ID) -
- State: WCEL state (WO or a list of BL-states) -
- See command help '-?' for BL character explanations. -
- HSDPA: Enabled (Y/N), BTS reported capability (Y/N/?) -
- HSUPA: Enabled (Y/N), BTS reported capability (Y/N/?) -
- DC-HSDPA: Enabled (Y/N), BTS reported capability (Y/N/?) -
- MIMO: Enabled (Y/N), BTS reported capability (Y/N/?) -
- HS-FACH: Enabled (Y/N), BTS reported capability (Y/N/?) -
- -
- Question mark indicates that value in RNW DB is not set. -
-------------------------------------------------------------------------------
WBTS WCEL C-ID State HSDPA HSUPA DC- HS- MIMO
HSDPA FACH
-------------------------------------------------------------------------------
WBTS-86 WCEL-8601 8601 WO Y/Y Y/Y N/N N/? N/N
WBTS-87 WCEL-8701 8701 WO Y/Y Y/Y N/N N/? N/N
-------------------------------------------------------------------------------
Handled successfully 2 WBTSs, 2 matching WCELs.
Hardware 75
Operation completed at: 15-02-2012 09:44:10.13
-------------------------------------------------------------------------------
coredump handling in (RELEASE_MODE) builds
** core dump
# ls /srv/Log/crash/USPU-5-7129-4f3a69d2-rrcprb-ABRT.core
/srv/Log/crash/USPU-5-7129-4f3a69d2-rrcprb-ABRT.core
** available debuginfo packages

# ls -1 *debuginfo*
SS_ILLibgen-debuginfo-3.10.1.16.6743-R_IL_3.10.1.16.2.WR.mips_rb.rpm
pac_rrc_qx_e1-debuginfo-promoted.31756-R_QNCB.11.41.1_33.WR.mips_rb.rpm
** RPM extraction
# rpm2cpio pac_rrc_qx_e1-debuginfo-promoted.31756-R_QNCB.11.41.1_33.WR.mips_rb.rpm | cpio -ivd
# rpm2cpio SS_ILLibgen-debuginfo-3.10.1.16.6743-R_IL_3.10.1.16.2.WR.mips_rb.rpm | cpio -ivd
** library address in rrcprb

# ldd /opt/nokiasiemens/pac_rrc_qx_e1/bin/rrcprb | grep libgen
liblnx-libgen.so => /opt/nokiasiemens/lib64/liblnx-libgen.so (0x0000005555dd8000)
** start GDB, open core against the real binary

# gdb /opt/nokiasiemens/pac_rrc_qx_e1/bin/rrcprb /srv/Log/crash/USPU-5-7129-4f3a69d2-rrcprb-ABR
...
Reading symbols from /opt/nokiasiemens/lib64/libalarmlight.so...
(no debugging symbols found)...done.
Loaded symbols for /opt/nokiasiemens/lib64/libalarmlight.so
Reading symbols from /opt/nokiasiemens/lib64/libilfunitex.so...(no debugging symbols found)...d
Loaded symbols for /opt/nokiasiemens/lib64/libilfunitex.so
Reading symbols from /mnt/sysimg/usr/lib64/libxslt.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib64/libxslt.so.1
Reading symbols from /opt/nokiasiemens/lib64/libilhas.so...(no debugging symbols found)...done.
Loaded symbols for /opt/nokiasiemens/lib64/libilhas.so
Core was generated by `/opt/nokiasiemens/pac_rrc_qx_e1/bin/rrcprb'.

Program terminated with signal 6, Aborted.
#0 0x00000055561c81f4 in epoll_wait () from /lib64/libc.so.6
(gdb)
** read rrcprb symbols

(gdb) symbol-file /root/debug/opt/nokiasiemens/pac_rrc_qx_e1/bin/rrcprb.debug
Reading symbols from /root/debug/opt/nokiasiemens/pac_rrc_qx_e1/bin/rrcprb.debug...done.
** add symbol-file for a library, address is needed here

(gdb) add-symbol-file /root/debug/opt/nokiasiemens/lib64/liblnx-libgen.so.debug 0x0000005555dd8
add symbol table from file "/root/debug/opt/nokiasiemens/lib64/liblnx-libgen.so.debug" at
.text_addr = 0x5555dd8000
(y or n) y
Reading symbols from /root/debug/opt/nokiasiemens/lib64/liblnx-libgen.so.debug...done.
** take the full bt
Hardware 76
Reading symbols from /root/debug/opt/nokiasiemens/lib64/liblnx-libgen.so.debug...done.
(gdb) t a a bt full
Thread 8 (process 7130):

#0 0x00000055561bc848 in poll () from /lib64/libc.so.6
No symbol table info available.
#1 0x0000005555cc820c in Timlib::TimerManager::waitForTimeoutEvents () from /opt/nokiasiemens/
#2 0x0000005555cc8560 in Timlib::TimerManager::handleTimeout () from /opt/nokiasiemens/lib64/l
#3 0x0000005555cc85e8 in Timlib::TimerManager::run () from /opt/nokiasiemens/lib64/libhaslib.s
...
fsddiag - fastdist diag tool
** configuration check
# fsddiag show config linux
config_info read from Linux:
FASTDIST_CONFIG_MEM: 800000000094e400
mac(xaui0): 00:d0:c9:b9:82:f4
octeon_port: 0
pko_internal_port: 4
vlan_enabled: 0
vlan_id: 804
mtu: 2048
core_group[EITP]: -1
core_group[CSUP]: -1
core_group[USUP]: -1
core_group[CRUP]: -1
# fsddiag show config SE EITP-0
config_info read from SE:
mac(xaui0) : 00:d0:c9:b9:82:55
octeon_port : 0
pko_internal_port : 4
vlan_enabled : 1
vlan_id : 804
mtu : 2048
core_group[EITP] : 9
core_group[CSUP] : -1
core_group[USUP] : -1
core_group[CRUP] : -1
** counter clearance
# fsddiag show counters zero EITP-0
FSDDIAG RECEIVE RESET ENTITY RESULT: Success!
** counters
# fsddiag show counters entity EITP-0
FSDDIAG RECEIVE SHOW ENTITY RESULT:

-----------------------------------
PDU_UNKOWN [0x0]
PDU_ERR_ENCODING [0x0]
---
Hardware 77
recv packet from UP info:
FASTDIST_RECV_FROM_UP_TOTAL_PACKETS [0x1e1]
FASTDIST_RECV_FROM_UP_TOTAL_BYTES [0xe890]
FASTDIST_RECV_DATA_PDU [0x1e1]
FASTDIST_RECV_CONTROL_PDU [0x0]
FASTDIST_RECV_SUCCESS [0x1e1]
FASTDIST_ERR_UNEXPECTED_FRAG [0x0]
FASTDIST_ERR_WQE_ALLOC_FAILED [0x0]
FASTDIST_ERR_FLOW_UNEXISTED [0x0]
FASTDIST_ERR_INVALID_LOGIC_ADDR [0x0]
FASTDIST_ERR_TOO_MANY_SEGS [0x0]
FASTDIST_ERR_DEST_UNKNOWN [0x0]
FASTDIST_ERR_TOO_MANY_SEGS_FOR_WQE [0x0]
FASTDIST_ERR_UNKNOWN_PDU [0x0]
FASTDIST_ERR_FLOW_EXISTED [0x0]
FASTDIST_ERR_FLOW_UNAVALIABLE [0x0]
FASTDIST_ERR_IFC_UNREGISTERED [0x0]
FASTDIST_ERR_BAD_FLOW_TABLE_STATE [0x0]
FASTDIST_ERR_BAD_FLOW_TABLE_ID [0x0]
FASTDIST_ERR_FLOW_DOUBLE_FREE [0x0]
FASTDIST_ERR_BAD_FASTDIST_FRAME [0x0]
FASTDIST_ERR_CHECK_FLOW_HEALTH_TIME_OUT [0x0]
FASTDIST_ERR_CHECK_FLOW_HEALTH_PENDING [0x0]
FASTDIST_ERR_SAME_CONN_IN_DIFFERENT_WO_TABLES [0x0]
FASTDIST_ERR_BAD_ETH_FRAME [0x0]
FASTDIST_ERR_FLOW_HEALTH_HANDLER_UNREGISTERED [0x0]
FASTDIST_ERR_INTERNAL [0x0]
FASTDIST_ERR_NOMEM [0x0]
FASTDIST_ERR_UNINITIALIZED [0x0]
FASTDIST_ERR_INVALID_PARAM [0x0]
***********************************
send packet to UP info:
FASTDIST_SEND_TO_UP_TOTAL_PACKETS [0x1c4]
FASTDIST_SEND_TO_UP_TOTAL_BYTES [0xe07c]
FASTDIST_SEND_SUCCESS [0x1c4]
FASTDIST_ERR_PKO_SEND_FAIL [0x0]
FASTDIST_ERR_DEST_UNAVAIL [0x0]
FASTDIST_ERR_UNEXPECTED_FRAG [0x0]
FASTDIST_ERR_WQE_ALLOC_FAILED [0x0]
FASTDIST_ERR_FLOW_UNEXISTED [0x0]
FASTDIST_ERR_INVALID_LOGIC_ADDR [0x0]
FASTDIST_ERR_TOO_MANY_SEGS [0x0]
FASTDIST_ERR_DEST_UNKNOWN [0x0]
FASTDIST_ERR_TOO_MANY_SEGS_FOR_WQE [0x0]
FASTDIST_ERR_UNKNOWN_PDU [0x0]
FASTDIST_ERR_FLOW_EXISTED [0x0]
FASTDIST_ERR_FLOW_UNAVALIABLE [0x0]
FASTDIST_ERR_IFC_UNREGISTERED [0x0]
FASTDIST_ERR_BAD_FLOW_TABLE_STATE [0x0]
FASTDIST_ERR_BAD_FLOW_TABLE_ID [0x0]
FASTDIST_ERR_FLOW_DOUBLE_FREE [0x0]
FASTDIST_ERR_BAD_FASTDIST_FRAME [0x0]
FASTDIST_ERR_CHECK_FLOW_HEALTH_TIME_OUT [0x0]
FASTDIST_ERR_CHECK_FLOW_HEALTH_PENDING [0x0]
FASTDIST_ERR_SAME_CONN_IN_DIFFERENT_WO_TABLES [0x0]
FASTDIST_ERR_BAD_ETH_FRAME [0x0]
FASTDIST_ERR_FLOW_HEALTH_HANDLER_UNREGISTERED [0x0]
FASTDIST_ERR_NOT_INITIALIZED [0x0]
FASTDIST_ERR_INTERNAL [0x0]
FASTDIST_ERR_NOMEM [0x0]
FASTDIST_ERR_UNINITIALIZED [0x0]
Hardware 78
FASTDIST_ERR_INVALID_PARAM [0x0]
-----------------------------------
iltrmcli - troubleshooting tool for cacprb
# iltrmcli -S -a
====== TRANSPORT RESOURCE INFORMATION LIST ===============================================
IP_ADDR:[TEID/PORT] TYPE IPBR_ID OWNER_ID BANDWIDTH VRF_ID
--------------------------------------------------------------------------------------------
10.16.225.198:10058 UDP 86 7 12569 0
10.16.225.198:10059 UDP 86 7 517 0
10.16.225.198:10060 UDP 86 7 0 0
10.16.225.199:10000 UDP 87 30 833 0
10.16.225.199:10001 UDP 87 30 18787 0
10.16.225.199:10002 UDP 87 30 0 0
10.16.225.199:10003 UDP 87 30 0 0
10.16.225.198:10000 UDP 86 31 833 0
10.16.225.198:10001 UDP 86 31 18787 0
10.16.225.198:10002 UDP 86 31 0 0
10.16.225.198:10003 UDP 86 31 0 0
10.16.225.194:BEF00005 GTP 2 7 0 0
============================================================================================
# iltrmcli -S -g all
====== TRANSPORT RESOURCE INFORMATION LIST ===============================================
IP_ADDR:[TEID/PORT] TYPE IPBR_ID OWNER_ID BANDWIDTH VRF_ID
--------------------------------------------------------------------------------------------
10.16.225.194:BEF00005 GTP 2 7 0 0
============================================================================================
test_responder connectivity check
# !410
wget http://10.23.52.131:8080/responder/sign?challenge=Foo-1:12345678:1234567890qwerty:123456
--19:56:46-- http://10.23.52.131:8080/responder/sign?challenge=Foo-1:12345678:1234567890qwerty
=> `sign?challenge=Foo-1:12345678:1234567890qwerty:123456.5'
Connecting to 10.23.52.131:8080... connected.
HTTP request sent, awaiting response... 200 OK
Length: 3,526 (3.4K) [text/xml]
100%[====================================>] 3,526 --.--K/s
19:56:49 (829.11 KB/s) - `sign?challenge=Foo-1:12345678:1234567890qwerty:123456.5' saved [3526/
Computer unit,Family id,Family Name,Supervision time
issue 2
issue 3
After the ftp is complete, could you send FAFA msg to DCH & send me the capture text.
./dmxsend -h *,1500,800,0,0,0,0,fafa
Hardware 79
I would like to check if there are any packet drops in the RNC user plane.
issue 4
ctrl-c, ctrl-v
issue 5
ctrl-c, ctrl-v
Hardware 80

MCRNC Troubleshooting PDF

Caricato da

Informazioni sul documento

Titolo originale

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

MCRNC Troubleshooting PDF

Caricato da

Copyright:

Formati disponibili

mcrnc - troubleshooting

complete page in a pdf format: mcrnc troubleshooting

1. howto check mcrnc cabling

10. howto check LMPs IP connectivity

1. commissioning FAILED - lock file exists

6. howto install patches

1. howto check interface states

4. VRFs change the normal commands

5. howto translate dx error codes

Q: commissioning failed - lock file exists

DEBUG:lock file exists

remember to reset your session before you try to reinstall

[root@myfews ~]# fsetupcli session reset mc455

check the HDD

Q: howto mount RNC SW delivery (ISO image)

[root@myfews ~]# mkdir -p /mnt/mypoint/v

** when you are done REMEMBER to unmount

** hint: use losetup for loop device control (man losetup) **

what is the storage location for esw

root@a1fews_hp2 script]# mount | grep 1_31

** esw delivery is located @

howto find initial switch configs

** switch initial scripts can be found from:

root@a1fews_hp2 script]# pwd; ls bcn*initial*

howto install patches

WARNING: You used --skip-mount.

2 patch(es) applied under tags:pac_rek_qx_e1-2.1562-R_QNCB.11.41.1_31.WR.mips_rv.rpm

** patch DB, patch history

few useful RPM tricks

** query all installed RPMs

** to which RPM this file belongs?

** RPM dump, including md5sums

** for DIY guys

** tailor your own query output

.versionlabelinfo section in binaries

Hex dump of section '.versionlabelinfo':

BCN1 BCN2 BCN3 BCN4 BCN5 BCN6

Checking that all relevant SFP+-ports are up, exit if not:

Checking the cables are connected according to the schema:

howto check mcrnc clustering

howto check port state (external SFP states)

** m10 and m40 SFP states below.

howto check port config

** m10 LMPs main switch interface (eth0.800) config

** m60 external SFP20 (megamon port) config

howto mirror ports

See also: my wireshark settings

** how to check mirroring state

Bit Pattern monitoring MAIN SWITCH 10:

Bit Pattern monitoring MAIN SWITCH 20:

Bit Pattern monitoring MAIN SWITCH 40:

Bit Pattern monitoring MAIN SWITCH 50:

Bit Pattern monitoring MAIN SWITCH 60:

Session ID Admin Mode Probe Port Mirrored Port Type

Session ID Admin Mode Probe Port Mirrored Port Type

Session ID Admin Mode Probe Port Mirrored Port Type

Session ID Admin Mode Probe Port Mirrored Port Type

Session ID Admin Mode Probe Port Mirrored Port Type

** NOTE: LAN1,LAN2 cannot be monitored using zjane.

[..] -- multiple nodes linked with this addin

Green color indicates available nodes

LMP-1-1-1 : node available /cabinet-1/chassis-1/piu-1

how warm is my rnc

hint: use losetup for loop device control (man losetup)

root@a1fews_hp2 script]# pwd; ls bcninitial