s Tivoli Errors Description: 1. 2. 3. 4. 5. 6. Backup process failed after reaching at considerable level (such as 80-90%).

Drives in Tivoli Storage Manager were getting offline. Server License Compliance failed. Some scheduled backup was not properly running at designated duration. TSM Server services were running over each client. StorageAgent service is also running on servers whose backup goes through LAN. 7. sysback utility was not working properly. Observations: 1. Backup process failed after reaching at considerable level (such as 80-90%)
05/14/08 22:36:17 05/14/08 22:36:17 05/14/08 22:36:17 05/14/08 22:36:17 05/14/08 22:36:17 05/14/08 22:36:17 05/14/08 22:36:17 ANR8447E No drives are currently available in library 3310LIB. (SESSION: 97443) ANR1404W Scratch volume mount request denied mount failed. (SESSION: 97443) ANR8447E No drives are currently available in library 3310LIB. (SESSION: 97443) ANR1401W Mount request denied for volume SDR335L3 mount failed. (SESSION: 97443) ANR8447E No drives are currently available in library 3310LIB. (SESSION: 97443) ANR1401W Mount request denied for volume SM0343L3 mount failed. (SESSION: 97443) ANR0525W Transaction failed for session 97443 for node SEMPRD_SAP (TDP R3 AIX) storage media inaccessible. (SESSION: 97443)

Logs Collected from BRTOOLS

BR0280I BRBACKUP time stamp: 2008-05-14 23.28.15 #FILE..... /oracle/SEP/sapbackup/cntrlSEP.dbf #SAVED.... SEP___A0FG80ZDZY BKI0023I: Time: Wed May 14 23:30:11 2008 Done: 54.074 GB (90.1 %) of 60.015 GB. Estimated end time: Wed May 14 23:51:31 2008. BKI0053I: Time: Wed May 14 23:30:11 2008 Object: 25 of 27 done: /oracle/SEP/sapdata1/sysaux_1/sysaux.data1 with: 200.008 MB saved with description SEP___A0FG80ZDZY. BR0280I BRBACKUP time stamp: 2008-05-14 23.30.12 #FILE..... /oracle/SEP/sapdata1/sysaux_1/sysaux.data1 #SAVED.... SEP___A0FG80ZDZY BKI1215I: Average transmission rate was 18.826 GB/h MB/sec). BKI1227I: Average compression factor was 1.00. BKI0020I: End of program at: Wed May 14 23:30:13 2008 .

(5.355

BKI0021I: Elapsed time: 03 h 14 min 14 sec . BKI0024I: Return code is: 2. BR0280I BRBACKUP time stamp: 2008-05-14 23.30.13 BR0279E Return code from '/usr/sap/SEP/SYS/exe/run/backint -u SEP -f backup -i /oracle/SEP/sapbackup/.bdxxobhk.lst -t file -p /oracle/SEP/102_64/dbs/initSEP.utl -c': 2 BR0232E 24 of 27 files saved by backup utility BR0280I BRBACKUP time stamp: 2008-05-14 23.30.13 BR0231E Backup utility call failed BR0280I BRBACKUP time stamp: 2008-05-14 23.30.18 BR0317I 'Alter database end backup' successful BR0056I End of database backup: bdxxobhk.anf 2008-05-14 23.30.13 BR0280I BRBACKUP time stamp: 2008-05-14 23.30.18 BR0054I BRBACKUP terminated with errors BR0280I BRBACKUP time stamp: 2008-05-14 23.30.18 BR0291I BRARCHIVE will be started with options '-U -jid ALLOG20080207201553 -d util_file -c force -p initSEP.sap -cds' BR0280I BRBACKUP time stamp: 2008-05-14 23.31.05 BR0292I Execution of BRARCHIVE finished with return code 5

2.

Drives in Tivoli Storage Manager were getting offline.

05/12/08 20:15:20 05/12/08 20:15:23 ANR0511I Session 93264 opened output volume SDR334L3. (SESSION: 93264) ANR8965W (Session: 93229, Origin: PLMPRD_SAN)The server is unable to automatically determine the serial number for the device. (SESSION: 93229) ANR8963E (Session: 93229, Origin: PLMPRD_SAN) Unable to find path to match the serial number defined for drive 3310RMT1 in library 3310LIB . (SESSION: 93229) ANR0408I Session 93273 started for server PLMPRD_SAN (AIX-RS/6000) (Tcp/Ip)for Library sharing.(SESSION: 93273) ANR0408I (Session: 93229, Origin: PLMPRD_SAN) Session 2987 started for server TSM (AIX-RS/6000) (Tcp/Ip) for library sharing. (SESSION: 93229) ANR0409I (Session: 93229, Origin: PLMPRD_SAN) Session 2987 ended for server TSM (AIX-RS/6000). (SESSION: 93229) ANR8873E (Session: 93229, Origin: PLMPRD_SAN) The path from source PLMPRD_SAN to destination 3310RMT1 (/dev/rmt1) is taken offline. (SESSION: 93229) ANR1772E The path from source PLMPRD_SAN to destination 3310RMT1 is taken offline.

05/12/08 20:15:23

05/12/08 20:15:23 05/12/08 20:15:23

05/12/08 20:15:23 05/12/08 20:15:23

05/12/08 20:15:23

(SESSION: 93273)

3.

Server License Compliance failed.

05/12/08 20:14:11 ANR2841W Server is NOT IN COMPLIANCE with license terms. (SESSION: 93224)

4.

Some scheduled backup was not properly running at designated duration.

5.

sysback versions are not supporting the current version of AIX versions (AIX 5.3)

Solution: 1. Activity logs were checked. 2. Output of several commands are redirected to a single file and sent to Senthil Kumar.
q q q q q q q q q q q q q q q q q q q q q q q q q admin f=d > /tmp/tsmconfig.out node f=d >> /tmp/tsmconfig.out status >> /tmp/tsmconfig.out license >> /tmp/tsmconfig.out server f=d >> /tmp/tsmconfig.out option >> /tmp/tsmconfig.out db f=d >> /tmp/tsmconfig.out dbvol f=d >> /tmp/tsmconfig.out log f=d >> /tmp/tsmconfig.out logvol f=d >> /tmp/tsmconfig.out spacetrigger db >> /tmp/tsmconfig.out spacetrigger log >> /tmp/tsmconfig.out script f=d >> /tmp/tsmconfig.out sched t=a f=d >> /tmp/tsmconfig.out sched f=d >> /tmp/tsmconfig.out association >> /tmp/tsmconfig.out domain f=d >> /tmp/tsmconfig.out policyset * active f=d >> /tmp/tsmconfig.out mgmtclass * active f=d >> /tmp/tsmconfig.out copy * active f=d >> /tmp/tsmconfig.out copy * active t=a f=d >> /tmp/tsmconfig.out stgpool f=d >> /tmp/tsmconfig.out devclass f=d >> /tmp/tsmconfig.out libr f=d >> /tmp/tsmconfig.out drive f=d >> /tmp/tsmconfig.out

q path f=d >> /tmp/tsmconfig.out q drmstatus >> /tmp/tsmconfig.out

3. lscfg vp output was collected and sent. 4. Logs such as /tmp/dsmerror.log and /tmp/dsmsched.log were required to analyze the problem. If the logs files were not there put an entry in /usr/tivoli/tsm/client/ba/bin/dsm.sys file for generation of these error logs. Log files created and permissions were changed. 5. Database/SAP backup logs collected and sent for analysis. 6. Information about Operating System (such as OS version, ML and service pack for Windows), Application versions, Tivoli Client version and Cluster versions were collected. 7. Extra entries which are to be entered in dsm.sys file are as follows for generation of log files:
tcpwindowsize tcpbuffsize tcpnodelay largecommbuffers txnbytelimit errorlogname schedlogname schedlogretention passwordaccess 256 512 yes yes 2097152 /tmp/dsmerror.log /tmp/dsmsched.log 30 D generate

8. Drive mappings were changed to match the serial no. (Offline Problem)
tsm: TSM> update path CRMPRD_SAN 3310rmt3 libr=3310lib srctype=server desttype=drive device=/dev/rmt1 online=yes

9. Domain of TDMS has been changed from WINDOM to SAPDOM

tsm: TSM> update node tdms dom=sapdom Reason for change: WINDOM has a retention period of 7 days while SAPDOM has a retention period of 21 days.

10. Configurations of non-existing tape library 3582 has been removed from Tivoli. 11. License problem resolved (Non-Compliance to license terms)
No of license has been increased from 59 to 70 tsm: TSM>register license file=mgsyslan.lic number=70

Conclusion: Check the backup schedule and drive mappings so that further backup will go smoothly.