Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Table of Contents
1 Introduction........................................................................................................................................ 1
2 Processing.......................................................................................................................................... 1
2.1 System Flow Chart........................................................................................................................ 1
2.2 Pre- job Requirements.................................................................................................................. 5
2.3 Post-job Requirements.................................................................................................................. 6
2.4 Inputs............................................................................................................................................ 7
2.4.1 Credit Facility Interface file..................................................................................................... 7
2.4.2 External Customer Address/Location Interface file............................................................12
2.4.3 HUB Regional Code Mapping..............................................................................................23
2.5 Data Transformation.................................................................................................................... 23
2.5.1 Pre-Requisites...................................................................................................................... 23
2.5.2 Source to Target Mapping.................................................................................................... 24
2.5.3 Derivation Logic................................................................................................................... 35
2.5.4 Constraints........................................................................................................................... 36
2.6 Error handling Procedures.......................................................................................................... 37
2.6.1 Rejects Handling.................................................................................................................. 37
2.6.2 Backup / Recovery Procedures............................................................................................ 37
2.6.3 Error Codes Definitions........................................................................................................ 37
2.6.4 Others.................................................................................................................................. 37
2.7 Outputs........................................................................................................................................ 38
2.7.1 Customer Address/Location Interface..................................................................................38
3 History Processing & Comparison.................................................................................................43
4 Detail Job Information...................................................................................................................... 43
4.1 Connection Information............................................................................................................... 43
4.2 Job Parameters........................................................................................................................... 43
4.3 Routines / Functions Defined...................................................................................................... 43
.
1 Introduction
This is a Source Extraction program, which retrieves all the information relating to Credit Facility from
HUB system and non-HUB systems and merge them into the Credit Facility Interface file before loading
them into HEW R2 Database, also local code are converted to regional code from code mapping table.
It involving some transformation process to handle the field name mapping, data type changes and simple
data cleansing. The data type change is conversion from Varchar data type in external sequential file to
data type of target dataset, this also involves validating date field value and reject / defaulting invalid/null
values.
An Audit/ Reject handling process is also included as part of the job.
2 Processing
2.1 System Flow Chart
The high level design is illustrated as follows:
BI Staging
REGCODEXREF
1
CRED_FACIL_ARR_INTERFACE_HEW_01.txt
..
4
CRED_FACIL_ARR_INTERFACE_HEW_10.txt 6
Regional Code
Mer Lookup
ge CRED_FACIL_ARR_I
2 NTERFACE_HEW
External Data Validation
External system
CRED_FACIL_ARR_INTERFACE
_HEW 3
Audit/Reject handling
.
Here is the description of the above process:
The detailed design for Job Design - To Credit Facility Combined Interface is illustrated as follows:
djpHewr2CMBITF_CRED-FACIL_ARR_INTERFACE_HEW1
.
Stage Name Stage Type Description
Source Stages
Sequential File
fsqCRED_FACIL_ARR_INTERFACE_HEWred Stage This stage inputs data from
CRED_FACIL_ARR_INTERFACE_HEW*.txt file
fsqEXT_LOC_ARR_INTERFACE_HEWred Sequential File This stage inputs data from external systems to the
Stage job.
Processing Stages
This Stage combines the records from
fnlLocArrInterface Funnel Stage db2CRED_FACIL_ARR_INTERFACE_HEWsel and
fsqEXT_CRED_FACIL_ARR_INTERFACE_HEWred
respectively.
tfpExtLocArrInterface Transformer This stage performs data cleansing, defaulting and
Stage field splitting for input data.
db2REGCODEXREFlkp DB2/UDB This stage is used to lookup the regional codes from
Enterprise the table REGCODEXREF.
lkpRegcodexref Lookup Stage This stage is used to lookup regional codes from
db2REGCODEXREFlkp
cpyRateTypCde Copy Stage This Stage is used to make three copy of RateType
CdeTable
cxpLocArrInterface Column Export To concatenate the source key columns using pipe
Stage separator to be appended to rejected records.
This Stage combines the reject records from
fnlRejLocArrInterface Funnel Stage tfpExtLocArrInterface and cxpLocArrInterface
respectively.
tfpLocArrInterface Transformer This stage performs data cleansing, defaulting and
Stage field splitting for input data.
modrejLocArrInterface Modify Stage This stage is used to handle Null for field
START_DT
Target Stages
fsqRej_CMBITF_LOC_ARR_INTERFACE_HEWwrt Sequential File This stage is used to store rejected data coming
Stage from column export stage cxpRejSegmInterface
fdsLOC_ARR_INTERFACE_HEWwrt Dataset Stage This stage stores all the processed data coming
from tfpLocArrInterface.
.
Job 2: It will Upsert the data in
CRED_FACIL_ARR_INTERFACE_HEW table
.
djpHewr2CMBITF_CRED-FACIL_ARR_INTERFACE_HEW2
.
Stage Name Stage Type Description
Source Stages
Sequential File
fsqCRED_FACIL_ARR_INTERFACE_HEWred Stage This stage inputs data from
CRED_FACIL_ARR_INTERFACE_HEW*.txt file
fsqEXT_LOC_ARR_INTERFACE_HEWred Sequential File This stage inputs data from external systems to the
Stage job.
Processing Stages
This Stage combines the records from
fnlLocArrInterface Funnel Stage db2CRED_FACIL_ARR_INTERFACE_HEWsel and
fsqEXT_CRED_FACIL_ARR_INTERFACE_HEWred
respectively.
tfpExtLocArrInterface Transformer This stage performs data cleansing, defaulting and
Stage field splitting for input data.
db2REGCODEXREFlkp DB2/UDB This stage is used to lookup the regional codes from
Enterprise the table REGCODEXREF.
lkpRegcodexref Lookup Stage This stage is used to lookup regional codes from
db2REGCODEXREFlkp
cpyRateTypCde Copy Stage This Stage is used to make three copy of RateType
CdeTable
cxpLocArrInterface Column Export To concatenate the source key columns using pipe
Stage separator to be appended to rejected records.
This Stage combines the reject records from
fnlRejLocArrInterface Funnel Stage tfpExtLocArrInterface and cxpLocArrInterface
respectively.
tfpLocArrInterface Transformer This stage performs data cleansing, defaulting and
Stage field splitting for input data.
modrejLocArrInterface Modify Stage This stage is used to handle Null for field
START_DT
Target Stages
fsqRej_CMBITF_LOC_ARR_INTERFACE_HEWwrt Sequential File This stage is used to store rejected data coming
Stage from column export stage cxpRejSegmInterface
fdsLOC_ARR_INTERFACE_HEWwrt Dataset Stage This stage stores all the processed data coming
from tfpLocArrInterface.
.
Job 2: It will Upsert the data in
CRED_FACIL_ARR_INTERFACE_HEW table
e.g.
EXT_CRED_FACIL_ARR_INTERFACE_HEW _SRC1.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW _SRC2.txt
Nullable field will have string value NULL.
DATE field format should be yyyy-mm-dd.
.
2.4 Inputs
2.4.1 Credit Facility Interface file
2.4.1.1 Overview
Its Sequential file that contains Customer Address/Location information.
There are total 11 files as per 11 source jobs
CRED_FACIL_ARR_INTERFACE_HEW_01.txt
CRED_FACIL_ARR_INTERFACE_HEW_02.txt
CRED_FACIL_ARR_INTERFACE_HEW_03.txt
CRED_FACIL_ARR_INTERFACE_HEW_04.txt
CRED_FACIL_ARR_INTERFACE_HEW_05.txt
CRED_FACIL_ARR_INTERFACE_HEW_06.txt
CRED_FACIL_ARR_INTERFACE_HEW_07.txt
CRED_FACIL_ARR_INTERFACE_HEW_08.txt
CRED_FACIL_ARR_INTERFACE_HEW_09.txt
CRED_FACIL_ARR_INTERFACE_HEW_10.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
Table 1: CRED_FACIL_ARR_INTERFACE_HEW (List only the fields related to the design)
.
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
Sl
Column Name Data Type Nullable Definition
No.
CRNCY_LIMIT_CDE VARCHAR
13. No Currency Limit Code
CRNCY_CRED_LIMIT_CDE
LIMIT_CURR_AMT VARCHAR
15. No Limit Current Amount
CRED_LIMIT_CURR_AMT
.
19. RVW_DT VARCHAR No Review Date
START_DT VARCHAR
22. No Start date of Account
LMT_GRNT_DT
LMT_TYPE_CDE VARCHAR
27. No Instruction Amount
CRED_LMT_TYPE_CDE
31. PYMT_PRSL_LOC_CURR DECIMAL(16,3) Yes Payment Personal Credit Facility Current Amount
.
46. INT_MAX_RATE_TYPE_CDE VARCHAR(3) Yes Interest Maximum Rate Type Code
.
74. PRICE_INT_TYPE VARCHAR(10) Yes Pricing Interest Type
.
2.4.1.2 File format
Sequential files
.
2.4.2 External Customer Address/Location Interface file
2.4.2.1 Overview
Its sequential file that contains data information about Customer Address/Location from external
systems.
.
P:EXT_CRED_FACIL_ARR_INTERFACE_HEW*.txt
Sl
Column Name Data Type Nullable Definition
No.
CRNCY_LIMIT_CDE VARCHAR NO
13. Currency Limit Code
CRNCY_CRED_LIMIT_CDE
LIMIT_CURR_AMT VARCHAR NO
15. Limit Current Amount
CRED_LIMIT_CURR_AMT
.
20. CASH_RISK_PCT VARCHAR NO Cash Risk Percent
START_DT VARCHAR NO
22. Start date of Account
LMT_GRNT_DT
LMT_TYPE_CDE VARCHAR NO
27. Instruction Amount
CRED_LMT_TYPE_CDE
.
47. INT_SPRD_MAX_RATE VARCHAR NO Interest Spread Maximum Rate
.
75. INT_CR_CALC_CDE VARCHAR NO Interest Credit Calculation Code
.
2.4.2.3 NLS Considerations
UTF -8
.
EXT_CRED_FACIL_ARR_INTERFACE_HEW_<*>.txt
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
S. No. Column Name Source Data Source Target Data Type Target Nullable
Type Nullable
13. CRNCY_LIMIT_CDE No
VARCHAR VARCHAR(3) Yes
CRNCY_CRED_LIMIT_CDE
15. LIMIT_CURR_AMT No
VARCHAR DEC (16,3) Yes
CRED_LIMIT_CURR_AMT
.
EXT_CRED_FACIL_ARR_INTERFACE_HEW_<*>.txt
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
S. No. Column Name Source Data Source Target Data Type Target Nullable
Type Nullable
22. START_DT No
VARCHAR DATE Yes
LMT_GRNT_DT
27. LMT_TYPE_CDE No
VARCHAR VARCHAR( 3) Yes
CRED_LMT_TYPE_CDE
.
EXT_CRED_FACIL_ARR_INTERFACE_HEW_<*>.txt
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
S. No. Column Name Source Data Source Target Data Type Target Nullable
Type Nullable
.
EXT_CRED_FACIL_ARR_INTERFACE_HEW_<*>.txt
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
S. No. Column Name Source Data Source Target Data Type Target Nullable
Type Nullable
.
EXT_CRED_FACIL_ARR_INTERFACE_HEW_<*>.txt
CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
S. No. Column Name Source Data Source Target Data Type Target Nullable
Type Nullable
.
2.4.2.5 Character Conversion
1. The nullable character fields from the input will be cleansed:
- Nullable field will have string value NULL convert it to NULL.
- Space and Empty String will convert to NULL.
- Remove all the leading and pending space and make it left justified.
ARR_START_DT
PARNT_ARR_START_DT Reject if invalid/Null/Blank values
ACCT_STAT_LAST_DT
PARNT_ARR_REL_START_DT
SETUP_DT
START_DT
PYMT_NEXT_DT
CALC_PYMT_DT
PYMT_GRACE_PRD_DT If invalid/Null/Blank Default to 0001-01-01
INT_DEBIT_NEXT_DATE
AUTH_XPR_DT
CALC_PYMT_LAST_DT
TRAN_ATMC_PYRL_LAST_DT
INT_DEBIT_LAST_DATE
RVW_DT
STMT_LAST_DT
TRAN_LAST_DT If invalid/Null/Blank Default to 9999-12-31
DATA_XTRCT_LAST_DT
DUE_DT
.
2.4.2.7 File format
DB2 UDB Table
.
2.4.3 HUB Regional Code Mapping
2.4.3.1 Overview
This file maintains the various local code and corresponding regional code mapping.
2.5.1 Pre-Requisites
N.A.
.
2.5.2 Source to Target Mapping
Table 5: Source to Interface Mapping.
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
1. Direct Mapping
CHNG_TYPE VARCHAR (12) No No CHNG_TYPE VARCHAR (12)
1
2. Direct Mapping
ARR_SRCE_KEY VARCHAR( 25) No No ARR_SRCE_KEY VARCHAR( 25)
3
4. Direct Mapping
SRCE_SYS_CDE VARCHAR( 6) No No SRCE_SYS_CDE VARCHAR( 6)
2
5. No Direct Mapping No
PARNT_ARR_SRCE_KEY VARCHAR( 25) PARNT_ARR_SRCE_KEY VARCHAR( 25)
5
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
22. START_DT Direct Mapping (see section 2.4..2.6 to validate date START_DT
19 DATE Yes from external source) Yes DATE
LMT_GRNT_DT START_LMT_GRNT_DT
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
Scenario Description :
Sep No Column Name Data Type Nullabl Nulla Column Name Data Type
e ble
Derivation Logic
CRED_FACIL_ARR_INTERFACE_HEW CRED_FACIL_ARR_INTERFACE_HEW_*.txt
CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt
EXT_CRED_FACIL_ARR_INTERFACE_HEW.txt
.
.
2.5.3 Derivation Logic
REGCODEXREF.LOCAL_CDE = P: CRED_FACIL_ARR_INTERFACE_HEW.
REAS_LOAN_CDE REGCODEXREF.TABLE_NAME = HEW_REAS_LOAN_CDE
REGCODEXREF.SRCE_SYS_CDE = P: CRED_FACIL_ARR_INTERFACE_HEW.SRCE_SYS_CDE
.
S. TABLE_NAME Parent fields in target database
No. Child fields Nullable
(REGIONALXREF)
HEW_RATE_TYPE_CDE
7. INT_MAX_RATE_TYPE_CDE Yes LOCAL_CDE + SRCE_SYS_CDE + Table name
.
ARR_TYPE_CDE HEW_ ARR_TYPE_CDE Yes LOCAL_CDE + SRCE_SYS_CDE + Table name
2.5.4 Constraints
N.A
.
2.6 Error handling Procedures
Please refer to the Project Error Handling Document for the project-wide error-handling standard.
JOB_NAME djpHewr2CMBITF_CRED_FACIL_ARR_INTERFACE_HEW1
TABLE_NAME CRED_FACIL_LMT_ARR_INTERFACE_HEW.txt ,
EXT_CRED_FACIL_ARR_INTERFACE_HEW*.txt
Rej_CMBITF_CRED_FACIL_ARR_INTERFACE_HEW2.txt
JOB_NAME djpHewr2CMBITF_CRED_FACIL_ARR_INTERFACE_HEW2
2.6.4 Others
N.A.
.
2.7 Outputs
2.7.1.1 Overview
The Credit Facility Interface is a Data Stage dataset file that contains information about Line of Credit.
.
P:CRED_FACIL_ARR_INTERFACE_HEW
Sl
Column Name Data Type Nullable Definition
No.
Change Type
INSERT = for new records
1. CHNG_TYPE VARCHAR(12) No
UPDATE = for changed records
DELETE = for deleted records
CRNCY_LIMIT_CDE
13. VARCHAR(3) Yes Currency Limit Code
CRNCY_CRED_LIMIT_CDE
LIMIT_CURR_AMT
15. DECIMAL(16,3) Yes Limit Current Amount
CRED_LIMIT_CURR_AMT
.
START_DT
22. DATE Yes Start date of Account
LMT_GRNT_DT
LMT_TYPE_CDE
27. VARCHAR(3) Yes Instruction Amount
CRED_LMT_TYPE_CDE
31. PYMT_PRSL_LOC_CURR DECIMAL(16,3) Yes Payment Personal Credit Facility Current Amount
.
49. INT_SPRD_MIN_RATE DECIMAL(11,8) Yes Interest Spread Minimum Rate
.
77. MV_LCL_AMT DECIMAL(23,3) Yes Market Value Amount
2.7.1.4 Pre-Requisites
N.A.
.
3 History Processing & Comparison
N.A.