Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
5 NW PARTNER TRAINING
Data Loading from Flat File to BW to BPC
BPC has a protected namespace (/CPMB/). This prevents BPC from directly
interacting with much of the BW environment. Note: this feature is by design allow
independence of the data model from corporate EDW processes and models.
BPC has an unique data model (no BW Time or Unit of Measure characteristics.
This feature requires transformation of the inbound BW data into the BPC data model.
BPC is a single key figure model, while BW data models are typically multiple key
figure based. This feature also therefore requires a transformation of the inbound BW
data to allow loading the BPC data model
Planning data needs to be aggregated to a higher level than data typically used fro
actual reporting (i.e.: planning data is usually presented in monthly buckets, while BW
reporting data may be weekly or even daily).
The above considerations require specific designs to efficiently move data from ECC
into BW, and then into a BPC environment. Fortunately Netweaver has the Extract,
transform, and load (ETL) tools to make this job easy!
Extractors small programs that make data connections to systems outside of the
home BW system. These extractors can modify the form of the data (i.e.: change field
from 8 characters to 6).
Business Application Programming Interface (BAPI) is used to extract data from nonSAP sources. BAPI serves the purpose of connecting third- party ETL tools to SAP BW.
DB connect allows the extraction of data directly from the underlying database
Data Transfer Processes (DTPs) are used within BW to transfer data from one data
target to another (i.e.: from the PSA to an info provider)
0FIGL_C10 record:
Staging Cube:
DTP Load
BPC
DM Load
0FIGL_C10 Cube
Data Flow
Z_STAGE Cube
Filtered in DTP
SAP
BusinessObjects
Planning and
Consolidation
SAP NetWeaver
BW EDW
SAP ERP
Planning and
Consolidation
P_ACCT
0G\L_Account
Extractor
General Ledger
Account
BPC FI
Planning
Cube
FI/CO
Actual
Cube
Extractor
FI/CO or
other
Flat File
0FIGL_C10
Z_STAGE
/CPMB/PLANNING cube
1.
2.
3.
Info Providers
Info Providers are the central multidimensional data model in BW. An Info Provider
describes a self-enclosed data set encompassing one or more related business
processes.
There are several types of Info Providers :
Source Systems
Flat Files for which metadata is maintained manually by BI and data is transferred to BI
using a file interface
Database management systems into which data is loaded from a database supported by
SAP using DB Connect without using an external extraction program
Relational or multidimensional sources that are connected to BI using UD connect
Web Services that transfer data to BI by means of a push
Non-SAP systems for which data and metadata is transferred using staging BAPIs
Flat File
0FIGL_C10
Z_STAGE
Flat File SS
InfoPackage
DTP
0FIGL_C10
/CPMB/PLANNING cube
Source Systems
Source system type is determined in the source systems area of the Data Warehousing
Workbench
DataSource Systems
A DataSource comprises the quantity of logically related fields that provide the data for a
business unit for data transfer to BI. You need to create a separate DataSource for
transaction data and for Master data (each for Texts, Attributes and hierarchies). The
data source in the exercises identifies where the flat file is located.
InfoPackage
An InfoPackage determines what data from which DataSource and from which source
system are requested and written to the BI entry layer, the Persistent Staging Area
(PSA).
Transformation
Transformation process defines mapping rules and ability to aggregate and filter data
Transformation
Transformation process allows to map the source fields to the target fields
Source
2010 SAP AG. All rights reserved. / Page 18
Target
Transformation
Click on each arrow (mapping rule) to view the rule details. Accept system generated
proposal:
Transformation
Transformation rules can be created to provide target defintion when ther is no source.
In the exercise example, the target Fiscal Variant field is defined by a rule that sets this
to a constant value (K1).
Transformation
Transformation rules can in some cases be very simple. In the example below, the
transformation provides a Direct Assignment between the source and the target fields.
No conversion routines are used in this mapping definition.
0FIGL_C10 cube
Chart of accounts
Mapped
0CHRT_ACCTS
Company code
Mapped
0COMP_CODE
Controlling area
Mapped
0CO_AREA
Cost Center
Mapped
0COSTCENTER
Currency Type
Constant
0CURTYPE
Functional area
Mapped
0FUNC_AREA
G/L Account
Mapped
0GL_ACCOUNT
Profit Center
Mapped
0PROFIT_CTR
Constant
0SEGMENT
Valuation View
Constant
0VALUATION
Constant
0VTYPE
10
Version
Constant
0VERSION
V00
Mapped
0BALANCE
Mapped
0DEBIT
Mapped
0CREDIT
Const Value
00
Transformation
0FIGL_C10 cube
Fiscal year
Mapped
0FISCYEAR
Mapped
0FISCPER
Mapped
0FISCVARNT
Posting period
Mapped
0FISCPER3
DTP
Data Transfer Processes (DTPs) are used to transfer data within BW from the PSA to
another object (0FIGL_C10 in the example shown) in accordance with transformations
and filters.
Data Flow
0FIGL_C10 Cube
Staging Cube
0FIGL_C10
Z_STAGE
/CPMB/PLANNING cube
Flat File SS
InfoPackage
DTP
0FIGL_C10
Z_STAGE
InfoCubes
Object Overview of the 0FIGL_C10 cube (note the use of four key figures!)
Staging Cube
Staging cubes are used extensively within BPC to summarize data from multiple
sources and to pre-format data.
Note that the number of info objects and key figures are significantly different
from the 0FIGL_C10 cube. A major function of the staging cube is to organize the
BW key figure based data model into an account based (single key figure based)
data model.
Transformation
Chart of accounts
0CHRT_ACCTS
Company code
0COMP_CODE
Not Mapped
Controlling area
0CO_AREA
Concatenated w/ PCN
Cost Center
0COSTCENTER
Not Mapped
Currency Type
0CURTYPE
Not Mapped
Functional area
0FUNC_AREA
Not Mapped
G/L Account
0GL_ACCOUNT
==>
Profit Center
0PROFIT_CTR
Concatenated w/CO_AREA
0SEGMENT
Not Mapped
Valuation View
0VALUATION
Not Mapped
0VTYPE
Not Mapped
Version
0VERSION
Not Mapped
Cumulative Balance
0BALANCE
==>
0SALES
Not Mapped
0DEBIT
==>
0CREDIT
==>
Z_STAGE Cube
Z_ACCT (Account)
0FIGL_C10 cube
Transformation
Fiscal year
0FISCYEAR
Not Mapped
0FISCPER
==>
FISCPER
0FISCVARNT
==>
0FISCVARNT
Posting period
0FISCPER3
Not Mapped
0CURRENCY
Not Mapped
Change Run ID
0CHNGID
Not Mapped
Record type
0RECORDTP
Not Mapped
Request ID
0REQUID
Not Mapped
Unit:
Currency key
Other fields:
Z_STAGE Cube
Transformation
Within the transformation definition, rules can be created to provide additional technical
transformations between source to target data. In the exercise, the 0FIGL_C10 field
FISCPER field mapped to 0FISPER field of Z_STAGE cube the technical mapping id
relatively simple: a seven character field is mapped into a seven numeric field. This
mapping is easy to perform since the system recognizes 0FISCPER as a specific
characteristics called a Time Characteristics, and thereby has an arsenal of predefined
functions (called conversion routines) to convert one time format into another.
In the exercises associated with this presentation, a DTP is created to move the data
from the 0FIGL_C10 cube into the Z_STAGE staging cube
0FIGL_C10 record:
Staging Cube:
DTP Load
Z_STAGE Cube
0CHRT_ACTS record
with value 2 is
Filtered in DTP
Once the staging cube is loaded the next process uses standard BPC ETL tools
(Data Manager packages) to load the data from the staging cube into the BPC
application.
Data Manager will use a standard BPC mapping tool, call a transformation file to map
the fields fro the source to the target data model.
A conversion file is used to changed the format of some source data (fiscal period)
into the standard BPC time format YYYY.MMM).
A standard Data Manager package brings all of these objects together (source,
target, transformation, and conversion).
SAP
0FIGL_C10
Z_STAGE
/CPMB/PLANNING cube
Flat File SS
InfoPackage
DTP
BPC DM Pkg
0FIGL_C10
Z_STAGE
BPC Cube
Mapping
/CPMB/PLANNING
Z_PCN
ENTITY
Z_ACTY
P_Activity
Z_ACCT
GL_ACCT
RptCurreny = LC (constant)
0FISCPER
TIME
SignedData
Z_STAGE Cube
0FIGL_C10 Cube
Data Flow
Z_STAGE Cube
Filtered in DTP
SAP
BPC
NetWeaver BW
Example
Key figure
models
Possible
Not possible
Financial Logic
Modeled in
various ways
Handled in
ShareQueryEngine
Time
Modeled in 13
different
InfoObjects
Modeled in one
Time dimension
Currency
Handled similar to
SAP ERP using
currency types
Leverages entities
currency and LC
0BALANCE 0CREDIT
0DEBIT
$66,000.00 $50,790.00 $51,650.00
BPC
P_Activity
BALANCE
F00
CREDIT
F10
DEBIT
F20
Amount
$66,000.00
$50,790.00
$51,650.00
0CURRENCY
USD
0UNIT
each
RPTCurrency
LC
each
Format Challenges
Transforming SAP NetWeaver BW data into the SAP BusinessObjects Planning and
Consolidation one key figure model, as described in the previous section, is usually not enough
to ensure an error-free load of SAP NetWeaver BW data into SAP BusinessObjects Planning
and Consolidation
Several format conversions may be required to allow data to flow into SAP BusinessObjects
Planning and Consolidation. We will examine the following:
Data signage conversion
Date format conversion
Definition of constant values
Removal of leading zeros: ALPHA conversion
Removal of special characters from alphanumeric SAP ERP material numbers
In order to keep an audit trail, any transformed data should be stored in a custom
InfoObject along with the original data. So for example, keep 0MATERIAL for the
original SAP ERP material number but create a custom object to store the
material number in SAP BusinessObjects Planning and Consolidation format.
BPC Date
Amount
2010.JAN
100,000
2010.MAY
150,000
If you use Fiscal Period to populate the SAP BusinessObjects Planning and
Consolidation time dimension then your conversion is slightly different, as the
period is stored as YYYYPPP in SAP NetWeaver BW
2010 SAP AG. All rights reserved. / Page 65
Additonal details
Thank you