arun.

varadarajan: BIA Index rollup

Posted by Arun Varadarajan 20 Aug, 2008
The follow up to my previous blog on BIA Index build - I decides to look into the index rollup
*Index rollup : </p><p>After the BIA index is built - the subsequent data loads will have to be rolled
up into the BIA for reporting. If this is not done then the data will not be available for reporting. This
process is the same as rolling up a request into an Aggregate. Here there is no compress after rollup
option - the data is compressed by default and the BIA does something called Vertical compression /
column compression instead of the standard row level compression that we are all familiar about.
</p><p>Caution : Even if you switch off the BIA Indices for reporting - the rollup is required.*Get the list of
requests that are to be rolled up. Here there is a BIA Index but no Aggregate.
RSS2_DTP_RNR_SUBSEQ_PROC_SET GET_INSTANCE_FOR_RNR

633666 LINE 43

RSS2_DTP_RNR_SUBSEQ_PROC_SET GET_TSTATE_FOR_RNR 2 LINE 243

Status transition 2 / 2 to 7 / 7 completed successfully
RSS2_DTP_RNR_SUBSEQ_PROC_SET SET_TSTATE_FURTHER_START_OK LINE 261
Set the status of reporting on the cubes before rolling up the BIA Index.<br /
><br /><CUBE> ACT
<br /
><CUBE> ACT
<br /><CUBE>
ACT
<br /><br />Statistics UID of indexing
job: '4AVGUJ241MF68T94VA6S7GTU5' (RSDDSTATTREX/RSDDSTATTREXSERV)<br /
><br />Generate statistics for the cube - this is similar to Indexing - have found the same<br /
>job getting triggered when INdex creation happens.+Start indexing the S Tables first...
<br /><br /><CUBE> ACT
<br /><CUBE>
ACT
<br />Loading data to index BIW_BIC:SYBSPACK
(records '0000000002', job '0' )<br />YF2IG_C07 ACT
<br />Caution: Key figure '<XXXXX>' is of type "FLOAT"
<br />Caution:
Key figure '<XXXXX>' is of type "FLOAT"
<br />Caution: Key figure
'<XXXXX>' is of type "FLOAT"
<br />Caution: Key figure '<XXXXX>'
is of type "FLOAT"
<br />Caution: Key figure '<XXXXX>' is of type
"FLOAT"
<br />Caution: Key figure '<XXXXX>' is of type "FLOAT"
<br />Caution: Key figure '<XXXXX>' is of type "FLOAT"
<br /
>Caution: Key figure '<XXXXX>' is of type "FLOAT"
<br />Caution: Key
figure '<XXXXX>' is of type "FLOAT"
<br /><CUBE1> ACT
</
p><p>
<br />Here it also checks where else these characteristics /
index on S table is used in BIA and indicates if those cubes are active or not.<br /><br />Loading data
to index BIW_BIC:XYBSPACK (records '0000000002', job '0' ) Total number of indexed reocrds in
index 'BIW_BIC:SYBSPACK' after COMMIT: '2'<br />Loading data to index BIW_BIC:SYMATERL
(records '0000000007', job '0' )<br /><CUBE> ACT
<br /><CUBE> ACT
<br />Loading data to index

Generated by Jive on 2015-10-26+01:00

1

arun.varadarajan: BIA Index rollup

BIW_BIC:<CHARACTERISTIC> (records '0000000007', job '0' )<br />Total number of indexed reocrds
( Looks like a type in SAP.. )in index 'BIW_BIC:<CHARACTERISTIC>' after COMMIT: '7'<br />Loading
data to index BIW_BIC:<CHARACTERISTIC> (records '0000000002', job '0' )<br />Total number of
indexed reocrds in index 'BIW_BIC:<CHARACTERISTIC>' after COMMIT: '2'<br />Loading data to index
BIW_BIC:F<CUBE> (records '0000043030', job '0' )
<br />Total number of indexed reocrds in index
'BIW_BIC:F<CUBE>' after COMMIT: '43,030'<br />Loading data to index BIW_BIC:D<CUBE>P (records
'0000000001', job '0' )
<br />Roll up BIA index
<br />Statistics UID of indexing job: '<JOB ID>' (RSDDSTATTREX/RSDDSTATTREXSERV)<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index of master data
table(s) for InfoObject '<CHARACTERISTIC>' </p><p>Here all the characteristics indicated as nav attributes
of the characteristic liested above are indexed.</p><p><br />This includes Nav Attributes and also other
characteristics whch are part of the master and also part of the data load.</p><p><br />Index for table
'<NAV ATTR>' is being processed
<br />Index for table '<CHARACTERISTIC>'
is being processed
<br />Index for table '<CHARACTERISTIC>'
is being processed
<br />Index for table '<CHARACTERISTIC>' is
being processed
<br />Index for table '<CHARACTERISTIC>' is
being processed
<br />Index for table '<CHARACTERISTIC>' is
being processed
<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Index for table '<CHARACTERISTIC>' is being processed
<br />Index for table '<CHARACTERISTIC>' is being processed
<br /
>Index for table '<CHARACTERISTIC>' is being processed
<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index of
master data table(s) for InfoObject '<CHARACTERISTIC>'<br />Index for table '<NAV ATTR>'
is being processed
<br />Index for table '<CHARACTERISTIC>' is
being processed
<br />Index for table '<CHARACTERISTIC>' is being
processed<br />Index for table '<CHARACTERISTIC>' is being processed
<br />Index of master data table(s) for InfoObject '<NAV ATTR>'
<br />Index for table '<NAV ATTR>' is being processed
<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index for
table '<CHARACTERISTIC>' is being processed
<br />Index for table
'<CHARACTERISTIC>' is being processed
<br /><br />Check which
index to load - Main Index or Delta Index...this is for the SID Tables.<br /><br />Delta mode
for index '<NAV ATTR>' set to 'Off' (duration: '0.035387')
<br />Read-/fill mode:
'D' (Restriction by JOIN with 'RSDDTREXNEWSID')
<br />Index of master data
table(s) for InfoObject 'YSKU7'
<br />Index for table '<NAV ATTR>' is being
processed
<br />Delta mode for index '<NAV ATTR>' set to 'Off' (duration:
'0.052726')
<br />Read-/fill mode: 'D' (Restriction by JOIN with 'RSDDTREXNEWSID') </
p><p>The restriction by Join comes because a Join Index is being created between the S table and
X table</p><p>This is because of the Nav Attribute being indexed..more information on Join Indexes
</p><p>
<br />No new data for index of table '<NAV ATTR>' <br /><br />*Other
characteristics that are not part of any master table are being indexed.*<br />
<br />Index for table '<CHARACTERISTIC>' is being processed
<br />Index

Generated by Jive on 2015-10-26+01:00

2

arun.varadarajan: BIA Index rollup

for table '<CHARACTERISTIC>' is being processed<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Index for table '<CHARACTERISTIC>' is being processed<br /
>Index for table '<CHARACTERISTIC( Line ITEM)>' is being processed<br />Delta mode for index
'SYBILLDOCU' set to 'Off' (duration: '2.243841')
<br />Read-/fill mode: 'D' (Restriction by JOIN with
'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index filled
(written records '25'):<br />Prepare optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Commit
optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Index for table '<CHARACTERISTIC>'
is being processed
<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Index for table '<MASTER CHARACTERISTIC>' is being
processed<br />Delta mode for index '<CHARACTERISTIC>' set to 'Off' (duration: '0.046333')<br />Read-/
fill mode: 'D' (Restriction by JOIN with 'RSDDTREXNEWSID')
<br />Index of master data
table(s) for InfoObject 'YCUSTMER'
<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Delta mode for index '<CHARACTERISTIC>' set to 'Off' (duration:
'0.011561')<br />Read-/fill mode: 'D' (Restriction by JOIN with 'RSDDTREXNEWSID')
<br />No new data for index of table '<CHARACTERISTIC>'
<br /
>Index for table '<CHARACTERISTIC>' is being processed
<br /
>Index for table '<CHARACTERISTIC>' is being processed
<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index for
table '<CHARACTERISTIC>' is being processed
<br />Index for table
'<CHARACTERISTIC>' is being processed
</p><p>
<br />Delta mode for index
'<CHARACTERISTIC>' set to 'Off' (duration: '0.050789')<br />Read-/fill mode: 'D' (Restriction by JOIN
with 'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index
filled (written records '2'):<br />Prepare optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br /
>Index of master data table(s) for InfoObject '<CHARACTERISTIC>'<br />Index for table
'<CHARACTERISTIC>' is being processed
<br />Delta mode for index
'<CHARACTERISTIC>' set to 'Off' (duration: '0.038126')<br />Read-/fill mode: 'D' (Restriction by JOIN
with 'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index
filled (written records '2'):<br />Prepare optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br /
>Commit optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Commit optimize for
BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Index for table '<CHARACTERISTIC>' is
being processed
<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Delta mode for index '<CHARACTERISTIC>' set to 'Off' (duration:
'0.048498') <br />Read-/fill mode: 'D' (Restriction by JOIN with 'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index filled (written records '7'):<br /
>Prepare optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Index of master data
table(s) for InfoObject '<CHARACTERISTIC>'<br />Index for table '<CHARACTERISTIC>' is being
processed
<br />Delta mode for index '<CHARACTERISTIC>' set to 'Off' (duration:
'0.009456') Read-/fill mode: 'D' (Restriction by JOIN with 'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index filled (written records '7'):<br />Prepare
optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Commit optimize for BIA subindex
'BIW_BIC:<CHARACTERISTIC>':<br />Commit optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':
<br /><br />Commit optimize:+

Generated by Jive on 2015-10-26+01:00

3

arun.varadarajan: BIA Index rollup

The previously optimized data is made visible. <br />If you perform rollback for an index, the system
rolls back the data to the last commit optimize. <br />[Source | http://help.sap.com/saphelp_nw2004s/
helpdata/en/43/5391420f87a970e10000000a155106/content.htm] :<br /><br />Basically since
this is a master data index - guess the rollback of master data is being built in for if you roll back a
request in the master data - the commit optimize takes over here.<br />
<br /
>Index for table '<CHARACTERISTIC>' is being processed
<br />Index
for table '<CHARACTERISTIC>' is being processed
<br />Index for table
'<CHARACTERISTIC>' is being processed
<br />Delta mode for index
'<CHARACTERISTIC>' set to 'Off' (duration: '0.055343')<br />Read-/fill mode: 'D' (Restriction by JOIN with
'RSDDTREXNEWSID')
<br />Index 'BIW_BIC:<CHARACTERISTIC>' for BIA index filled
(written records '2'):<br />Prepare optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Commit
optimize for BIA subindex 'BIW_BIC:<CHARACTERISTIC>':<br />Index for table '<CHARACTERISTIC>' is
being processed <br /><br />Now the fact table is being indexed :<br /><br />Index for table 'F<CUBE>'
is being processed
<br />Delta mode for index 'F<CUBE>' set to 'Off' (duration:
'2.155832')
<br />Read from 'F-' fact table
<br />Index
'BIW_BIC:F<CUBE>' for BIA index filled (written records '43030'):
<br />Prepare optimize
for BIA subindex 'BIW_BIC:F<CUBE>':
<br />Commit optimize for BIA subindex
'BIW_BIC:F<CUBE>':
</p><p>
<br />43030 records only and gets finished quite
quickly - took about 1-2 minutes or so<br />Had to remove the times for easier presentation<br /><br /
>Now the dimension tables get indexed.*Request Index : Index 'BIW_BIC:D<CUBE>P' for BIA index filled
(written records '1'):<br />Prepare optimize for BIA subindex 'BIW_BIC:D<CUBE>P':
<br />Commit optimize for BIA subindex 'BIW_BIC:D<CUBE>P':
<br />Index for table 'D<CUBE>1' is being processed
<br />Index
for table 'D<CUBE>3' is being processed
<br />Index for table
'D<CUBE>2' is being processed
<br />Index for table 'D<CUBE>6'
is being processed
<br />Index for table 'D<CUBE>4' is being
processed
<br />BIA index for InfoCube '<CUBE>' rolled up
successfully
</p><p>Now this is also request based - based on the number or requests
that are to be rolled up the set of activities above will repeat...*Now a check is made to check if there are
any aggregates on the cube that have to be rolled up.<br />In this case there are'nt any...<br />No rollup
necessary
<br />Rollup is finished: Data target <CUBE>, from
633,526 to 633,666
<br />Job finished
<br />
Net net the BIA index rollup is fine .. only issues observed so far are :
1. Rollup after addition of Nav Attributes to the cube - sometimes warnings are shown...
2. Deletion of data - it deletes from the BIA index also - but then sometimes gets locked and in most cases
requires a full Index rebuild. - here you can see a check box for Delete from BIA Indices in the selective
deletion window - have'nt tried it out yet..
Will see if I can put together something on Maintenance activities for BIA after this... and have some
presentations on BIA which should come in handy to publish some more material.
Arun Varadarajan

Generated by Jive on 2015-10-26+01:00

4

arun.varadarajan: BIA Index rollup

777 Views

hemant vyas
4 Nov, 2009 9:23 AM
hi
a good analysis of the things happening behind the scenes. I was wondering what are implications of not rolling
up data in BIA indexes besides no availability of data for reporting. may be you can throw some light on that.
I want to know about data extraction from cubes on BIA etc.
Arun Varadarajan in response to Manabu Matsudate on page 5
21 Aug, 2008 2:19 AM
Manabu,
We usually roll up using the process chain - was not able to locate the job through the process chain and to
spare me the effort - we had a load to be done to the cube that had to be rolled up manually - I had taken the
job log from this.
Arun
Manabu Matsudate
21 Aug, 2008 2:13 AM
Customer tends to forget to schedule roll up.
You can roll up by Process Chain(later than SPS13)
or scheduling report program "RSDDK_AGGREGATES_ROLLUP".
http://help.sap.com/saphelp_nw70/helpdata/EN/1c/5491420f87a970e10000000a
155106/frameset.htm

Generated by Jive on 2015-10-26+01:00

5