Properties of Objective

measures
Lecture 35/22-10-09
 Properties of Objective Measures
• Inversion property:
Consider the bit vectors shown below:

A B C D E F • 0 & 1 in each col

vector represents
0
1 0 0 1 0 whether a tr (row)
0
0 0 1 1 1 contains a particular
0
0 0 1 1 1 item(col)
0 1 0 1 1
1
0 0 1 1 0 • E.g. A represents that
1
1 0 1 0 0 “A’ is present in I and
0
last tr

•Clearly, C and E are inverted form of A.

•The process of flipping the bit vector is called inversion.

•If a measure M is invariant under Inversion, then its value for pair
(C,D) should be identical to its value for (A,B)
• The inversion property of a measure M
can be tested as follows:
– Inversion Property: A measure M is invariant
under inversion op. if its value remains same when
exchanging the frequency counts f11 with f00 and f10 with
f01.
– Ø-coeff remains invariant .
– Consider Ø-coeff of (C,D) and (A,B), they are same
even though items C and D appear together more
frequently than A and B.
– Compute it????
• Also, Ø( E,F) > Ø(C,D)
Even though items E and F occur together only once.
• For asymm binary data, measures that do
not remain invariant (remains variant)
under inversion op are preferred.
• Such measures are Interest factor, IS
factor and Jaccard coeff. Compute I(A,B),
I(C,D).
• 2. NULL ADDITION Property:
– The process of addition of unrelated adta to a
given data set is known as NULL ADDITION
operation.

• DEfn: An obj measure M is invariant under Null

add. Op. if it is not affected by increasing f00 ,
while all other frequencies in the contingency
table remain same.
– IS(cosine) , Jaccard measures satisfy this property.
– Interest factor, Ø-coeff do not satisfy this property.
• 3. Scaling Property:
– Consider the following grade-gender example (on
page).
– Defn: (Scaling Invariance Prop)
An obj meas. M is invariant under row and
col scaling op if
M(T)=M(T’)
where T is the contingency table with fr.
counts(f11 ;f10 ;f01 ;f00 )
and T’ is con. table with fr counts
(k1f11 ;k2f10 ;k3f01 ;k4f00 ) and K1,k2,k3, k4 are +ve
consts.
– Ø coeff, IS factor, Interest factor change their values when
con table is rescaled.