Sei sulla pagina 1di 106

Digital Communications

Chapter 2: Deterministic and Random Signal Analysis


Po-Ning Chen, Professor

Institute of Communications Engineering


National Chiao-Tung University, Taiwan

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

1 / 106

2.1 Bandpass and lowpass signal representation

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

2 / 106

2.1 Bandpass and lowpass signal representation


Denition (Bandpass signal)
A bandpass signal x(t) is a real signal whose frequency
content is located around central frequency f0 , i.e.
X (f ) = 0

for all f f0 > W


f0 may not be the
carrier frequency fc !
6
X (f )

@
@
@
@

f0 W

f0

f0 + W

f0 W

f0

f0 + W

The spectrum of a bandpass signal is Hermitian symmetric,


i.e., X (f ) = X (f ). (Why? Hint: Fourier transform.)
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

3 / 106

2.1 Bandpass and lowpass signal representation


Since the spectrum is Hermitian symmetric, we only need
to retain half of the spectrum X+ (f ) = X (f )u1 (f )
(named analytic signal or pre-envelope) in order to
analyze it,

1 f > 0

where u1 (f ) = 12 f = 0
Note: X (f ) = X+ (f ) + X+ (f )

0 f < 0
A bandpass signal is very real, but may contain
unnecessary content such as the carrier frequency fc
that is nothing to do with the digital information
transmitted.
So, it is more convenient to remove this carrier frequency
and transform x(t) into its lowpass equivalent signal
x (t) before analyzing the digital content.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

4 / 106

2.1 Bandpass and lowpass signal representation Baseband and bandpass signals

Denition (Baseband signal)


A lowpass or baseband (equivalent) signal x (t) is a complex
signal (because it is not necessarily Hermitian symmetric!) whose
spectrum is located around zero frequency, i.e.
X (f ) = 0

for all f > W

It is generally written as
x (t) = xi (t) + xq (t)
where
xi (t) is called the in-phase signal
xq (t) is called the quadrature signal
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

5 / 106

Baseband signal
Our goal is to relate x (t) to x(t) and vice versa

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

6 / 106

Bandwidths of x(t) and x(t)

Definition of bandwidth. The bandwidth of a signal is one


half of the entire range of frequencies over which the spectrum
is essentially nonzero. Hence, W is the bandwidth in the
lowpass signal we just dened, while 2W is the bandwidth of
the bandpass signal by our denition.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

7 / 106

Analytic signal
Lets start from the analytic signal x+ (t).

x+ (t) = X+ (f )e 2ft df

X (f )u1 (f )e 2ft df

= F 1 {X (f )u1 (f )}

F 1 Inverse Fourier transform


= F 1 {X (f )} F 1 {u1 (f )}
1
1
)
= x(t) ( (t) +
2
2t
1
1
x(t) + x(t),
=
2
2

x( )
where x(t) = x(t) t1 = (t
) d is a real-valued signal.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

8 / 106

Appendix: Extended Fourier transform


F 1 {2u1 (f )} = F 1 {1 + sgn(f )}
= F 1 {1} + F 1 {sgn(f )} = (t) +

1
t

Since sgn(f ) = , the inverse Fourier transform of sgn(f )


does not exist in the standard sense! We therefore have to
derive its inverse Fourier transform in the extended sense!

( f )S(f ) = lim Sn (f ) and ( n) Sn (f )df <


n

F 1 {S(f )} = lim F 1 {Sn (f )}.


n

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

9 / 106

Appendix: Extended Fourier transform


Since lima0 e af sgn(f ) = sgn(f ),
lim
a0

e af sgn(f )e 2ft df

= lim [
a0

e f (a+ 2t) df +

e f (a+ 2t) df ]

1
1
+
]
= lim [
a0
a + 2t a 2t

t =0
4t
0
= lim [ 2
]
=

1
a0 a + 4 2 t 2

t t 0
Hence, F 1 {2u1 (f )} = F 1 {1} + F 1 {sgn(f )} = (t) + t1 .

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

10 / 106

x(t) x+(t) x(t)


6
X (f )
@
@

X (f )
6

f0 W f0 f0 + W

f0 W f0 f0 + W




We then observe
X (f ) = 2X+ (f + f0 ).
This implies
x (t) =
=
=
=
Digital Communications: Chapter 2

Ver. 2016.03.14

F 1 {X (f )}
F 1 {2X+ (f + f0 )}
2x+ (t)e 2f0 t
(x(t) + x(t))e 2f0 t
Po-Ning Chen

11 / 106

As a result,
x(t) + x(t) = x (t)e 2f0 t
which gives:
x(t) ( = Re {x(t) + x(t)} )

= Re {x (t)e 2f0 t }

By x (t) = xi (t) + xq (t),


x(t) ( = Re {(xi (t) + xq (t))e 2f0 t } )
= i (t) cos(2f0 t) xq (t) sin(2f0 t)

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

12 / 106

X(f ) X (f )
From x(t) = Re {x (t)e 2f0 t }, we obtain

X (f ) = x(t)e 2ft dt

Re {x (t)e 2f0 t } e 2ft dt

[x (t)e 2f0 t + (x (t)e 2f0 t ) ] e 2ft dt


=
2
1
=
x (t)e 2(f f0 )t dt
2
1
+ x (t)e 2(f +f0 )t dt
2
1
=
[X (f f0 ) + X (f f0 )]
2

X (f ) = (x (t)e 2(f )t ) dt = x (f )e 2ft dt


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

13 / 106

Summary
Terminologies & relations
Bandpass signal

x(t) = Re {x (t)e 2f0 t }

[X

X (f ) = 2  (f f0 ) + X (f f0 )]
Analytic signal or pre-envelope x+ (t) and X+ (f )
Lowpass equivalent signal or complex envelope

x (t) = (x(t) + x(t))e 2f0 t

X (f ) = 2X (f + f0 )u1 (f + f0 )

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

14 / 106

Useful to know
Terminologies & relations
From x (t) = xi (t) + xq (t) = (x(t) + x(t))e 2f0 t ,

2f0 t }

xi (t) = Re { (x(t) + x(t)) e

2f0 t }

xq (t) = Im { (x(t) + x(t)) e


Also from x (t) = (x(t) + x(t))e 2f0 t ,

2f0 t }

x(t) = Re { x (t) e

2f0 t }

x(t) = Im { x (t) e

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

15 / 106

Useful to know
Terminologies & relations
From x (t) = xi (t) + xq (t) = (x(t) + x(t))e 2f0 t ,

2f0 t }

xi (t) = Re { (x(t) + x(t)) e

2f0 t }

xq (t) = Im { (x(t) + x(t)) e


Also from x (t) = (x(t) + x(t))e 2f0 t ,

2f0 t }

x(t) = Re { (xi (t) + xq (t)) e

2f0 t }

x(t) = Im { (xi (t) + xq (t)) e

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

16 / 106

Useful to know
Terminologies & relations
pre-envelope x+(t)
complex envelope x (t)

envelope  (t) = xi2 (t) + xq2 (t) = r (t)

phase  (t) = arctan[xq (t)/xi (t)]


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

17 / 106

Modulaor/demodulator and Hilbert transformer


Usually, we will modulate and demodulate with respect to
carrier frequency fc , which may not be equal to the center
frequency f0 .
x (t) x(t) = Re {x (t)e 2fc t } modulation
x(t) x (t) = (x(t) + x(t))e 2fc t demodulation
The demodulation requires to generate x(t), a Hilbert
transform of x(t)

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

18 / 106

Hilbert transform is basically a 90-degree phase shifter.

, f > 0

f =0
H(f ) = F { } = sgn(f ) = 0,

,
f <0

Recall that on page 10, we have shown


F 1 {sgn(f )} =
hence
F{

1
1{t 0};
t

1
1
} = sgn(f ) = sgn(f ).
t

X (f )
Tip: x+ (t) = 12 [x(t) + x(t)] X+ (f ) = 12 [X (f ) + X (f )] = {
0
X (f )
X (f ) = {
X (f )

f >0
f <0

(1)

(f ) = X (f )H(f ), implies H(f ) = {1


Eq. (1), together with X
1
Digital Communications: Chapter 2

f >0
f <0

Ver. 2016.03.14

f >0
f <0
Po-Ning Chen

19 / 106

Energy considerations
Denition (Energy of a signal)
The energy Es of a (complex) signal s(t) is
Es =

s(t) dt

Hence, the energies of x(t), x+ (t) and x (t) are


Ex =

x(t) dt
2

Ex+ = x+ (t) dt

Ex = x (t) dt

We are interested in the connection among Ex , Ex+ , and Ex .


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

20 / 106

First, from Parsevals Theorem we see


Ex =

x(t) dt =

X (f ) df

Parsevals theorem
x(t)y (t)dt =
X (f )Y (f )df

(Rayleighs theorem)
x(t)2 dt =
X (f )2 df

Second

X (f ) =

1
1
X (f fc ) + X (f fc )
2
2
!"" " " " " " " " " " " "#" " " " " " " " " " " " $ !"" " " " " " " " " " " " " " " #"
" " " " " " " " " " " " " " " "$

=X+ (f )

=X+ (f )

Third, fc W and
X (f fc )X (f fc ) = 4X+ (f )X+ (f ) = 0 for all f

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

21 / 106

It then shows
2
1
1
X (f fc ) + X (f fc ) df
2
2
1
1
1
Ex + Ex = Ex
=
4  4  2 

Ex =

and

Ex = X+ (f ) + X+ (f ) df

= Ex+ + Ex+ = 2Ex+

Theorem (Energy considerations)


Ex = 2Ex = 4Ex+

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

22 / 106

Extension of energy considerations


Denition (Inner product)
We dene the inner product of two (complex) signals x(t) and
y (t) as
x(t), y (t) =

x(t)y (t)dt.

Parsevals relation immediately gives


x(t), y (t) = X (f ), Y (f ).
Ex = x(t), x(t) = X (f ), X (f )
Ex = x (t), x (t) = X (f ), X (f )

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

23 / 106

We can similarly prove that


x(t), y (t)
= X (f ), Y (f )
1
1
1
1
= X (f fc ) + X (f fc ), Y (f fc ) + Y (f fc )
2
2
2
2
1
1
X (f fc ), Y (f fc ) + X (f fc ), Y (f fc )
=
4
4 !"" " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " #"" " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " "$
=0

1
1
+ X (f fc ), Y (f fc ) + X (f fc ), Y (f fc )
4 !"" " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " # " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " " "$ 4
=0

1
1
x (t), y (t) + (x (t), y (t)) =
4
4

Digital Communications: Chapter 2

Ver. 2016.03.14

1
2 Re {x (t), y (t)}

Po-Ning Chen

24 / 106

Corss-correlation of two signals


Denition (Cross-correlation)
The cross-correlation of two signals x(t) and y (t) is dened as
x(t), y (t)
x(t), y (t)

=
.
x,y =
Ex Ey
x(t), x(t) y (t), y (t)

Denition (Orthogonality)
Two signals x(t) and y (t) are said to be orthogonal if x,y = 0.
The previous slide then shows x,y = Re {x ,y }.
x ,y = 0 x,y = 0 but x,y = 0
/ x ,y = 0
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

25 / 106

2.1-4 Lowpass equivalence of a bandpass system


Denition (Bandpass system)
A bandpass system is an LTI system with real impulse
response h(t) whose transfer function is located around a
frequency fc .
Using a similar concept, we set the lowpass equivalent
impulse response as
h(t) = Re {h (t)e 2fc t }
and
H(f ) =

Digital Communications: Chapter 2

1
[H (f fc ) + H (f fc )]
2

Ver. 2016.03.14

Po-Ning Chen

26 / 106

Baseband input-output relation


Let x(t) be a bandpass input signal and let
y (t) = h(t)x(t)

or equivalently

Y (f ) = H(f )X (f )

Then, we know
x(t) = Re {x (t)e 2fc t }
h(t) = Re {h (t)e 2fc t }
y (t) = Re {y (t)e 2fc t }
and
Theorem (Baseband input-output relation)
y (t) = h(t) x(t)

Digital Communications: Chapter 2

Ver. 2016.03.14

1
y (t) = h (t) x (t)
2
Po-Ning Chen

27 / 106

Proof:
2
(f + fc )),
For f fc (or specically, for u1 (f + fc ) = u1
1
1
2
Note 2 = u1 (0) u1
(0) = 4 .
Y (f ) = 2Y (f + fc )u1 (f + fc )
= 2H(f + fc )X (f + fc )u1 (f + fc )
1
[2H(f + fc )u1 (f + fc )] [2X (f + fc )u1 (f + fc )]
=
2
1
H (f ) X (f )
=
2
The case for f = fc is valid since Y (fc ) = X (fc ) = 0.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

28 / 106

The above theorem applies to a deterministic system.


How about a stochastic system?

x(t)-

h(t)

y (t)-

X (t)
-

h(t)

Y (t)
-

The text abuses the notation by using X (f ) as the spectrum


of x(t) but using X (t) as the stochastic counterpart of x(t).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

29 / 106

2.7 Random processes

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

30 / 106

Random Process

Denition
A random process is a set of indexed random variables
{X (t), t T }, where T is often called the index set.
Classication
1
If T is a nite set Random Vector
2
If T = Z or Z+ Discrete Random Process
3
If T = R or R+ Continuous Random Process
4
If T = R2 , Z2 , , Rn , Zn Random Field

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

31 / 106

Examples of random process


Example
Let U be a random variable uniformly distributed over
[, ). Then
X (t) = cos (2fc t + U)
is a continuous random process.
Example
Let B be a random variable taking values in {1, 1}. Then
X (t) = {

cos(2fc t)
sin(2fc t)

if B = 1
= cos (2fc t (B + 1))
if B = +1
4

is a continuous random process.


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

32 / 106

Statistical properties of random process


For any integer k > 0 and any t1 , t2 , , tk T , the
nite-dimensional cumulative distribution function (cdf) for
X (t) is given by:
FX (t1 , , tk ; x1 , , xk ) = Pr {X (t1 ) x1 , , X (tk ) xk }
As event [X (t) < ] (resp. [X (t) ]) is always regarded
as true (resp. false),
lim FX (t1 , , tk ; x1 , , xk )

xs

= FX (t1 , , ts1 , ts+1 , tk ; x1 , , xs1 , xs+1 , , xk )


and
lim FX (t1 , , tk ; x1 , , xk ) = 0

xs
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

33 / 106

Denition
Let X (t) be a random process; then the mean function is
mX (t) = E[X (t)],
the (auto)correlation function is
RX (t1 , t2 ) = E [X (t1 )X (t2 )] ,
and the (auto)covariance function is

KX (t1 , t2 ) = E [ (X (t1 ) mX (t1 )) (X (t2 ) mX (t2 )) ]

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

34 / 106

Denition
Let X (t) and Y (t) be two random processes; then the
cross-correlation function is
RX ,Y (t1 , t2 ) = E [X (t1 )Y (t2 )] ,
and cross-covariance function is

KX ,Y (t1 , t2 ) = E [ (X (t1 ) mX (t1 )] [Y (t2 ) mY (t2 )) ]

Proposition
RX ,Y (t1 , t2 ) = KX ,Y (t1 , t2 ) + mX (t1 )mY (t2 )
RY ,X (t2 , t1 ) = RX ,Y (t1 , t2 )

RX (t2 , t1 ) = RX (t1 , t2 )

KY ,X (t2 , t1 ) = KX ,Y (t1 , t2 )

KX (t2 , t1 ) = KX (t1 , t2 )

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

35 / 106

Stationary random processes


Denition
A random process X (t) is said to be strictly or strict-sense
stationary (SSS) if its nite-dimensional joint distribution
function is shift-invariant, i.e. for any integer k > 0, any
t1 , , tk T and any ,
FX (t1 , , tk ; x1 , , xk ) = FX (t1 , , tk ; x1 , , xk )
Denition
A random process X (t) is said to be weakly or wide-sense
stationary (WSS) if its mean function and (auto)correlation
function are shift-invariant, i.e. for any t1 , t2 T and any ,
mX (t ) = mX (t) and RX (t1 , t2 ) = RX (t1 , t2 ).
The above condition is equivalent to
mX (t) = constant and RX (t1 , t2 ) = RX (t1 t2 ).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

36 / 106

Wide-sense stationary random processes


Denition
Two random processes X (t) and Y (t) are said to be jointly
wide-sense stationary if
Both X (t) and Y (t) are WSS;
RX ,Y (t1 , t2 ) = RX ,Y (t1 t2 ).
Proposition
For jointly WSS X (t) and Y (t),
RY ,X (t2 , t1 ) = RX ,Y (t1 , t2 )
KY ,X (t2 , t1 ) = KX ,Y (t1 , t2 )

Digital Communications: Chapter 2

Ver. 2016.03.14

5
5

RX ,Y ( ) = RY ,X ( )
KX ,Y ( ) = KY ,X ( )

Po-Ning Chen

37 / 106

Gaussian random process


Denition
A random process {X (t), t T } is said to be Gaussian if for
any integer k > 0 and for any t1 , , tk T , the
nite-dimensional joint cdf
FX (t1 , , tk ; x1 , , xk ) = Pr [X (t1 ) x1 , , X (tk ) xk ]
is Gaussian.

Remark
The joint cdf of a Gaussian process is fully determined by its
mean function and its autocovariance function.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

38 / 106

Gaussian random process


Denition
Two real random processes {X (t), t TX } and {Y (t), t TY }
are said to be jointly Gaussian if for any integers j, k > 0 and
for any s1 , , sj TX and t1 , , tk TY , the nite-dimensional
joint cdf
Pr [X (s1 ) x1 , , X (sj ) xj , Y (t1 ) y1 , , Y (tk ) yk ]
is Gaussian.
Denition
A complex process is Gaussian if the real and imaginary
processes are jointly Gaussian.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

39 / 106

Gaussian random process


Remark
For joint (in general complex) Gaussian processes,
uncorrelatedness, dened as
RX ,Y (t1 , t2 ) = E[X (t1 )Y (t2 )]
= E[X (t1 )]E[Y (t2 )] = mX (t1 )mY (t2 ),
implies independence, i.e.,
Pr [X (s1 ) x1 , , X (sj ) xj , Y (t1 ) y1 , , Y (tk ) yk ]
= Pr [X (s1 ) x1 , , X (sk ) xk ]Pr [Y (t1 ) y1 , , Y (tk ) yk ]

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

40 / 106

Theorem
If a Gaussian random process X (t) is WSS, then it is SSS.
Idea behind the Proof:
For any k > 0, consider the sampled random vector
k
X

X (t1 )

X (t )

2
.
=

X (tk )

k are respectively
The mean vector and covariance matrix of X

mX k

Digital Communications: Chapter 2

E[X (t1 )]

E[X (t )]

2
k] =

= mX (0) 1
= E[X

E[X (tk )]

Ver. 2016.03.14

Po-Ning Chen

41 / 106

and
RX =

kX
Hk ]
E[X

KX (0)
KX (t1 t2 )

KX (0)
.
= KX (t2 t1 )

It can be shown that for a new sampled random vector


X (t1 + )

X (t + )

X (tk + )

the mean vector and covariance matrix remain the same.


Hence, X (t) is SSS.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

42 / 106

Power spectral density


Denition
Let RX ( ) be the correlation function of a WSS random
process X (t). The power spectral density (PSD) or power
spectrum of X (t) is dened as

SX (f ) = RX ( )e 2f d .

Let RX ,Y ( ) be the cross-correlation function of two jointly


WSS random process X (t) and Y (t); then the cross spectral
density (CSD) is
SX ,Y (f ) =

Digital Communications: Chapter 2

Ver. 2016.03.14

RX ,Y ( )e 2f d .

Po-Ning Chen

43 / 106

Properties of PSD

PSD (in units of watts per Hz) describes the density of


power as a function of frequency.
Analogously, probability density function (pdf) describes
the density of probability as a function of outcome.
The integration of PSD gives power of the random
process over the considered range of frequency.
Analogously, the integration of pdf gives probability over
the considered range of outcome.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

44 / 106

Theorem
SX (f ) is non-negative and real (which matches that the power
of a signal cannot be negative or complex-valued).
Proof: SX (f ) is real because
SX (f ) =

RX ( )e 2f d

= RX (s)e 2fs ds

Digital Communications: Chapter 2

RX (s)e 2fs ds

= (

(s = )

SX (f )

RX (s)e 2fs ds)

Ver. 2016.03.14

Po-Ning Chen

45 / 106

SX (f ) is non-negative because of the following (we only prove


this based on that T R and X (t) = 0 outside [T , T ]).
SX (f ) =

E[X (t + )X (t)]e 2f d

= E [X (t)
= E [X (t)

X (t + )e 2f d ]

(s = t + )

X (s)e 2f (st) ds]

(f )e 2ft ]
= E [X (t)X

(f ) = F{X (t)}.
In notation, X

Since the above is a constant with respect to t (by WSS),


T
1
(f )e 2ft ] dt
E [X (t)X
SX (f ) =

2T T
T
1
(f ) X (t)e 2ft dt]
E [X
=
2T
T
1
(f )X
(f )] = 1 E [X
(f )2 ] 0.
E [X
=
2T
2T
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

46 / 106

Wiener-Khintchine theorem
Theorem (Wiener-Khintchine)
Let {X (t), t R} be a WSS random process. Dene
X T (t) = {

X (t)
0,

if t [T , T ]
otherwise.

and set

T (f ) = X T (t)e 2ft dt = X (t)e 2ft dt.


X

T
If SX (f ) exists (i.e., RX ( ) has a Fourier transform), then
1
T (f )2 }
E {X
T 2T

SX (f ) = lim

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

47 / 106

Variations of PSD definitions


Power density spectrum : Alternative denition
Fourier transform of auto-covariance function (e.g.,
Robert M. Gray and Lee D. Davisson, Random
Processes: A Mathematical Approach for Engineers,
p. 193)

I remark that from the viewpoint of digital


communications, the texts denition is more appropriate
since
the auto-covariance function is independent of a
mean-shift; however, random signals with dierent
means consume dierent powers.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

48 / 106

What can we say about, e.g., the PSD of stochastic


system input and output?

(t) = Re{ (t)e 2fc t }


h(t)
y (t)-
x(t) (t) = ((t) +
(t))e 2fc t
x (t) 12 h (t) y (t)

where can be x, y or h.

(t) = Re{ (t)e 2fc t }


h(t)
Y
(t)
X (t)
-
 (t) = ((t) +
(t))e 2fc t
1

X  (t) 2 h (t) Y  (t)


where can be X , Y or h.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

49 / 106

2.9 Bandpass and lowpass random processes

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

50 / 106

Denition (Bandpass random signal)


A bandpass (WSS) stochastic signal X (t) is a real random
process whose PSD is located around central frequency f0 , i.e.
SX (f ) = 0

for all f f0 > W


f0 may not be the
carrier frequency fc !
6
SX (f )

@
@
@
@

f0 W

f0

f0 + W

f0 W

f0

f0 + W

X (t) = Re {X  (t)e 2fc t }


We know
2fc t

X  (t) = (X (t) + X (t))e


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

51 / 106

Assumption (Fundamental assumption)


The bandpass signal X (t) is WSS.
In addition, its complex lowpass equivalent process X  (t) is
WSS. In other words,
X i (t) and X q (t) are WSS.
X i (t) and X q (t) are jointly WSS.
Under this fundamental assumption, we obtain the
following properties:
P1) If X (t) zero-mean, both X i (t) and X q (t) zero-mean
because mX = mX i cos(2fc t) mX q sin(2fc t) .

RX ( ) = RX q ( )
P2) i

RX i ,X q ( ) = RX q ,X i ( )
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

52 / 106

Proof of P2):
RX ( )
= E [X (t + )X (t)]
= E [Re {X  (t + )e 2fc (t+ ) } Re {X  (t)e 2fc t }]
= E [(X i (t + ) cos(2fc (t + )) X q (t + ) sin(2fc (t + )))
(X i (t) cos(2fc t) X q (t) sin(2fc t))]
RX i ( ) + RX q ( )
cos(2fc )
=
2
RX ,X q ( ) RX q ,X i ( )
sin(2fc )
+ i
2
RX ( ) RX q ( )
cos(2fc (2t + )) (= 0)
+ i
2
RX ,X q ( ) + RX q ,X i ( )
sin(2fc (2t + )) (= 0)
i
2

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

53 / 106

P3) RX ( ) = Re { 12 RX  ( )e 2fc }.
Proof: Observe from P2),
RX  ( ) =
=
=
=

E [X  (t + )X  (t)]
E [(X i (t + ) + X q (t + ))(X i (t) X q (t))]
RX i ( ) + RX q ( ) RX i ,X q ( ) + RX q ,X i ( )
2RX i ( ) + 2RX q ,X i ( ).

Hence, also from P2),


RX ( ) = RX i ( ) cos(2fc ) RX q ,X i ( ) sin(2fc )
1
= Re { RX  ( )e 2fc }
2

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

54 / 106

P4) SX (f ) = 14 [SX  (f fc ) + SX  (f fc )].


Proof: A direct consequence of P3).

Note:

(f ) = 1 [X
 (f fc ) + X
 (f fc )]
Amplitude X
2
Amplitude square
(f )
X

=
=

2
1
 (f fc )
X  (f fc ) + X
4
2
1
2
 (f fc ) )
(X  (f fc ) + X
4

(f )2 .
Wiener-Khintchine: SX (f ) X

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

55 / 106

P5) X i (t) and X q (t) uncorrelated if one of them has


zero-mean.
Proof: From P2),
RX i ,X q ( ) = RX q ,X i ( ) = RX i ,X q ( ).
Hence, RX i ,X q (0) = 0 (i.e.,
E[X i (t)X q (t)] = 0 = E[X i (t)]E[X q (t)]).

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

56 / 106

P6) If SX  (f ) = SX  (f )(= SX  (f )) symmetric, then


X i (t + ) and X q (t) uncorrelated for any , provided one
of them has zero-mean.
Proof: From P3),
RX  ( ) = 2RX i ( ) + 2RX q ,X i ( ).
SX  (f ) = SX  (f ) implies RX  ( ) is real;
hence, RX q ,X i ( ) = 0 for any .

Note that SX  (f ) = SX  (f ) i RX  ( ) real i RX q ,X i ( ) = 0


for any .
We next discuss the PSD of a system.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

57 / 106

X (t)
-

h(t)

Y (t) =

Y (t)
-

mY = mX

h( )X (t )d

RX ,Y ( ) = E [X (t + ) (
=

h(u)X (t u)du) ]

h (u)RX ( + u)du =

= RX ( ) h ( )
RY ( ) = E [(

h( )d

h(u)X (t + u)du) (

h(u) (

h (v )RX ( v )dv

h(v )X (t v )dv ) ]

h (v )RX (( u) + v )dv ) du

h(u)RX ,Y ( u)du

= RX ,Y ( ) h( ) = RX ( ) h ( ) h( ).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

58 / 106

Thus,
SX ,Y (f ) = SX (f )H (f ) since

h ( )e 2f d = H (f )

and
SY (f ) = SX ,Y (f )H(f ) = SX (f )H(f )2 .

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

59 / 106

White process
Denition (White process)
A (WSS) process W (t) is called a white process if its PSD is
constant for all frequencies:
SW (f ) =

N0
2

This constant is usually denoted by N20 because the PSD


is two-sided ( 0 and 0 ). So, the power
spectral density is actually N0 per Hz (N0 /2 at f = f0
and N0 /2 at f = f0 ).
The autocorrelation function RW ( ) = N20 (), where ()
is the Dirac delta function.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

60 / 106

Why negative frequency?


It is an imaginarily convenient way created by Human to
correspond to the imaginary domain of a complex signal
(that is why we call it imaginary part).
By giving respectively the spectrum for f0 and f0 (which
may not be symmetric), we can specify the amount of real
part and imaginary part in time domain corresponding to
this frequency.
For example, if the spectrum is conjugate symmetric, we
know imaginary part (in time domain) = 0.
Notably, in communications, imaginary part is the part
that will be modulated by (or transmitted with carrier)
sin(2fc t); on the contrary, real part is the part that will
be modulated by (or transmitted with carrier) cos(2fc t).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

61 / 106

Why () function?
Denition (Dirac delta function)
Dene the Dirac delta function (t) as
(t) = {

, t = 0;
,
0, t 0

which satises the replication property, i.e., for every


continuous point of g (t),
g (t) =

g ( )(t )d .

Hence, by replication property,

(u)du = (t )d = 1 (t )d = 1.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

62 / 106

, t = 0;
; but
0, t 0
with g1 (t) = 1 and g2 (t) = 2 continuous at all points,

Note that it seems (t) = 2(t) = {

1=

g1 ( )(t )d

g2 ( )(t )d = 2.

So, it is not well-dened and contradicts the below


intuition: With f (t) = (t) and g (t) = 2(t),
f (t) = g (t) for t R except for countably many points

f (t)dt =

g (t)dt

(if

f (t)dt is nite).

Hence, (t) and 2(t) are two dierent Diract delta


functions by denition. (Their multiplicative constant
cannot be omitted!)
What is the problem saying f (t) = g (t) for t R?
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

63 / 106

Comment: x + a = y + a x = y is incorrect if a = .
As a result, saying = (or (t) = 2(t) ) is not a
rigorously dened statement.
Summary: The Dirac delta function, like , is simply
a concept dened only through its replication property.
Hence, a white process W (t) that has autocorrelation
function RW ( ) = N20 ( ) is just a convenient and
simplied notion for theoretical research about real world
phenomenon. Usually, N0 = KT , where T is the ambient
temperature in kelvins and k is Boltzmans constant.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

64 / 106

Discrete-time random processes


The property of a time-discrete process {X [n], n Z+ }
can be obtained using sampling notion via the Dirac
delta function.
X [n] = X (nT ), a sample at t = nT from a
time-continuous process X (t), where we assume T = 1
for convenience.
The autocorrelation function of a time-discrete process is
given by:
RX [m] = E{X [n + m]X [n]}
= E{X (n + m)X (n)}
= RX (m), a sample from RX (t).
RX (2)
RX (5)
RX (7)
RX (10)
RX (12)
RX (0)
RX (3)
R (8)
R (13)
RX (4) 6RX (6) 6 X RX (9) 6RX (11) 6 X
6RX (1) 6

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

665 / 106

SX [f ] =

( RX (t)(t n)) e 2ft dt


n=

RX (t)e 2ft (t n)dt

n=

RX (n)e 2fn (Replication Property)

n=

RX [n]e 2fn (Fourier Series)

n=

Hence, by Fourier sesies,


RX [n] =

1/2

1/2

SX [f ]e 2fm df ( = RX (n) =

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

SX (f )e 2fm df ).

66 / 106

2.8 Series expansion of random processes

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

67 / 106

2.8-1 Sampling band-limited random process


Deterministic case
A deterministic signal x(t) is called band-limited if
X (f ) = 0 for all f > W .
Shannon-Nyquist theorem: If the sampling rate fs 2W ,
then x(t) can be perfectly reconstructed from samples.
An example of such reconstruction is

n
n
x(t) = x ( ) sinc [fs (t )] .
fs
fs
n=

Note that the above is only sucient, not necessary.


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

68 / 106

Stochastic case
A WSS stochastic process X (t) is said to be band-limited
if its PSD SX (f ) = 0 for all f > W .
It follows that

RX ( ) = RX (
n=

n
n
) sinc [2W (
)] .
2W
2W

In fact, this random process X (t) can be reconstructed


by its random samples in the sense of mean square.
Theorem
2

n
n
) sinc [2W (t
)] = 0
E X (t) X (
2W
2W
n=
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

69 / 106

The random samples


Problems of using these random samples.

n
)}n= are in general
These random samples {X ( 2W
correlated unless X (t) is zero-mean white.

m
nm
n
)X (
)} = RX (
)
2W
2W
2W
m
n
)} E {X (
)} = mX 2 .
E {X (
2W
2W

E {X (

If X (t) is zero-mean white,


N0 n m
m
nm
n
)X (
)} = RX (
)=
(
)
2W
2W
2W
2
2W
m
n
)} E {X (
)} = mX 2 = 0 except n = m.
= E {X (
2W
2W

E {X (

Thus, we will introduce the uncorrelated KL expansions


in Slide 87.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

70 / 106

2.9 Bandpass and lowpass random processes (revisited)

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

71 / 106

Denition (Filtered white noise)


A process N(t) is called a ltered white noise if its PSD equals
SN (f ) = {

N0
2 ,

0,

f fc < W
otherwise

Applying P4) SX (f ) = 14 [SX  (f fc ) + SX  (f fc )] , we

learn the PSD of the lowpass equivalent process N  (t) of


N(t) is
2N0 , f < W
SN  (f ) = {
0,
otherwise
From P6), SN  (f ) = SN  (f ) implies N i (t + ) and
N q (t) are uncorrelated for any if one of them has zero
mean.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

72 / 106

Now we explore more properties for PSD of bandlimited X (t)


and complex X  (t).
P0-1) By fundamental assumption on Slide 52, we obtain
(t) are jointly WSS.
that X (t) and X
(t) is the
RX ,X ( ) and RX ( ) are only functions of because X

Hilbert transform of X (t), i.e., RX ,X ( ) = RX ( )h ( ) = RX ( )


h( ) (since h ( ) = h( )) and RX ( ) = RX ,X ( ) h( ).

(t))e 2fc t } is WSS by


P0-2) X i (t) = Re {(X (t) + X
fundamental assumption.

RX ( ) = RX ( )

P2 )

RX ,X ( ) = RX ,X ( )

(t) is the lowpass


(X (t) + X
equivalent signal of X i (t)!)
(X i (t) + X q (t) is the lowpass
equivalent signal of X (t)!)

Thus, RX ,X ( ) = RX ,X ( ) = RX ( ) h( ) = RX ( ) is the Hilbert


transform output due to input RX ( ).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

73 / 106

P3 ) RX i ( ) = Re { 12 R(X + X ) ( )e 2fc }
1
RX i ( ) = Re { R(X + X ) ( )e 2fc }
2
= Re {(RX ( ) + RX ,X ( ))e 2fc }
= RX ( ) cos(2fc ) + RX ( ) sin(2fc )
Note that SX (f ) = SX (f )HHilbert (f ) = SX (f )( sgn(f )).
P4 ) SX i (f ) ( = SX q (f )) = SX (f fc ) + SX (f + fc ) for f < fc

SX i (f ) =

1
(SX (f fc ) + SX (f + fc ))
2

1
( sgn(f fc )SX (f fc ) + sgn(f + fc )SX (f + fc ))
2
= SX (f fc ) + SX (f + fc ) for f < fc

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

74 / 106

P4 ) SX q ,X i (f ) = [SX (f fc ) SX (f + fc )] for f < fc


Terminologies & relations

RX ( ) = Re { 12 RX  ( ) e 2fc } (P3)

R
1
2fc
}
,X ( ) = RX ( ) hHilbert ( ) = Im { 2 RX  ( ) e




































































































P0-1
Then:

1
2 RX  ( )

= RX i ( ) + RX q ,X i ( ) = (RX ( ) + RX ,X ( ))e 2fc


                                                                                                       
Proof of P3

2fc

} (P3 )

RX i ( ) = Re { (RX ( ) + RX ,X ( )) e

RX ,X ( ) = Im { (RX ( ) + RX ,X ( )) e 2fc } = RX i ( ) hHilbert ( )

q i
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

75 / 106

Proof (of P4 ): Hence,


RX q ,X i ( ) = Im {(RX ( ) + RX ,X ( ))e 2fc }
= RX ( ) sin(2fc ) + RX ,X ( ) cos(2fc )
= RX ( ) sin(2fc ) + RX ( ) cos(2fc ).
Then we can prove P4 by following similar procedure to the
proof of P4 .

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

76 / 106

2.2 Signal space representation

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

77 / 106

Key idea & motivation

The low-pass equivalent representation removes the


dependence of system performance analysis on carrier
frequency.
Equivalent vectorization of the (discrete or continuous)
signals further removes the waveform redundancy in
the analysis of system performance.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

78 / 106

Vector space concepts


= vHv
Inner product: v 1 , v 2 = ni=1 v1,i v2,i
2 1

(H denotes Hermitian transpose)

Orthogonal if v 1 , v 2 = 0
Norm: v =

v , v

Orthonormal: v 1 , v 2 = 0 and v 1 = v 2 = 1
Linearly independent:
k

ai v i = 0 i ai = 0 for all i
i =1

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

79 / 106

Vector space concepts


Triangle inequality
v 1 + v 2 v 1 + v 2
Cauchy-Schwartz inequality
v 1 , v 2 v 1 v 2 .
Equality holds i v 1 = av 2 for some a.
Norm square of sum:
v 1 + v 2 2 = v 1 2 + v 2 2 + v 1 , v 2 + v 2 , v 1
Pythagorean: if v 1 , v 2 = 0, then
2

v 1 + v 2 = v 1 + v 2
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

80 / 106

Eigen-decomposition
1

Matrix transformation w.r.t. matrix A


v = Av

Eigenvalues of square matrix A are solutions {} of


characteristic polynomial
det(A I ) = 0

Eigenvectors for eigenvalue is solution v of


Av = v

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

81 / 106

Signal space concept


How to extend the signal space concept to a (complex)
function/signal z(t) dened over [0, T ) ?
Answer: We can start by dening the inner product for
complex functions.
T

Inner product: z1 (t), z2 (t) = 0 z1 (t)z2 (t) dt


Orthogonal if z1 (t), z2 (t) = 0.

Norm: z(t) = z(t), z(t)


Orthonormal: z1 (t), z2 (t) = 0 and z1 (t) = z2 (t) = 1.
Linearly independent: ki=1 ai zi (t) = 0 i ai = 0 for all
ai C
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

82 / 106

Triangle Inequality
z1 (t) + z2 (t) z1 (t) + z2 (t)
Cauchy Schwartz inequality
z1 (t), z2 (t) z1 (t) z2 (t)
Equality holds i z1 (t) = a z2 (t) for some a C.
Norm square of sum:
z1 (t) + z2 (t)2 = z1 (t)2 + z2 (t)2
+ z1 (t), z2 (t) + z2 (t), z1 (t)
Pythagorean property: if z1 (t), z2 (t) = 0,
2

z1 (t) + z2 (t) = z1 (t) + z2 (t)


Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

83 / 106

Transformation w.r.t. a function C (t, s)


z(t) =

C (t, s)z(s) ds

This is in parallel to
v

(
vt = At,s vs )

= Av .

s=1

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

84 / 106

Eigenvalues and eigenfunctions

Given a complex continuous function C (t, s) over [0, T )2 , the


eigenvalues and eigenfunctions are {k } and {k (t)} such
that
T

0 C (t, s)k (s) ds = k k (t) (In parallel to Av = v )

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

85 / 106

Mercers theorem

Theorem (Mercers theorem)


Give a complex continuous function C (t, s) over [0, T ]2 that
is Hermitian symmetric (i.e., C (t, s) = C (s, t)) and
nonnegative denite (i.e., i j ai C (ti , tj )aj 0 for any {ai }
and {ti }). Then the eigenvalues {k } are reals, and C (t, s)
has the following eigen-decomposition

C (t, s) = k k (t)k (s).


k=1

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

86 / 106

Karhunen-Lo`eve theorem
Theorem (Karhunen-Lo`eve theorem)
Let {Z (t), t [0, T )} be a zero-mean random process with a
continuous autocorrelation function RZ (t, s) = E[Z (t)Z (s)].
Then Z (t) can be written as
M

Z (t) =2
k=1 Z k k (t) 0 t < T
where = is in the sense of mean-square,
T
Z k = Z (t), k (t) = 0 Z (t)k (t) dt
and {k (t)} are orthonormal eigenfunctions of RZ (t, s).

Merit of KL expansion: {Z k } are uncorrelated. (But


samples {Z ( k/(2W ) )} are not uncorrelated even if
Z (t) is bandlimited!)
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

87 / 106

Proof.
E[Z i Z j ] = E [(
=

T
0

Z (t)i (t)dt) (
T

T
0

Z (s)j (s)ds) ]

RZ (t, s)j (s)ds) i (t)dt

= j j (t)i (t)dt
0

j
=

( = E[Z i ]E [Z j ])

Digital Communications: Chapter 2

Ver. 2016.03.14

if i = j
if i j

Po-Ning Chen

88 / 106

Lemma
For a given orthonormal set {k (t)}, how to minimize the
energy of error signal e(t) = s(t) s(t) for s(t) spanned by
(i.e., expressed as a linear combination of) {k (t)}?
Assume s(t) = k ak k (t); then
e(t)

= s(t) s(t)
2
= s(t) kki ak k (t) ai i (t)
2
2
= s(t) kki ak k (t) + ai i (t)
s(t) kki ak k (t), ai i (t)
ai i (t), s(t) kki ak k (t)
2
2
= s(t) kki ak k (t) + ai
ai s(t), i (t) ai i (t), s(t)

By taking derivative w.r.t. Re{ai } and Im{ai }, we obtain


ai = s(t), i (t).
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

89 / 106

Denition
2

If every nite energy signal s(t) (i.e., s(t) < ) satises


2
2

e(t) = s(t) s(t), k (t) k (t) = 0


k

(equivalently,
L

s(t) =2 s(t), k (t) k (t) = ak k (t)


k

(in the sense that the norm of the dierence between


left-hand-side and right-hand-side is zero), then the set of
orthonormal functions {k (t)} is said to be complete.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

90 / 106

Example (Fourier series)

2kt
2kt
2
2

cos (
),
sin (
) 0 k Z

T
T
T
T

is a complete orthonormal set for signals dened over [0, T )


with nite number of discontinuities.
For a complete orthonormal basis, the energy of s(t) is
equal to
s(t)2 = aj j (t), ak k (t)
j

=
=

aj ak j (t), k (t)
j k
aj aj
j

= aj 2
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

91 / 106

Given a deterministic function s(t), and a set of complete


orthonormal basis {k (t)} (possibly countably innite),
s(t) can be written as
L

s(t) =2 ak k (t),

0t T

k=0

where
ak = s(t), k (t) =
In addition,

T
0

s(t)k (t) dt.

s(t) = ak 2 .
k

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

92 / 106

Remark
In terms of energy (and error rate):
A bandpass signal s(t) can be equivalently analyzed
through lowpass equivalent signal s (t) without the
burden of carrier freq fc ;
A lowpass equivalent signal s (t) can be equivalently
analyzed through (countably many)
{ak = s (t), k (t)} without the burden of continuous
waveforms.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

93 / 106

Gram-Schmidt procedure
Given a set of functions v1 (t), v2 (t), , vk (t)
v1 (t)
v1 (t)

1 (t) =

Compute for i = 2, 3, , k (or until i (t) = 0),


i 1

i (t) = vi (t) vi (t), j (t) j (t)


j=1

and set i (t) =

i (t)
i (t) .

This gives an orthonormal basis 1 (t), 2 (t), , k (t), where


k k.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

94 / 106

Example
Find a Gram-Schmidt orthonormal basis of the following
signals.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

95 / 106

Sol.
1 (t) =

v1 (t)
v1 (t)

v1 (t)

2 (t) = v2 (t) v2 (t), 1 (t) 1 (t)


= v2 (t) (
Hence 2 (t) =

2 (t)
2 (t)

3
0

v2 (t)1 (t) dt) 1 (t) = v2 (t)

v2 (t)
.
2

3 (t) = v3 (t) v3 (t), 1 (t) 1 (t) v3 (t), 2 (t) 2 (t)

1, 2 t < 3
= v3 (t) 21 (t) 0 2 (t) = {
0, otherwise
Hence 3 (t) =
Digital Communications: Chapter 2

3 (t)
3 (t) .

Ver. 2016.03.14

Po-Ning Chen

96 / 106

4 (t) = v4 (t) v4 (t), 1 (t) 1 (t) v4 (t), 2 (t) 2 (t)


v4 (t), 3 (t) 3 (t)

= v4 (t) ( 2)1 (t) (0)2 (t) 3 (t) = 0

Orthonormal basis={1 (t), 2 (t), 3 (t)}, where 3 4.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

97 / 106

Example
Represent the signals in slide 95 in terms of the orthonormal
basis obtained in the same example.
Sol.

21 (t) + 0 2 (t) + 0 3 (t) 5 [ 2, 0, 0]

v2 (t) = 0 1 (t) + 2 2 (t) + 0 3 (t) 5 [0, 2, 0]

v3 (t) =
21 (t) + 0 2 (t) + 3 (t) 5 [ 2, 0, 1]

v4 (t) = 21 (t) + 0 2 (t) + 1 3 (t) 5 [ 2, 0, 1]


v1 (t) =

The vectors are named signal space representations or


constellations of the signals.
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

98 / 106

Remark
The orthonormal basis is not unique.
For example, for k = 1, 2, 3, re-dene
1, k 1 t < k
0, otherwise

k (t) = {
Then
v1 (t)

(+1, +1, 0)

v2 (t)

(+1, 1, 0)

v3 (t)

(+1, +1, 1)

v4 (t)

Digital Communications: Chapter 2

Ver. 2016.03.14

(1, 1, 1)

Po-Ning Chen

99 / 106

Euclidean distance

s1 (t)
s2 (t)

5
5

(a1 , a2 , , an ) for some complete basis


(b1 , b2 , , bn ) for the same complete basis

d12 =

Euclidean distance between s1 (t) and s2 (t)


\
^n
_ (ai bi )2
= ^
i =1

= s1 (t) s2 (t)

Digital Communications: Chapter 2

Ver. 2016.03.14

(=

s1 (t) s2 (t)2 dt)

Po-Ning Chen

100 / 106

Bandpass and lowpass orthonormal basis


Now lets change our focus from [0, T ) to (, )
A time-limited signal cannot be bandlimited to W .
A bandlimited signal cannot be time-limited to T .

Hence, in order to talk about the ideal bandlimited signal, we


have to deal with signals with unlimited time span.

Re-dene the inner product as:

f (t), g (t) = f (t)g (t) dt

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

101 / 106

Let s1, (t) and s2, (t) be lowpass equivalent signals of the
bandpass s1 (t) and s2 (t), satisfying
S1, (f ) = S2, (f ) = 0 for f > fB
si (t) = Re {si , (t)e 2fc t } where fc fB
Then, as we have proved in slide 24,
s1 (t), s2 (t) =

1
2 Re {s1, (t), s2, (t)}

Proposition
If s1, (t), s2, (t) = 0, then s1 (t), s2 (t) = 0.

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

102 / 106

Proposition
If {n, (t)} is a complete basis for the set of lowpass signals,
then

{(

(t)
=
Re
2 (t)) e 2fc t }

n,

n (t) = Im {( 2n, (t)) e 2fc t }

= Re {( 2n, (t)) e 2fc t }

is a complete orthonormal set for the set of bandpass signals.


Proof: First, orthonormality can be proved by

1 n = m
1

n (t), m (t) = Re { 2n, (t), 2m, (t)} =

0 n m

1
1 n = m

n (t), m (t) = Re { 2n, (t), 2m, (t)} =

0 n m
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

103 / 106

and

1
Re { 2n, (t), 2m, (t)}
2
= Re { n, (t), m, (t)}

Re { } = 0 n = m
=

nm

n (t), m (t) =

s(t) = Re {s (t)e 2fc t }

s (t)e 2fc t }

s(t) = Re {
L
Now, with
s (t) =2 an, n, (t) with an, = s (t), n, (t)

(t)

s
 (t) = 0

we have
1
2
2
s(t) s(t) = s (t) s (t) = 0
2
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

104 / 106

and
s(t) = Re {
s (t)e 2fc t }
= Re { an, n, (t)e 2fc t }
n

an,
= (Re { } Re { 2n, (t)e 2fc t }
2
n

an,
+Im { } Im {( 2n, (t)) e 2fc t })
2
an,
an,
= (Re { } n (t) + Im { } n (t))
2
2
n

Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

105 / 106

What you learn from Chapter 2

Random process
WSS
autocorrelation and crosscorrelation functions
PSD and CSD
White and ltered white

Relation between (bandlimited) bandpass and lowpass


equivalent deterministic signals
Relation between (bandlimited) bandpass and lowpass
equivalent random signals
Properties of autocorrelation and power spectrum density

Role of Hilbert transform


Signal space concept
Digital Communications: Chapter 2

Ver. 2016.03.14

Po-Ning Chen

106 / 106

Potrebbero piacerti anche