CP-5001: ADVANCED DIGITAL

SIGNAL PROCESSING

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Lecture 1 & 2: Outline
•  Course Information
•  Course Syllabus
•  DSP is Everywhere
•  Why Signal Processing?
•  Limitations of Analog Signal Processing
•  Digital Signal Processing: Pros and Cons
•  Discrete Time Signal and Systems
•  Linear Time Invariant System

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Instructor:
Dr. Muhammad Majid
Assistant Professor,
Department of Computer Engineering,
University of Engineering and Technology Taxila,
Pakistan.
Email:
m.majid@uettaxila.edu.pk

Contact Hours:
06, Ground Floor, After Lecture

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Objective
•  To establish the idea of using computing techniques
to alter the properties of a signal for desired effects,
via understanding of
•  Fundamentals of discrete-time, linear, shift-
invariant signals and systems in
•  Efficient computational algorithms and their
implementation.
•  To gain preliminary experience in computational
processing of real signal and to relate the above
understanding to real world scenario

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Nuts and Bolts
Prerequisites:
Signals and Systems, Digital Signal Processing

Class Mailing List:

Provide your Name, Registration No. and Email

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Nuts and Bolts
Reference Books:
1. Discrete-Time Signal Processing, Prentice Hall,
2nd Edition by Alan Oppenheim, Ronald Schafer,
John Buck
2. Multidimensional Signal, Image and Video
Processing and Coding by John W. Woods

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Policies
•  Grading:
•  Assignments, Quizzes 20%
•  Project 20%
•  Midterm Exam 20%
•  Final Exam 40%
•  Exams:
•  Exams must be taken at scheduled time, no
makeup exams

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Course Information
Policies
•  Assignments:
•  Assigned Tuesday, due following Tuesday before 3
pm
•  Assignments lose 25% credit per day late
•  Up to 3 students can collaborate and turn in one
written assignment
•  Collaboration means all collaborators work out all
problems together
•  Attendance:
•  85% attendance is must for this course
•  If attendance < 85% you are not allowed in exams
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Course Syllabus
•  Introduction to Digital Signal Processing
•  Discrete-Time Signals and System
•  The Z-Transform
•  Sampling of Continuous-Time Signals
•  Transform Analysis of Linear Time-Invariant Systems
•  Filter Design Techniques
•  Structures for Discrete-Time Systems
•  The Discrete-Fourier Transform
•  Computation of the Discrete-Fourier Transform
•  Multidimensional Signal Processing

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 DSP is Everywhere
•  Sound applications
•  Compression, enhancement, special effects,
synthesis, recognition, echo cancellation,…
•  Cell Phones, MP3 Players, Movies, Dictation,
Text-to-speech,…
•  Communication
•  Modulation, coding, detection, equalization, echo
cancellation,…
•  Cell Phones, dial-up modem, DSL modem,
Satellite Receiver,…
•  Automotive
•  ABS, GPS, Active Noise Cancellation, Cruise
Control, Parking,…
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 DSP is Everywhere
•  Medical
•  Magnetic Resonance, Tomography,
Electrocardiogram,…
•  Military
•  Radar, Sonar, Space photographs, remote
sensing,…
•  Image and Video Applications
•  DVD, JPEG, Movie special effects, video
conferencing,…
•  Mechanical
•  Motor control, process control, oil and mineral
prospecting,…

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Signal Processing
•  Humans are the most advanced signal processors
•  speech and pattern recognition, speech
synthesis,…
•  We encounter many types of signals in various
applications
•  Electrical signals: voltage, current, magnetic and
electric fields,…
•  Mechanical signals: velocity, force, displacement,
…
•  Acoustic signals: sound, vibration,…
•  Other signals: pressure, temperature,…
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Signal Processing
•  Most real-world signals are analog
•  They are continuous in time and amplitude
•  Convert to voltage or currents using sensors and
transducers
•  Analog circuits process these signals using
•  Resistors, Capacitors, Inductors, Amplifiers,…
•  Analog signal processing examples
•  Audio processing in FM radios
•  Video processing in traditional TV sets

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Limitations of Analog Signal
Processing
•  Accuracy limitations due to
•  Component tolerances
•  Undesired nonlinearities
•  Limited repeatability due to
•  Tolerances
•  Changes in environmental conditions
•  Temperature
•  Vibration
•  Sensitivity to electrical noise
•  Limited dynamic range for voltage and currents
•  Inflexibility to changes
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Limitations of Analog Signal
Processing
•  Difficulty of implementing certain operations
•  Nonlinear operations
•  Time-varying operations
•  Difficulty of storing information

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Digital Signal Processing
•  Represent signals by a sequence of numbers
•  Sampling or analog-to-digital conversions
•  Perform processing on these numbers with a digital
processor
•  Digital signal processing
•  Reconstruct analog signal from processed numbers
•  Reconstruction or digital-to-analog conversion

digital digital
signal signal
analog analog
signal A/D DSP D/A signal

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Digital Signal Processing
•  Analog input – analog output
–  Digital recording of music
•  Analog input – digital output
–  Touch tone phone dialing
•  Digital input – analog output
–  Text to speech
•  Digital input – digital output
–  Compression of a file on computer

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Digital Signal Processing:
Pros and Cons
•  Pros
•  Accuracy can be controlled by choosing word
length
•  Repeatable
•  Sensitivity to electrical noise is minimal
•  Dynamic range can be controlled using floating
point numbers
•  Flexibility can be achieved with software
implementations
•  Non-linear and time-varying operations are easier
to implement
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Digital Signal Processing:
Pros and Cons
•  Pros
•  Digital storage is cheap
•  Digital information can be encrypted for security
•  Price/performance and reduced time-to-market
•  Cons
•  Sampling causes loss of information
•  A/D and D/A requires mixed-signal hardware
•  Limited speed of processors
•  Quantization and round-off errors

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Technology Trends

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Comparison of Chips

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 DSP in Real Time Embedded
Systems

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Discrete-Time Signals:
Sequences
•  Discrete-time signals are represented by sequence of
numbers
•  The nth number in the sequence is represented
with x[n]
•  Often times sequences are obtained by sampling of
continuous-time signals
•  In this case x[n] is value of the analog signal at
xc(nT)
•  Where T is the sampling period

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Discrete-Time Signals:
Sequences
10

-10
0 20 40 60 80 100 t (ms)
10

-10
0 10 20 30 40 50 n (samples)

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Basic Sequences and
Operations
•  Delaying (Shifting) a sequence
y[n] = x[n − no ]

•  Unit sample (impulse) sequence 1.5

1
⎧0 n ≠ 0
δ[n] = ⎨ 0.5

⎩1 n = 0 0
-10 -5 0 5 10

•  Unit step sequence 1.5

1

⎧0 n < 0 0.5

u[n] = ⎨ 0
⎩1 n ≥ 0
-10 -5 0 5 10
1

•  Exponential sequences 0.5

x[n] = Aαn 0
-10 -5 0 5 10

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Basic Sequences and
Operations
•  Sinusoidal Sequence
•  Important class of sequences
x[n] = cos(ωon + φ)

•  An exponential sequence with complex

α = α e jωo and A = A e jφ

n jωon n
n
x[n] = Aα = A e α e jφ
= A α e j(ωon+ φ )
n n
x[n] = A α cos(ωon + φ) + j A α sin(ωon + φ)

•  x[n] is a sum of weighted sinusoids

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Basic Sequences and
Operations
•  Difference of continuous-time, discrete-time sinusoids

•  Have ambiguity of 2πk in frequency

•  Periodicity
•  Interpretation of high and low frequencies

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Discrete-Time Systems
•  Discrete-Time Sequence is a mathematical operation
that maps a given input sequence x[n] into an output
sequence y[n]

y[n] = T{x[n]} x[n] T{.} y[n]

•  Example Discrete-Time Systems

•  Ideal Delay System
•  Moving (Running) Average
•  Maximum
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Discrete-Time Systems
•  Example Discrete-Time Systems
•  Memoryless System
•  A system is memoryless if the output y[n] at
every value of n depends only on the input x[n]
at the same value of n
•  Linear System
•  A system is said to be linear if it satisfies two
properties
•  Additivity
•  Homegenity or Scaling

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Discrete-Time Systems
•  Example Discrete-Time Systems
•  Time-Invariant (shift-invariant) Systems
•  A time shift at the input causes corresponding
time-shift at output
•  Causality
•  A system is causal it’s output is a function of
only the current and previous samples
•  Stability
•  A system is stable if and only if every bounded
input produces a bounded output

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Linear Time Invariant
System
•  Special importance for their mathematical tractability
•  Most signal processing applications involve LTI
systems
•  LTI system can be completely characterized by their
impulse response
δ[n-k] T{.} hk[n]

•  Represent any input x[n] = ∑ x[k ]δ[n − k ]

k = −∞

⎧ ∞ ⎫ ∞ ∞
y[n] = T ⎨ ∑ x[k ]δ[n − k ]⎬ = ∑ x[k ]T{δ[n − k ]} = ∑ x[k ]h [n] k
⎩k = −∞ ⎭ k = −∞ k = −∞

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Linear Time Invariant
System
•  From time invariance we arrive at convolution
∞
y[n] = ∑ x[k ] h[n − k ] = x[k ] ∗ h[k ]
k = −∞
1 1
0.5 LTI 0.5

•  Example 0
-5 0 5
0
-5 0 5
2 2
1 LTI 1
0 0
-5 0 5 -5 0 5
2 2
1 LTI 1
0 0
-5 0 5 -5 0 5
2 4
1 LTI 2
0 0
-5 0 5 -5 0 5
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Properties of LTI System
•  Convolution is commutative
∞ ∞
x [n] ∗ h [n] = ∑ x [k ] h [n − k ] = ∑ h [k ] x [n − k ] = h [n] ∗ x [n]
k=−∞ k=−∞

x[n] h[n] y[n] h[n] x[n] y[n]

•  Convolution is distributive
x [ n ] ∗ ( h1 [ n ] + h2 [ n ]) = x [ n ] ∗ h1 [ n ] + x [ n ] ∗ h2 [ n ]

h1[n]
x[n] h1[n]+ h2[n] y[n] x[n] + y[n]
h2[n]

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Properties of LTI System
•  Cascade connection of LTI system

x[n] h1[n] h2[n] y[n]

x[n] h2[n] h1[n] y[n]

x[n] h1[n]*h2[n] y[n]

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing

 Stable and Causal LTI
System
•  An LTI system is (BIBO) stable if and only if
•  Impulse response is absolute summable The image cannot be displayed. Your computer may
not have enough memory to open the image, or the
image may have been corrupted. Restart your
computer, and then open the file again. If the red x
still appears, you may have to delete the image and
then insert it again.

•  Let’s write the output of the system as

The image cannot be displayed. Your computer may not have enough memory to open the image, or the image may have been corrupted. Restart your computer, and then open the file again. If the red x still
appears, you may have to delete the image and then insert it again.

•  If the input is bounded then the output is

The image cannot be displayed. Your
computer may not have enough memory
to open the image, or the image may have
been corrupted. Restart your computer,
and then open the file again. If the red x
still appears, you may have to delete the
image and then insert it again.

bounded by The image cannot be displayed. Your computer may not have enough memory to
open the image, or the image may have been corrupted. Restart your computer,
and then open the file again. If the red x still appears, you may have to delete the
image and then insert it again.

•  The output is bounded if the absolute sum of

impulse response is finite
Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing
 Stable and Causal LTI
System
•  An LTI system is causal if and only if
h[k] = 0 for k < 0
•  How?

•  Examples
•  Ideal Delay
•  Moving Average
•  Accumulator
•  Forward Difference
•  Backward Difference

Muhammad Majid (m.majid@uettaxila.edu.pk) CP-5001 Advanced Digital Signal Processing