Partial-Update Adaptive Signal Processing: Design Analysis and Implementation
()
About this ebook
- Advanced analysis and design tools
- Algorithm summaries in tabular format
- Case studies illustrate the application of partial update adaptive signal processing
Kutluyil Doğançay
Kutluyil Dogançay received the BS degree with honors in electrical and electronic engineering from Bogaziçi University, Istanbul, Turkey, in 1989, the MSc degree in communications and signal processing from Imperial College, The University of London, UK, in 1992, and the PhD degree in telecommunications engineering from The Australian National University, Canberra, ACT, Australia, in 1996. Since November 1999, he has been with the School of Engineering, University of South Australia, where he is a professor and discipline leader of electrical and mechatronic engineering. His research interests span statistical and adaptive signal processing with applications in defence and communication systems. Dr Dogançay received the Best Researcher Award of School of Engineering, University of South Australia, in 2015, and Tall Poppy Science Award of the Australian Institute of Political Science in 2005. He was the Tutorials Chair of the IEEE Statistical Signal Processing Workshop (SSP 2014), and the Signal Processing and Communications Program Chair of the 2007 Information, Decision and Control Conference. He serves on the Editorial Board of Signal Processing and the EURASIP Journal on Advances in Signal Processing. From 2009-2015 he was an elected member of the Signal Processing Theory and Methods (SPTM) Technical Committee of the IEEE Signal Processing Society. He is currently an associate member of the Sensor Array and Multichannel (SAM) Technical Committee and a member of the IEEE ComSoc Signal Processing for Communications and Electronics Technical Committee. Dr Dogançay is the EURASIP liaison for Australia.
Related to Partial-Update Adaptive Signal Processing
Related ebooks
Multiresolution Signal Decomposition: Transforms, Subbands, and Wavelets Rating: 0 out of 5 stars0 ratingsAnalysis and Synthesis of Polynomial Discrete-Time Systems: An SOS Approach Rating: 0 out of 5 stars0 ratingsResource Efficient LDPC Decoders: From Algorithms to Hardware Architectures Rating: 0 out of 5 stars0 ratingsBio-Inspired Computation in Telecommunications Rating: 0 out of 5 stars0 ratingsMultirate and Wavelet Signal Processing Rating: 0 out of 5 stars0 ratingsModern Anti-windup Synthesis: Control Augmentation for Actuator Saturation Rating: 5 out of 5 stars5/5New Paradigms in Computational Modeling and Its Applications Rating: 0 out of 5 stars0 ratingsEngineering Optimization: An Introduction with Metaheuristic Applications Rating: 0 out of 5 stars0 ratingsLow and High Frequency Asymptotics: Acoustic, Electromagnetic and Elastic Wave Scattering Rating: 0 out of 5 stars0 ratingsNonlinear System Analysis Rating: 0 out of 5 stars0 ratingsElectrical Overstress (EOS): Devices, Circuits and Systems Rating: 0 out of 5 stars0 ratingsAdvanced Digital Signal Processing and Noise Reduction Rating: 5 out of 5 stars5/5Lyapunov Matrix Equation in System Stability and Control Rating: 0 out of 5 stars0 ratingsStability of Linear Systems: Some Aspects of Kinematic Similarity Rating: 0 out of 5 stars0 ratingsGenomic Signal Processing Rating: 5 out of 5 stars5/5Dynamical Systems Method for Solving Nonlinear Operator Equations Rating: 5 out of 5 stars5/5Operational Amplifiers Rating: 3 out of 5 stars3/5Spacecraft Attitude Control: A Linear Matrix Inequality Approach Rating: 0 out of 5 stars0 ratingsAdaptive Learning Methods for Nonlinear System Modeling Rating: 0 out of 5 stars0 ratingsComputer Vision for Microscopy Image Analysis Rating: 0 out of 5 stars0 ratingsQuantum Detection and Estimation Theory Rating: 4 out of 5 stars4/5Cyclostationary Processes and Time Series: Theory, Applications, and Generalizations Rating: 5 out of 5 stars5/5Singular Optimal Control Problems Rating: 0 out of 5 stars0 ratingsFundamentals of Electronics 2: Continuous-time Signals and Systems Rating: 0 out of 5 stars0 ratingsNon-Linear Differential Equations Rating: 0 out of 5 stars0 ratingsInternational Trends in Optics Rating: 0 out of 5 stars0 ratingsModern Intelligent Instruments - Theory and Application Rating: 0 out of 5 stars0 ratingsIntroduction to Random Signals and Noise Rating: 0 out of 5 stars0 ratingsEngineering and Scientific Computations Using MATLAB Rating: 0 out of 5 stars0 ratings
Physics For You
Quantum Computing For Dummies Rating: 0 out of 5 stars0 ratingsString Theory For Dummies Rating: 4 out of 5 stars4/5Physics I For Dummies Rating: 4 out of 5 stars4/5What If?: Serious Scientific Answers to Absurd Hypothetical Questions Rating: 5 out of 5 stars5/5The Physics Book: From the Big Bang to Quantum Resurrection, 250 Milestones in the History of Physics Rating: 4 out of 5 stars4/5Physics Essentials For Dummies Rating: 4 out of 5 stars4/5Quantum Physics for Beginners Rating: 4 out of 5 stars4/5DIY Lithium Battery Rating: 3 out of 5 stars3/5Step By Step Mixing: How to Create Great Mixes Using Only 5 Plug-ins Rating: 5 out of 5 stars5/5Welcome to the Universe: An Astrophysical Tour Rating: 4 out of 5 stars4/5The Reality Revolution: The Mind-Blowing Movement to Hack Your Reality Rating: 4 out of 5 stars4/5The Theory of Relativity: And Other Essays Rating: 4 out of 5 stars4/5Quantum Physics: A Beginners Guide to How Quantum Physics Affects Everything around Us Rating: 5 out of 5 stars5/5How to Teach Quantum Physics to Your Dog Rating: 4 out of 5 stars4/5Feynman Lectures Simplified 1A: Basics of Physics & Newton's Laws Rating: 5 out of 5 stars5/5What the Bleep Do We Know!?™: Discovering the Endless Possibilities for Altering Your Everyday Reality Rating: 5 out of 5 stars5/5How to Diagnose and Fix Everything Electronic, Second Edition Rating: 4 out of 5 stars4/5The God Effect: Quantum Entanglement, Science's Strangest Phenomenon Rating: 4 out of 5 stars4/5The Dancing Wu Li Masters: An Overview of the New Physics Rating: 4 out of 5 stars4/5Quantum Spirituality: Science, Gnostic Mysticism, and Connecting with Source Consciousness Rating: 5 out of 5 stars5/5QED: The Strange Theory of Light and Matter Rating: 4 out of 5 stars4/5Moving Through Parallel Worlds To Achieve Your Dreams Rating: 4 out of 5 stars4/5The Grid: The Fraying Wires Between Americans and Our Energy Future Rating: 4 out of 5 stars4/5Unlocking Spanish with Paul Noble Rating: 5 out of 5 stars5/5Midnight in Chernobyl: The Untold Story of the World's Greatest Nuclear Disaster Rating: 4 out of 5 stars4/5A Brief Welcome to the Universe: A Pocket-Sized Tour Rating: 5 out of 5 stars5/5A Universe from Nothing: Why There Is Something Rather than Nothing Rating: 4 out of 5 stars4/5Complexity: The Emerging Science at the Edge of Order and Chaos Rating: 4 out of 5 stars4/5
Reviews for Partial-Update Adaptive Signal Processing
0 ratings0 reviews
Book preview
Partial-Update Adaptive Signal Processing - Kutluyil Doğançay
Index
Chapter 1
Introduction
1.1 Adaptive signal processing
In practice most systems are inherently time-varying and/or nonlinear. The signals associated with these systems often have time-varying characteristics. Adaptive signal processing is a branch of statistical signal processing that deals with the challenging problem of estimation and tracking of time-varying systems. By virtue of its applicability to time-varying and/or nonlinear systems, adaptive signal processing finds application in a broad range of practical fields such as telecommunications, radar and sonar signal processing, biomedical engineering and entertainment systems. In order to make the estimation and tracking task tractable, the unknown system is usually modelled as a time-varying linear system or in some cases as a finitely parameterized nonlinear system such as the Volterra filter. This simplified system modelling is guided by prior knowledge of system characteristics. An important objective of adaptive signal processing is to learn the unknown and possibly time-varying signal statistics in conjunction with system estimation.
This chapter presents a brief overview of fundamental principles of adaptive signal processing and motivates partial-update adaptive signal processing as a low-complexity implementation option in the face of resource constraints. Adaptive system identification is shown to be the central theme of adaptive signal processing. In the context of adaptive system identification partial coefficient updating is proposed as an attractive approach to complexity reduction. The chapter sets the scene for the remainder of the book by presenting simple adaptive system identification examples that illustrate the potential benefits of partial-update adaptive signal processing in addition to allowing compliance with the existing resource constraints.
1.2 Examples of adaptive filtering
A fundamental building block for an adaptive signal processing system is the adaptive filter. The objective of an adaptive filter is to learn an unknown system from observations of the system input and/or output signals utilizing any a priori knowledge of the system and signal characteristics. The task of learning an unknown system is fundamental to many signal processing problems and comes in many disguises in applications of adaptive filters. In this section we take a brief look at two broad examples of adaptive filters. These examples serve the purpose of elucidating the basic components of adaptive filters.
1.2.1 Adaptive system identification
Most adaptive filtering problems are either (1) a special case of adaptive system identification or (2) utilize adaptive system identification as a means of solving another signal processing problem. In this sense, adaptive system identification provides the basis for a wide range of adaptive signal processing applications. It is, therefore, essential that we have a good understanding of the underlying principles and assumptions relating to adaptive system identification.
As depicted in Figure 1.1, in adaptive system identification, the objective is to estimate an unknown system from its input and output observations given by x(k, respectively. Throughout this book we restrict our attention to discrete-time signals and systems, so the independent time index k is an integer. A model for the adaptive filter is chosen based on prior knowledge of the unknown system characteristics, as well as complexity considerations. In its simplest and most preferred form, the adaptive filter is a finite impulse response (FIR) filter of length N with adjustable impulse response coefficients (adaptive filter coefficients):
(1.1)
Here T denotes the transpose operator. Equation are assumed to be real-valued unless otherwise specified. It is often straightforward to extend the analysis to adaptive filters with complex coefficients.
Figure 1.1 Adaptive system identification.
is called the error signal e(k) :
(1.2)
At each iteration k the adaptive filter updates its coefficients in order to minimize an appropriate norm of the error signal e(kgives an estimate of the unknown system parameters. If the unknown system is time-varying, i.e. its parameters change with time, the adaptive filter can track these changes by updating its coefficients in accordance with the error signal. It can take several iterations for the adaptation process to converge (i.e. to learn unknown system parameters). The time taken by the adaptation process to converge provides an indication of the convergence rate.
There are two main tasks performed by the adaptive filter; viz. adaptation process and filtering process. In Figure 1.1 these processes are identified by the adaptation process and adaptive filter blocks. For a linear adaptive filter as given by (1.1), the filtering process involves convolution. If the number of adaptive filter coefficients is large, the convolution operation may prove to be computationally expensive. Reduced complexity convolution techniques based on fast Fourier transform (FFT), such as overlap-add and overlap-save, may be used to ease computational demand. The adaptation process can also become computationally expensive for long adaptive filters due to the arithmetic operations required to update the adaptive filter coefficients. The computational complexity of the adaptation process depends on the adaptation algorithm employed.
Prediction of random signals and noise cancellation are two special cases of adaptive system identification. Figure 1.2(a) shows a one-step predictor which estimates the present value of the random signal x(k. If x(k) is a stable autoregressive (AR) process of order N:
(1.3)
where v(kin . After convergence the prediction error e(k) is equal to v(k), which implies whitening of the coloured noise signal x(kat the input of the adaptive filter. Swapping x(kin Figure 1.1 and referring to x(kas the interfering noise changes the system identification problem to a noise cancellation problem with e(kmay undergo before interfering with the signal of interest x(k). The sum of x(kis the primary signal. The unknown system is identified by an adaptive filter. Subtracting the adaptive filter output from the reference signal gives the error signal. Minimization of the error norm implies minimization of the difference between the adaptive filter output and the filtered reference signal. If the adaptive filter provides a perfect estimate of the unknown system, then the error signal becomes identical to the signal of interest. This provides perfect noise removal.
Figure 1.2 Special cases of system identification. (a) One-step prediction of a random signal by an adaptive filter which identifies the autoregressive model of the random signal with y ( k ) giving the prediction output and e ( k ) the prediction error; (b) Adaptive noise cancellation where the adaptive filter estimates the unknown system filtering the input noise signal n ( k ) with x ( k ) denoting the signal of interest and e ( k ) the ‘cleaned’ signal.
1.2.2 Adaptive inverse system identification
Figure 1.3 illustrates the adaptive inverse system identification problem. Comparison of Figures 1.2 and 1.3 reveals that adaptive inverse system identification requires an adaptive filter to be connected to the input and noisy output of the unknown system in the reverse direction. The use of the D for the desired adaptive filter response ensures that the adaptive filter will be able to approximate the inverse system for non-minimum-phase or maximum-phase linear systems. For such systems the stable inverse system is non-causal and has infinite impulse response (IIR). A (causal) FIR adaptive filter can approximate the stable inverse only if it is sufficiently long (i.e. N is sufficiently large) and D ).
Figure 1.3 Adaptive inverse system identification.
as a measure of accuracy for inverse system identification. The adaptive filter coefficients are adjusted iteratively in order to minimize the error norm in a statistical sense. At the end of the minimization process the adaptive filter converges to an estimate of the inverse of the unknown system. Due to the presence of noise at the unknown system output, the inverse system estimate is not identical to the zero-forcing solution that ignores the output