Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Kevin A. Wise
The Boeing Company, Integrated Defense Systems, St. Louis, MO 63166, USA
Eugene Lavretsky
,
Virginia Tech, Blacksburg, VA 24061, USA
This paper presents application of L1 adaptive controller to two benchmark ight control applications.
The benet of the proposed adaptive control approach is its promise for development of theoretically justied
tools for Verication and Validation (V&V) of adaptive systems. It has apriori predictable performance bounds
and guaranteed, bounded away from zero, time-delay margin in the presence of fast adaptation. Two ight
control examples, Unmanned Combat Aerial Vehicle (UCAV) and Aerial Refueling Autopilot, are considered
in the presence of nonlinear uncertainties and control surface failures. The L1 adaptive controller without any
redesign leads to scaled response for systems both signals, input and output, dependent upon changes in the
initial conditions, system parameters and uncertainties.
I. Introduction
Since the early 1990s, Air Force, Navy and NASA, in collaboration with industry and academia have made
signicant progress towards maturing the adaptive control theory for application to recongurable/damage adaptive
ight control for aircraft and weapon systems. Recongurable ight control refers to the ability of a ight control
system to adapt to unknown failures, damage, and uncertain aerodynamics. Flight control systems that are adaptive
Professor, Associate Fellow AIAA, Department of Mechanical Science and Engineering; nhovakim@illinois.edu
Graduate Research Assistant, Student Member AIAA, Department of Aerospace and Ocean Engineering, 215 Randolph Hall;jwang005@vt.edu
(Corresponding Author).
1 of 26
AIAA Guidance, Navigation and Control Conference and Exhibit
18 - 21 August 2008, Honolulu, Hawaii
AIAA 2008-6658
Copyright 2008 by Jiang Wang. Published by the American Institute of Aeronautics and Astronautics, Inc., with permission.
and recongurable constitute an important element in the design of mission effective unmanned combat systems.
These properties of the control system can increase the reliability of unmanned systems.
Both indirect and direct adaptive control methods have been investigated, and several approaches have been suc-
cessfully own on manned and unmanned aircraft, and also on advanced weapon systems. Indirect Adaptive based
approaches include Self-Repairing Flight Control Systems (SRFCS), Self Designing Controller (SDC) and Intelligent
Flight Control System (IFCS) Generation I. Direct adaptive control based approaches have been successfully used in
Recongurable Control for Tailless Fighters (RESTORE) program. The application of those technologies under the
RESTORE program led to the ight testing of the approach on the Boeing/NASA X-36 Agility Research Test Aircraft.
Success in the RESTORE dynamic inversion based adaptive neural-network control of aircraft and missiles offered
the potential to develop ight control systems without knowledge of the aerodynamics. These technological advances,
paved the road to successful transition of adaptive ight control methods into two Boeing / USAF production programs
[14].
Some previous work done by the authors [58] demonstrates the benets and the potential of direct adaptive
control for ying vehicles, and also summarizes the challenges and the open problems in this direction [9]. The
recently developed L
1
adaptive controller addressed some of those challenges by establishing a new paradigm for
design of adaptive control systems. The L
1
adaptive control methodology extends the classical notions of gain and
phase margins to a nonlinear adaptive control scheme, and, for the rst time, enables the design of a nonlinear closed-
loop control system with guaranteed, analytically provable, bounded away from zero, time-delay margin [10, 11]. Its
guaranteed performance bounds and systematic design procedures can signicantly reduce the tuning effort required
for achieving desired closed-loop performance, while operating in the presence of uncertainties. The performance
limitations of L
1
adaptive controller are shown to be consistent with hardware limitations. Furthermore, its ability of
fast adaptation allows for control of nonlinear systems by adapting two parameters only [15]. This, in particularly,
eliminates the need for selecting and tuning neural network basis functions, and with that signicantly reduces the
control design efforts. These features lay foundation for development of theoretically justied tools for Validation and
Verication (V&V) of adaptive systems.
We present the L
1
adaptive controller for two benchmark examples of ight control. First, the X-45A Unmanned
Combat Aerial Vehicle in the presence of unknown actuator failures and pitching moment uncertainty is discussed.
Simulation results demonstrate the benets of the proposed L
1
adaptive controller. The time-delay margin is computed
and shown to be consistent with the theoretical predictions. Next, the Automated Aerial Refueling (AAR) problem
is considered in the presence of vortex induced uncertainties. The simulation is done using Barrons Associates
tailless aircraft model [14]. In both applications, a single design of L
1
adaptive controller achieves (guaranteed)
scaled response for systems both signals, dependent upon changes in initial conditions, reference inputs and system
uncertainties.
2 of 26
II. Problem Formulation
The adaptive control architecture includes a xed robust baseline controller and an augmentation of it by an adap-
tive controller. The baseline controller is designed to yield consistent nominal system performance in the absence of
failures, while the adaptive element provides adaptation and reconguration in the presence of system uncertainties
(e.g., battle damage), control failures and unknown aerodynamics. The linearized open loop plant dynamics can be
generalized and written in the form:
_
_
x
p
(t) = A
p
x
p
(t) + B
p
[u(t) + K
0
(t, x
p
(t))] , x
p
(0) = x
p0
y(t) = C
p
x
p
(t) + D
p
[u(t) + K
0
(t, x
p
(t))]
z
p
(t) = Fy(t)
(1)
where A
p
R
n1n1
, B
p
R
n1m
, C
p
R
ln1
, D
p
R
lm
and F R
pl
are known matrices, u(t) R
m
is virtual control input, diagonal matrix R
mm
is unknown with strictly positive diagonal element
i
, i =
1, 2, , m, and represents control effectiveness uncertainties, K
0
(t, x
p
) R
m
is unknown nonlinear function of
system states. The output y(t) represents the sensor measurements, and z
p
(t) is the subset of the plant outputs that are
to be controlled.
The dynamics of the baseline controller can be generalized and written in the form:
_
_
x
c
(t) = A
c
x
c
(t) + B
1c
z
c
(t) + B
2c
z
p
(t)
u(t) = C
c
x
c
(t) + D
1c
z
c
(t) + D
2c
z
p
(t)
(2)
where z
c
(t) R
q
is the vector of outer-loop commands from guidance, and x
c
R
n2
. Substituting z
p
(t) from (1)
into (2), yields:
_
_
x
c
(t) = A
c
x
c
(t) + B
1c
z
c
(t) + B
2c
F [C
p
x
p
(t) + D
p
(u(t) + K
0
(t, x
p
(t)))]
u(t) = C
c
x
c
(t) + D
1c
z
c
(t) + D
2c
F [C
p
x
p
(t) + D
p
(u(t) + K
0
(t, x
p
(t)))]
(3)
Consequently, the second equation in (3) can be solved explicitly for u(t):
u(t) = (I D
2c
FD
p
)
1
[C
c
x
c
(t) + D
1c
z
c
(t) + D
2c
FC
p
x
p
(t) + D
2c
FD
p
K
0
(t, x
p
(t))]
= (I D
2c
FD
p
)
1
[D
2c
FC
p
C
c
]
_
_
x
p
(t)
x
c
(t)
_
_
. .
x(t)
+(I D
2c
FD
p
)
1
D
1c
z
c
(t)
+(I D
2c
FD
p
)
1
D
2c
FD
p
K
0
(t, x
p
(t)). (4)
The baseline controller u
L
(t), assuming no uncertainties, = I, K
0
(t, x
p
(t)) = 0, can be written as:
u
L
(t) = K
x
x(t) + K
z
z
c
(t) (5)
3 of 26
where
K
x
= (I D
2c
FD
p
)
1
[D
2c
FC
p
C
c
] , K
z
= (I D
2c
FD
p
)
1
D
1c
.
The extended system dynamics are
_
_
x
p
(t)
x
c
(t)
_
_
. .
x(t)
=
_
_
A
p
0
B
2c
FC
p
A
c
_
_
. .
A
_
_
x
p
(t)
x
c
(t)
_
_
. .
x(t)
+
_
_
B
p
B
2c
FD
p
_
_
. .
B1
[u(t) + K
0
(t, x
p
(t))] +
_
_
0
B
1c
_
_
. .
B2
z
c
(t)
y(t) = [C
p
[0]]
. .
C
x(t) + D
p
[u(t) + K
0
(t, x
p
(t))] , (6)
or equivalently,
x(t) = Ax(t) + B
1
[u(t) + K
0
(t, x
p
(t))] + B
2
z
c
(t) (7)
y(t) = Cx(t) + D
p
[u(t) + K
0
(t, x
p
(t))] ,
where x R
n
, n = n
1
+ n
2
.
In the absence of uncertainties, the linear closed-loop dynamics take the form:
x
m
(t) = (A + B
1
K
x
)
. .
Am
x
m
(t) + (B
1
K
z
+ B
2
)
. .
Bm
z
c
(t)
y
m
(t) = (C + D
p
K
x
)
. .
Cm
x
m
(t) + D
p
K
z
. .
Dm
z
c
(t) (8)
The closed-loop system (8) denes the desired nominal response, with A
m
being Hurwitz. The control design relies
on the following assumptions.
Assumption 1
i
[
l
,
u
] , i = 1, 2, , m, (9)
where
u
>
l
> 0 are known.
Let f(t, x(t)) = K
0
(t, x
p
(t)), where f : R R
n
R
m
is an unknown nonlinear function. Notice that
x
p
x
p1
x
p2
x
1
x
2
.
Assumption 2 (Semiglobal Lipschitz Condition) For any > 0, there exist positive L
x
1
x
2
. (10)
f(t, 0)
B , (11)
for all x
1
and x
2
uniformly in t 0.
4 of 26
Assumption 3 (Semiglobal uniform boundedness of partial derivatives) For any > 0, there exist d
fx
() > 0,
and d
ft
() > 0 such that for any x
d
fx
(),
_
_
_
f(t, x)
t
_
_
_
d
ft
(). (12)
The control objective is to design state feedback control u(t) such that despite the system uncertainties and
K
0
(t, x
p
(t)), all closed loop signals are bounded and the system state x(t) tracks the desired model state x
m
(t). Next
we present the L
1
adaptive controller that achieves this objective without the need for any retuning.
III. L
1
Adaptive Control
Consider the following control law
u(t) = u
L
(t) + u
ad
(t), (13)
where u
L
(t) is the component of the baseline linear controller, and u
ad
(t) is the adaptive increment. The baseline
controller is dened in (5), which is repeated here:
u
L
(t) = K
x
x(t) + K
z
z
c
(t) , (14)
where K
x
and K
z
denote the (nm) and (q m) nominal feedback and feedforward gain matrices, correspondingly.
Using these stabilizing gains for the system in (6), it takes the form:
x(t) = (A + B
1
K
T
x
)x(t) + B
1
(u
ad
+ K
0
(t, x
p
(t))) + (B
2
+ B
1
K
T
z
)z
c
(t) . (15)
From (8) and (15), we have
x(t) = A
m
x(t) + B
m
z
c
(t) + B
1
_
u
ad
(t) + K
0
(t, x
p
(t)) + k
x
x(t) + k
z
z
c
(t)
_
, (16)
where
k
x
= ( I)K
x
, k
z
= ( I)K
z
. (17)
Remark 1 In the absence of actuator failures, i.e. when = I
m
, we have k
x
(t) = 0
nm
and k
z
(t) = 0
qm
. This
implies that the adaptive system augments the baseline inner-loop controller, and therefore the incremental adaptive
feedback gains can be initialized at zero.
The design of L
1
adaptive controller involves a diagonal transfer function matrix D(s) with strictly proper transfer
function elements and a positive diagonal feedback gain matrix k R
mm
D(s) =
_
_
D
1
(s) 0 0 0
0 D
2
(s) 0 0
0 0
.
.
. 0
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
0 0 0 D
m
(s)
_
_
(18)
5 of 26
k =
_
_
k
1
0 0 0
0 k
2
0 0
0 0
.
.
. 0
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
0 0 0 k
m
_
_
. (19)
Furthermore, D(s) and k lead to strictly proper stable
C(s) =
_
_
C
1
(s) 0 0 0
0 C
2
(s) 0 0
0 0
.
.
. 0
.
.
.
.
.
.
.
.
.
.
.
.
.
.
.
0 0 0 C
m
(s)
_
_
,
C
i
(s) =
i
k
i
D
i
(s)
1 +
i
k
i
D(s)
, i = 1, 2, , m (20)
with low-pass gain C
i
(0) = 1. One simple choice is
D
i
(s) =
1
s
, (21)
which yields a rst order strictly proper C(s) in the following form
C(s) =
_
_
1k1
s+1k1
0 0 0
0
2k2
s+2k2
0 0
0 0
.
.
. 0
.
.
.
.
.
.
.
.
.
.
.
.
0 0 0
mkm
s+mkm
_
_
. (22)
Further, let
L
x
= max{|
l
1|, |
u
1|}K
x
L1
= max{|
l
1|, |
u
1|} max
i=1,2, ,m
(
n
j=1
|K
xji
|) , (23)
L
z
= max{|
l
1|, |
u
1|}K
z
L1
= max{|
l
1|, |
u
1|} max
i=1,2, ,m
(
n
j=1
|K
zji
|) ,
where K
xji
(t) are the j
th
row i
th
column element of K
x
. We now state the L
1
performance requirement that ensures
stability of the entire system and desired transient performance, as in [15].
Let
H(s) = (sI A
m
)
1
B
1
, (24)
H
m
(s) = (sI A
m
)
1
B
m
, (25)
6 of 26
and r
0
(t) be the signal with its Laplace transformation (sI A
m
)
1
x
0
. Since A
m
is Hurwitz and x
0
is nite, r
0
L
is nite.
L
1
-gain stability requirement: The choice of D(s) and k needs to ensure that there exists
r
such that:
G(s)
L1
<
_
r
(G(s)
L1
L
z
+H
m
(s)
L1
) z
c
L
r
0
L
_
/(
r
L
r
+
r
L
x
+ B) , (26)
where
G(s) = H(s)(I
mm
C(s)) ,
Remark 2 We notice that the L
1
-gain stability requirement in (26) is a consequence of the semiglobal Lipschitz
property of f(t, x), stated in Assumption 1. If f(t, x) is globally Lipschitz with uniform Lipschitz constant L
g
, then
lim
r
_
r
(G(s)
L1
L
z
+H
m
(s)
L1
) z
c
L
r
0
L
_
/(
r
L
g
+
r
L
x
+ B) =
1
L
g
+ L
x
=
1
L
,
where L = L
g
+ L
x
, and the L
1
-gain stability requirement in (26) degenerates into
G(s)
L1
< 1/L,
which is the same as the one derived in [16] for systems with constant unknown parameters. Notice that (26) is a
sufcient condition for stability.
The elements of L
1
adaptive controller are introduced next:
State Predictor: We consider the following state predictor:
x(t) = A
m
x(t) + B
m
z
c
(t) + B
1
_
(t)u
ad
(t) +
(t)x(t)
(t) +
k
x
(t)x(t) +
k
z
(t)z
c
(t)
_
y(t) = c
x(t) , x(0) = x
0
, (27)
where
(t) R
1m
and (t) R
1m
.
Adaptive Laws: Adaptive estimates
(t),
(t), (t),
k
x
(t),
k
z
(t) are governed by the following adaptation laws.
(t) = Proj(
(t), x(t)
(t)PB
1
),
(0) =
(t)PB
1
), (0) =
0
(t) = Proj(
(t), u
ad
(t) x
(t)PB
1
),
(0) =
k
x
(t) = Proj(
k
x
(t), x(t) x
(t)PB
1
) ,
k
x
(0) = 0
k
z
(t) = Proj(
k
z
(t), z
c
(t) x
(t)PB
1
) ,
k
z
(0) = 0,
where x(t) = x(t) x(t), =
c
I is the adaptation gain matrix, P is the solution of the algebraic equation A
m
P +
PA
m
= Q, Q > 0, and the projection operator ensures that the adaptive estimates
(t),
(t), (t),
k
x
(t),
k
z
(t)
remain inside the compact sets [
l
,
u
], [
b
,
b
], [
b
,
b
], [L
x
, L
x
], [L
z
, L
z
] respectively, with
b
,
b
dened as follows
b
= L
,
b
= B + , (28)
7 of 26
where is an arbitrary positive constant and
=
r
+ , (29)
with being an arbitrary positive constant as well.
Control Law: The control signal is generated through gain feedback of the following system:
(s) = D(s) r(s) , u
ad
(s) = k(s) , (30)
where r(s) is the Laplace transformation of
r(t) =
(t)u
ad
(t) +
(t)x(t)
(t) +
k
x
(t)x(t) +
k
z
(t)z
c
(t). (31)
The complete L
1
adaptive controller consists of (27), (28) and (30) subject to the L
1
-gain stability requirement in
(26).
IV. Analysis of L
1
Adaptive Controller
IV.A. Reference System
We now consider the following closed-loop reference system with its control signal and system response being dened
as follows:
x
ref
(t) = A
m
x
ref
(t) + B
m
z
c
(t) + B
1
_
f(t, x
ref
(t)) + u
ref
(t) + k
x
x
ref
+ k
z
z
c
(t)
_
(32)
u
ref
(s) =
1
C(s) r
ref
(s) (33)
y
ref
(t) = c
x
ref
(t) , x
ref
(0) = x
0
, (34)
where r
ref
(s) is the Laplace transformation of the signal r
ref
(t) = f(t, x
ref
(t)) + k
x
x
ref
(t) + k
z
z
c
(t). The next
Lemma establishes the stability of the closed-loop system in (32)-(34).
Lemma 1 For the closed-loop reference system in (32)-(34) subject to the L
1
-gain stability condition in (26), we have
x
ref
L
<
r
, (35)
u
ref
L
<
ur
, (36)
where
r
is dened in (26) and
ur
=
1
C(s)
L1
(L
r
r
+ L
x
r
+ B + L
z
z
c
L
).
A proof can be found in [15].
8 of 26
IV.B. Equivalent Linear Time-Varying System
In this section we demonstrate that the nonlinear system in (16) can be transformed into a linear system with unknown
time-varying parameters. We need to rst introduce several notations. Choose
0
to satisfy
1
C(s)
L1
1 G(s)
L1
L
0
+
1
< , (37)
where 0 <
1
< is an arbitrary positive constant. We notice that
0
can be arbitrarily small since and
1
can be
set arbitrarily. We will prove that by increasing the adaptive gain,
0
can serve as an upper bound for the tracking error
signal x(t). Dene
B
r
_
B
1
B
1
,
H
r
(s) (sI A
m
)
1
B
r
,
C
r
(s)
_
1
C(s) 0
0
C(s)
_
_ , (38)
where the choice of
B
1
renders B
r
IR
nn
full rank, and
C(s) is an arbitrary diagonal strictly proper stable transfer
function. Further, let
u
=
ur
+
2
, (39)
2
=
_
_
1
C(s)
_
_
L1
(L
+ L
x
)
1
+
_
_
1
C
r
H
1
r
_
_
L1
0
. (40)
Lemma 2 If
x
t
L
, (41)
u
t
L
u
, (42)
where ()
t
L
denotes the truncated L
<
b
, (43)
()
<
b
, (44)
f(, x()) = ()x()
+ () . (45)
Refer to [15] for the proof.
Since
x
0
r
, u(0) = 0 , (46)
and x(t), u(t) are continuous, there always exists t such that
x
t
L
, u
t
L
u
. (47)
9 of 26
It follows from (47) and Lemma 2 that the system in (16) can be rewritten over [0, t] as:
x() = A
m
x() + B
m
z
c
() + B
1
_
()x()
+ u
ad
() + () + k
x
x() + k
z
z
c
()
_
,
y() = c
x(), x(0) = x
0
, (48)
where (), () are unknown time-varying signals subject to:
|()| <
b
, |()| <
b
, [0, t] . (49)
|
()| d
(,
u
) , | ()| d
(,
u
) , [0, t]. (50)
IV.C. Transient and Steady-State Performance
Theorem 1 Consider the reference system in (32)-(34) and the closed-loop L
1
adaptive controller in (16), (27), (28),
(30) subject to (26). If the adaptive gain is chosen to verify the lower bound:
c
>
m
(,
u
)
min
(P)
2
0
, (51)
where
m
(,
u
) 4m
2
2
b
+ 4m
2
2
b
+ m
2
(
u
l
)
2
+ 4m
2
L
2
x
+ 4m
2
L
2
z
+4
max
(P)
min
(Q)
(
b
d
(,
u
) +
b
d
(,
u
)) , (52)
we have:
x
L
0
, (53)
x x
ref
L
<
1
, (54)
u u
ref
L
<
2
, (55)
where
1
and
2
are dened in (37) and (40).
See [15] for proof details.
It follows from (51) that we can achieve arbitrarily small
0
by increasing the adaptive gain.
IV.D. Design Guidelines
We note that the control law u
ref
(t) in the closed-loop reference system, which is used in the analysis of L
norm
bounds, is not implementable since its denition involves the unknown parameters. Theorem 1 ensures that the L
1
adaptive controller approximates u
ref
(t) both in transient and steady state. So, it is important to understand how these
bounds can be used for ensuring uniform transient response with desired specications. We notice that the following
ideal control signal
u
id
(t) =
1
_
f(t, x
id
(t)) + k
x
x
id
(t) + k
z
z
c
(t)
_
(56)
10 of 26
is the one that leads to desired system response:
x
id
(t) = A
m
x
id
(t) + B
m
z
c
(t), y
id
(t) = c
x
id
(t) (57)
by canceling the uncertainties exactly. In the closed-loop reference system (32)-(34), u
id
(t) is further low-pass ltered
by C(s) to have guaranteed low-frequency range. Thus, the reference system in (32)-(34) has a different response as
compared to (57) achieved with (56). We refer the reader to [17] for specic design guidelines on selection of C(s)
to ensure that the response of x
ref
(t) and u
ref
(t) can be made as close as possible to (57). Moreover, for systems
linearly dependent upon unknown parameters, the (nonlinear) L
1
adaptive controller has analytically computable time-
delay margin [11]. The trade-off between the time-delay margin and the performance of the L
1
adaptive controller
depends solely upon the bandwidth of C(s). Increasing the bandwidth of C(s) leads to improved performance at
the price of reduced time-delay margin. In [18], we consider constrained optimization of the performance and/or the
robustness of L
1
adaptive controller by resorting to appropriate Linear Matrix Inequality (LMI) type conditions. If
the corresponding LMI has a solution, then arbitrary desired performance bound can be achieved, while retaining a
prespecied lower-bound on the time-delay margin.
V. Unmanned Combat Aerial Vehicle
The L
1
adaptive controller is applied to a model of the aerodynamically unstable X-45A Unmanned Combat
Aerial Vehicle (UCAV) in the presence of actuator failures and pitch break uncertainty (unknown nonlinear in Angle
of Attack (AoA) pitching moment increment). This uncertainty is introduced in pitch dynamics in order to model
unknown changes in the aircraft pitching moment that can drive the aircraft into an uncontrollable (in AOA) region.
We recall the aircraft dynamics from (7):
x(t) = Ax(t) + B
1
(u(t) + K
0
(t, x
p
(t))) + B
2
z
c
(t) ,
x(0) = x
0
= 0 , (58)
where x(t) R
9
, u(t) R
3
(virtual control input), z
c
(t) R
4
are the measured system states, control signals and
reference inputs, respectively, A R
99
, B
2
R
94
, B
1
R
93
are known matrices where the three columns of B
1
are linearly independent,
=
_
1
0 0
0
2
0
0 0
3
_
_
(59)
is an unknown diagonal matrix with strictly positive diagonal elements. The state vector x = (, , p, q, r, q
I
, p
I
, r
I
, r
w
)
x
x(t) + k
z
z
c
(t)
_
. (60)
where the adaptive control signal u
ad
(t) is dened according to L
1
adaptive controller (27), (28) and (30), subject to
the L
1
-gain upper bound in (26). This is different from the approach, presented in [12], where RBF approximation
was employed for approximation of the nonlinearity. This signicantly reduces the design effort by eliminating the
need for RBF distributions and centers/widths tuning.
Note that the vector-function K
0
(t, x
p
) represents the matched unknown nonlinearities. In addition to unknown
K
0
(t, x
p
), models the loss of control effectiveness caused by actuator failures. The matrix models the uncertainties
in virtual control u(t), and is dened in a way that each diagonal element of represents a scaling factor for control
effectiveness in particular channel. Thus, is diagonal and is different from the control allocation matrix, which has
already been incorporated in B
1
in (58). The real control actuators are left outer board
LOB
, left middle board
LMB
,
left inner board
LIB
, right inner board
RIB
, right middle board
RMB
, right outer board
ROB
and thrust
Tvec
.
We only design the virtual controls (roll, pitch and yaw). When one or some of the control surfaces fail, the scaling
factor for each virtual control will change. As long as the failures do not cause loss of controllability for each input,
the matrix will remain diagonal and positive denite, as required by the main assumption of the above presented
adaptive control approach.
The inner-loop control objective is to design a full state-feedback controller u
ad
(t) for (60) such that all closed-
loop signals remain bounded, and the system state tracks the state of a desired reference model in the presence of
uncertainties and actuator failures. We compare the performance of the nominal plant in the presence of pitch break
and actuator failure with the performance of the closed-loop system with L
1
adaptive controller. For the L
1
adaptive
controller we set k
i
= 20, where i = 1, 2, 3, and D(s) =
1
s
which veries the L
1
gain stability condition, and we set
= 100000. The results are shown in Figures 1 and 2. For comparison purposes, simulation data are obtained from
the following three closed-inner-loop systems: a) adaptation OFF, failures OFF, b) adaptation OFF, failures ON, c) d)
L
1
adaptation ON, failures ON.
Figures 1-2 demonstrate the benets of adaptation, when the right outboard (ROB) elevon fails at 1 second of the
maneuver and the pitch break phenomenon is active throughout the entire maneuver. The failure of ROB causes the
change of matrix:
=
_
_
1 0 0
0 0.1399 0
0 0 0.3798
_
_
.
Figure 1 indicates that in spite of the unknown control failure and pitch break uncertainty, the L
1
adaptive system
is able to quickly recongure and track the commanded vertical acceleration, sideslip angle, roll rate, and yaw rate
12 of 26
signals, simultaneously. In fact, Figure 1 shows that with the adaptation turned on the desired/nominal system tracking
behavior has been recovered. In addition, Figure 2 compares the three virtual control feedback signals, and conrms
that the level of control activity is reasonable. In Figure 3, the subplot of Figure 1 is re-plotted to show the perfect
tracking achieved by L
1
for vertical acceleration.
0 5 10 15 20 25 30 35 40 45 50
15
10
5
0
5
v
e
r
tic
a
l a
c
c
e
le
r
a
tio
n
A
z
[ft/s
2
]
time [s]
ROB elevon fail at 1 s, pitch break ON
nominal baseline
uncertain baseline
uncertain L
1
0 5 10 15 20 25 30 35 40 45 50
2
0
2
4
s
id
e
s
lip
a
n
g
le
[d
e
g
]
time [s]
0 5 10 15 20 25 30 35 40 45 50
10
0
10
20
r
o
ll r
a
te
P
s
[d
e
g
/s
]
time [s]
0 5 10 15 20 25 30 35 40 45 50
1
0.5
0
0.5
1
1.5
y
a
w
r
a
te
R
s
[d
e
g
/s
]
time [s]
Figure 1. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Command Tracking
0 5 10 15 20 25 30 35 40 45 50
1
0
1
2
3
4
P
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
ROB elevon fail at 1 s, pitch break ON
0 5 10 15 20 25 30 35 40 45 50
0.4
0.2
0
0.2
0.4
0.6
Q
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
0 5 10 15 20 25 30 35 40 45 50
0.06
0.04
0.02
0
0.02
0.04
R
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
time [s]
Figure 2. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Virtual Controls
When the reference commands change, the system output and input have scaled responses similar to those of linear
13 of 26
0 5 10 15 20 25 30 35 40 45 50
12
10
8
6
4
2
0
2
v
e
r
tic
a
l a
c
c
e
le
r
a
tio
n
A
z
[ft/s
2
]
time [s]
ROB elevon fail at 1 s, pitch break ON
nominal baseline
uncertain baseline
uncertain L
1
Figure 3. Zoomed subplot of Fig 2 to show Guaranteed L1 performance
systems. These are shown in Figures 4, 5.
0 5 10 15 20
14
12
10
8
6
4
2
0
2
v
e
r
t
i
c
a
l
a
c
c
e
l
e
r
a
t
i
o
n
A
z
[
f
t
/
s
2
]
time [s]
medium command
small command
large command
Figure 4. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Scaled Command Tracking
Next we discuss robustness of the scheme. The time-delay margin for the inner loop (without adaptive feedback)
can be computed from the phase margin of the open loop transfer functions. The open loop transfer functions are
calculated by breaking the virtual control ( p, q, r) command loops one at a time keeping the other two loops closed.
14 of 26
0 2 4 6 8 10 12 14 16 18 20
0.4
0.2
0
0.2
0.4
0.6
P
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
medium command
small command
large command
0 2 4 6 8 10 12 14 16 18 20
0.4
0.2
0
0.2
0.4
0.6
Q
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
time [s]
0 2 4 6 8 10 12 14 16 18 20
0.05
0
0.05
R
d
o
t C
M
D
[d
e
g
/s
s
e
c
1
]
time [s]
Figure 5. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Scaled Virtual Control
This is shown in Table 1.
Table 1. Phase and time-delay margins for the inner loop
Loop Margin p q r
Phase Margin (deg) 85.6 65.6 66.1
Cross-over Frequency (rad/sec) 4.25 6.01 4.27
Time-delay Margin (sec) 0.3515 0.1905 0.2702
To calculate the time-delay margin for the adaptive system, we introduce the time-delay at the plant input, and
compute the margins using numerical simulations.
The time-delay margins for L
1
adaptive scheme are summarized in Table 2 for C(s) =
1
0.05s+1
and = 100000.
The worst case time-delay margin is 0.043 sec, which is small. Now we discuss how to improve the time-delay margin
by the change of C(s) using the analysis from [11].
The time-delay margin for the L
1
adaptive scheme for systems linearly dependent upon unknown parameters (i.e.,
in the absence of nonlinear unknown function), can be computed analytically as [11]. In [11], C(s)/(1C(s))
appears as a multiplier in the open-loop transfer function used for calculation of the lower bound on the time-delay
margin for the L
1
adaptive scheme. It is obvious that one could choose C(s) judiciously to maximize the phase margin
of the open-loop transfer function and minimize the cross-over frequency to obtain larger time-delay margin. Towards
15 of 26
Table 2. Time-delay margin for L1 for C(s) =
1
0.05s+1
p q r
n/a 0.056 n/a Individual
0.070 n/a n/a Individual
n/a n/a 0.055 Individual
0.0430 0.0430 n/a Two Loops
n/a 0.0450 0.0450 Two Loops
0.052 n/a 0.052 Two Loops
0.043 0.043 0.043 Simultaneous
that end, consider the following low-pass lter
C
1
(s) =
1
0.05s + 1
(6s + 1)
2
(8s + 1)
2
,
for which the L
1
gain requirement holds. The corresponding D
1
(s) will be
D
1
(s) =
(6s + 1)
2
s(3.2s
2
+ 28.8s + 28.05)
.
The Bode plots of D(s) and D
1
(s) are given in Figure 6. Note that a nonminimum phase lter is used to enhance
the phase characteristic in the region of frequency-band in order to improve the phase margin.
20
10
0
10
20
30
40
50
60
70
M
a
g
n
i
t
u
d
e
(
d
B
)
10
2
10
1
10
0
10
1
10
2
90
135
180
225
270
315
360
405
450
P
h
a
s
e
(
d
e
g
)
Bode Diagram
Frequency (rad/sec)
D(s)=1/s
D
1
(s)=(6s+1)
2
/(s(3.2s
2
+28.8s+28.05))
Figure 6. Choice of C(s) to maximize the time-delay margin
16 of 26
The subplot of vertical acceleration of Figure 1 is repeated with C
1
(s) in Figure 7. We see that there is some
degradation in the tracking, however it is still satisfactory. For this choice of C
1
(s), the worst case time-delay obtained
from simulation is 0.10 sec. In Table 2, we have the worst case time-delay margin for C(s) equal to 0.0425sec, which
implies that C
1
(s) doubles the time-delay margin. Thus, at this stage, it appears that improving the time-delay margin
hurts the transient performance, which is consistent with the conventional claims in linear systems theory. From
this perspective, the L
1
adaptive control paradigm achieves clear separation between adaptation and robustness: the
adaptation can be as fast as the CPU permits, while robustness can be resolved via conventional methods well known
from classical and robust control. We note that all the time-delay margins are calculated for the ROB actuator failure
case and in the presence of the pitch break uncertainty.
0 10 20 30 40 50
10
8
6
4
2
0
2
v
e
r
t
i
c
a
l
a
c
c
e
l
e
r
a
t
i
o
n
A
z
[
f
t
/
s
2
]
time [s]
ROB elevon fail at 1 s, pitch break ON
nominal baseline
C(s) = 1/(0.05s+1)
C
1
(s)= C(s)*(6s+1)
2
/(8s+1)
2
Figure 7. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Command Tracking (for Different Choice of C(s))
However, we note that a smaller value of is preferable from an implementation point of view. Figure 8 shows the
system response for different values of for both low-pass lters. It can be seen that there is almost no degradation
in the time response performance. However, for the low-pass lter C(s) =
1
0.05s+1
, if we decrease from 100000 to
10000, the worst case time-delay margin decreases from 0.043 to 0.003 (i.e. almost 14 times). However, for C
1
(s) it
decreases from 0.11 to 0.09 (i.e only 1.2 times). Thus, with smaller choice of , C
1
(s) is much suitable in terms of
robustness as compared to C(s). Table 3 summarizes the margins for C
1
(s) with = 10000.
Finally, we simulate the system with two actuator failures without any delays to test robustness of the L
1
adaptive
control scheme towards a different class of uncertainty. Figure 9 plots the vertical acceleration command tracking
in the presence of pitch break uncertainty and ROB and LMB elevon failures. We see that the L
1
adaptive control
architecture retains both its tracking property and as well the worst time-delay margin of 0.095, as predicted by the
17 of 26
Table 3. Time-delay margin of L1 for C1(s) and = 10000
p q r
n/a 0.18 n/a Individual
0.3 n/a n/a Individual
n/a n/a 0.25 Individual
0.10 0.10 n/a Two Loops
n/a 0.10 0.10 Two Loops
0.12 n/a 0.12 Two Loops
0.09 0.09 0.09 Simultaneous
0 10 20 30 40 50
10
8
6
4
2
0
2
v
e
r
t
i
c
a
l
a
c
c
e
l
e
r
a
t
i
o
n
A
z
[
f
t
/
s
2
]
time [s]
ROB elevon fail at 1 s, pitch break ON
C(s), = 100000
C
1
(s), = 100000
C
1
(s), = 10000
C(s), = 10000
Figure 8. Inner-Loop Adaptation with ROB Elevon Failure and Pitch Break Phenomenon: Command Tracking (for different values of )
L
1
theory. In Table 4, we have summarized the worst-case time delay margins for single actuator and two actuator
failures.
18 of 26
0 5 10 15 20
10
8
6
4
2
0
2
4
v
e
r
t
i
c
a
l
a
c
c
e
l
e
r
a
t
i
o
n
A
z
[
f
t
/
s
2
]
time [s]
ROB & LMB elevon fail, pitch break ON (A
z
command only)
nominal baseline
ROB and LMB failure
L
1
with C
1
(s)
Figure 9. MRAC loses stability in the presence of two actuator failures, while L1 proves guaranteed tracking
Table 4. Worst case time-delay margin with single and double actuator failures
Single Double
0.043 0.043 C(s) 100000
0.0225 0.020 C(s) 10000
0.11 0.13 C
1
(s) 100000
0.09 0.095 C
1
(s) 10000
VI. Aerial Refueling
In this section we apply the L
1
adaptive controller to Autonomous Aerial Refueling (AAR) autopilot design. The
probe-and-drogue refueling procedure is adopted. This has proven to be extremely difcult due to the aerodynamic
coupling among the two aircraft, receiver and tanker, and the drogue. The autopilot has to compensate for the uncer-
tainties due to the trailing vortices of the tanker when the receiver is ying from the observation point to the contact
point. As compared to the earlier work of the authors [19], the control signal dened via (27), (28) and (30) subject
to the L
1
-gain stability requirement in (26), eliminates the need for selecting and tuning basis functions required by
neural network based L
1
adaptive control. This reduces the design effort signicantly.
We consider a decoupled linearized six-degree-of-freedom (6-DOF) aircraft model for the receiver aircraft. Both
the receiver and the tanker aircraft are in straight and level ight in the beginning of the maneuver. The receiver is
19 of 26
assumed to be subject only to small perturbations during the entire refueling maneuver so that the linearized decoupled
dynamics can be used to describe its motion with some level of delity, with additive uncertainties coming from the
trailing vortices induced by the tanker aircraft. For the aerial refueling maneuver all angles are assumed small. Besides
these assumptions, we also neglect the inuence of gravity, thrust, and elevator on the angle of attack. The drogue
position is known, served as reference command z
c
(t), and the control objective is to y the receiver into a prescribed
neighborhood of the drogue center within a prescribed nite time interval. Upon incorporating inner loop baseline
controllers into the system dynamics, the system to be controlled has three inputs: thrust, elevator and aileron, and
has three outputs: horizontal separation, vertical separation and lateral separation relative to the tanker. The control
objective is to regulate three outputs to certain set points in the presence of aerodynamic uncertainties (drag, pitching
moment and rolling moments) in three directions respectively, and in the presence of control surface failures.
The aircraft model is a ying-wing unmanned aerial vehicle (UAV), known as the Barrons Associates nonlinear
tailless aircraft model (BANTAM) [14]. The wake-effect data which models the vortex are taken from a wind-tunnel
test of a delta wing UAV behind KC-135R tanker [20]. The baseline controller is a Linear Quadratic Regulation (LQR)
controller with integral action. For this LQR+PI controller structure, the feedforward gain K
z
is zero. The system
takes the form in (16), which is repeated here for the sake of completeness:
x(t) = A
m
x(t) + B
m
z
c
(t) + B
1
_
u
ad
(t) + K
0
(t, x
p
(t)) + k
x
x(t)
_
, (61)
where x(t) R
14
, u
ad
(t) R
3
(thrust, elevator and aileron), z
c
(t) R
3
are the measured system states, control
signals and reference inputs, respectively, A
m
R
1414
, B
m
R
143
, B
1
R
143
are known matrices where
the three columns of B
1
are linearly independent, The denitions of , k
x
are given in (17). Notice that there is no
k
z
in equation (61). The state vector x = (l, V, , , q, h, , , p, r, y, l
I
, h
I
, y
I
)
0 5 10 15 20 25
2
1
0
1
2
3
4
s
t
a
t
e
s
a
n
g
u
la
r
v
e
lo
c
it
y
(
d
e
g
/
s
e
c
)
time sec
p
q
r
Figure 11. Angels and angular velocities - Baseline Controller
For the design of L
1
controller we choose D
i
(s) =
1
s
, i = 1, , m. Conservative growth rates for the uncer-
tainties are computed from the experimental data, implying that max L
wi
= 0.1. The conservative maximum is given
by L
i
= 10.1. We choose k
1
= k
2
= k
3
= 20 leading to C
1
(s) =
20
s+20
, C
2
(s) =
8
s+8
and C
3
(s) =
8
s+8
. We set
a uniform adaptive gain = 100000 for the design of the adaptive controller in each axis. The closed loop system
response with L
1
adaptive augmentation and the adaptive control signals are shown in Figure. 12. We notice that
L
1
adaptive controller can recover the nominal performance of the baseline controller in the presence of the wake
vortex and loss in control effectiveness. The tracking precision upon t
) z(t
)]
[y
d
(t
) z
d
(t
)]
) x
d
(t
) z(t
)]
0 5 10 15 20 25 30
250
200
150
100
50
0
h
o
r
iz
o
n
t
a
l
s
e
p
e
r
a
t
io
n
f
t
L1
nominal
0 5 10 15 20 25 30
1
0.8
0.6
0.4
0.2
0
(
f
o
r
c
e
/
m
a
s
s
)
time sec
adaptive approximation
uncertainties
0 5 10 15 20 25 30
4920
4940
4960
4980
5000
v
e
r
t
ic
a
l
s
e
p
e
r
a
t
io
n
f
t
L1
nominal
0 5 10 15 20 25 30
1
0.5
0
0.5
1
(
m
o
m
e
n
t
/
m
o
m
e
n
t
o
f
in
e
r
t
ia
)
time sec
adaptive approximation
uncertainties
0 5 10 15 20 25 30
40
20
0
20
40
la
t
e
r
a
l
s
e
p
e
r
a
t
io
n
f
t
L1
nominal
0 5 10 15 20 25 30
0.4
0.2
0
0.2
0.4
(
m
o
m
e
n
t
/
m
o
m
e
n
t
o
f
in
e
r
t
ia
)
time sec
adaptive approximation
uncertainties
Figure 14. Horizontal, Vertical and Lateral Separation - second case
[y
d
(t
) z
d
(t
)]
) x
d
(t
norm and L
L
= max
i=1,..,n
_
sup
0t
|
i
()|
_
,
L
= max
i=1,..,n
_
sup
0
|
i
()|
_
,
where
i
is the i
th
component of .
Denition 2 The L
1
gain of a stable proper singleinput singleoutput system H(s) is dened to be ||H(s)||
L1
=
_
0
|h(t)|dt, where h(t) is the impulse response of H(s).
Denition 3 For a stable proper m input n output system H(s) its L
1
gain is dened as
H(s)
L1
= max
i=1, ,n
_
_
m
j=1
H
ij
(s)
L1
_
_
,
where H
ij
(s) is the i
th
row j
th
column element of H(s).
References
1
M. Sharma, A. J. Calise and J. E. Corban, Application of an Adaptive Autopilot Design to a Family of Guided Munitions, Proceedings of
AIAA Guidance, Navigation, and Control Conference and Exhibit, Denver, CO, August, 2000.
2
J. E. Corban, V. Burkemper, K. Holt, J. Evers, A. J. Calise and M. Sharma, Flight Test Of An Adaptive Autopilot For Precision Guided
Munitions, Proceedings of AIAA Missile Sciences Conference, 2000.
3
M. Sharma, K. Wise and E. Lavretsky, Application and Flight Testing of an Adaptive Autopilot on Precision Guided Munitions, Proceedings
of AIAA Guidance, Navigation, and Control Conference and Exhibit, Keystone, CO, August, 2006.
4
K. Wise, E. Lavretsky, J. Zimmerman, J. Francis-Jr, D. Dixon and B. Whitehead, Adaptive Flight Control of a Sensor Guided Munitions,
Proceedings of AIAA Guidance, Navigation, and Control Conference and Exhibit, San Francisco, CA, August, 2005.
5
K. Wise, Recongurable Systems for Tailless Fighter Aircraft - RESTORE, Final Report, AFRL-VA-WP-TR-99-3067.
6
K. Wise, and J. Brinker, Recongurable Flight Control for a Tailless Advanced Fighter Aircraft, Proceedings of AIAA Guidance, Navigation,
and Control Conference and Exhibit, Boston, MA, August, 1998.
7
K. Wise, J. Brinker, A. Calise, D. Enns, M. Elgersma and P. Voulgaris, Direct Adaptive Recongurable Flight Control For ATailless Advanced
Fighter Aircraft, Int. Journal of Robust Nonlinear Control, Special Issue on Recongurable Flight Control, 9:999-1012, 1999.
8
E. Lavretsky and K. Wise, Adaptive Flight Control for Manned/Unmanned Military Aircraft, Proceedings of American Control Conference,
Portland, OR, June, 2005.
9
K. Wise, E. Lavretsky and N. Hovakimyan, Adaptive Control of Flight: Theory, Applications, and Open Problems, Proceedings of American
Control Conference, Minneapolis, MN, June 2006.
10
C. Cao and N. Hovakimyan, Design and Analysis of a Novel L
1
Adaptive Control Architecture with Guaranteed Transient Performance,
IEEE Transactions on Automatic Control, 53(2):586-891, 2008.
11
C. Cao and N. Hovakimyan, Stability Margins of L
1
Adaptive Control Architecture, Proceedings of American Control Conference, New
York, NY, July 2007.
25 of 26
12
V. Patel, C. Cao, N. Hovakimyan, K. Wise and E. Lavretsky, L
1
Adaptive Controller for Tailless Unstable Aircraft, Proceedings of AIAA
Guidance, navigation and Control Conference, Hilton Head Island, SC, August 2007.
13
C. Cao and N. Hovakimyan, Adaptive Output Feedback Controller for Systems of Unknown Dimension, IEEE Transactions on Automatic
Control, 53(3):815-821, 2008.
14
J. Farrell, M. Sharma and M. Polycarpou, Backstepping-Based Flight Control with Adaptive Function Approximation, Journal of Guidance,
Control and Dynamics, 8(6):1089-1102, 2005.
15
C. Cao and N. Hovakimyan, Adaptive Controller for a Class of Systems with Unknown Nonlinearities: Part I, Proceedings of American
Control Conference, Seattle, WA, 2008.
16
C. Cao and N. Hovakimyan, Design and Analysis of a Novel L
1
Adaptive Control Architecture, Part II: Guaranteed Transient Performance,
Proceedings of American Control Conference, pages 3403-3408, 2006.
17
C. Cao and N. Hovakimyan, A Novel L
1
Neural Network Adaptive Control Architecture with Guaranteed Transient Performance, IEEE
Trans. on Neural Networks, 18:1160-1171, July 2007.
18
D. Li, N. Hovakimyan, C. Cao and K. Wise, Filter Design for Feedback-loop Trade-off of L
1
Adaptive Controller: A Linear Matrix
Inequality Approach, Proceedings of AIAA Guidance, navigation and Control Conference, Honolulu, HI, August 2008.
19
J. Wang, V. Patel, C. Cao, N. Hovakimyan and E. Lavretsky, Novel L
1
Adaptive Control Methodology for Aerial Refueling with Guaranteed
Transient Performance, Journal of Guidance, Control and Dynamics, 31(1):182-193, 2008.
20
W. B. Blake, E. G. Dickes and D. R. Gingras, UAV Aerial Refueling - Wind Tunnel Results and Comparison with Analytic Predictions,
Proceedings of AIAA Atmospheric Flight Mechanics Conference and Exhibit, Providence, RI, AIAA-2004-4820, 2004.
21
P. Ioannou and J. Sun. Robust Adaptive Control. Prentice Hall, 1996.
22
H. K. Khalil. Nonlinear Systems. Prentice Hall, Englewood Cliffs, NJ, 2002.
23
K. Zhou and J. C. Doyle. Essentials of Robust Control. Prentice Hall, Englewood Cliffs, NJ, 1998.
26 of 26