Documenti di Didattica
Documenti di Professioni
Documenti di Cultura
Abstract
From the literature it has been observed that most of can be easily understood [2]-[3]. The use of quantitative gait
the work through Gait has been carried out for the detection of analysis in the rehabilitation setting has increased only in
various medical problems. The present paper deals, Hybrid recent times. Since past five decades, the work has been
approach (A combination of ANN and GA) for Anomalous carried out for gait abnormality treatment. Many medical
Foot Recognition (AFR). The work has been carried out in practitioners along with the help of scientists and engineers
two phases. In the first phase, a knowledge-based model called [1]-[4] have carried out more experimental work in this area. It
AFR_MODEL has been formed. The model has been formed has been found from the literature that two major factors: time
by considering an input gait image that has been enhanced for and effort, are playing a vital role. These two factors have
the removal of distortion along with loss-less compression. been kept as a major objective in the present work. In the
Later on it has been segmented along with the detection of the present paper, a unique strategy has been adopted for further
region of interest. Hence the relevant geometrical parameters analysis of gait using above two factors for Anomalous Foot
of GAIT have been extracted from that ROI. Each parameter Recognition (AFR). Many researchers from Engineering field
has been stored in the form of corpus. For this, Artificial till 1980 have not carried out the work for GAIT analysis. In
Neural Network (ANN) has been employed in the work. In the the year 1983, Garrett and Luckwill [5], carried the work for
second phase, the AFR_MODEL has been utilized for AFR. maintaining the speech of walking through Electromyography
For this an algorithm called HAAFR (Hybrid Approach (EMG) and Gait analysis. In the year 1984, Berger and his
Anomalous Foot Recognition) has been proposed and has colleagues [6], detected angle movement and disturbances
been also tested with 15 subjects of varying age groups on a during walking. In the year 1990, Yang et al.[7], further
flat and plain surface without carrying weights. The result has carried the experimental work for the detection of short and
been found very satisfactory with the tested data sets. long steps during walking. In the year 1993 Grabiner et al. [8]
investigated that when a obstacle is placed in the path of a
Keywords: Artificial Neural Network (ANN), Genetic subject, how much time is taken by the subject to recover its
Algorithm (GA), Anomalous Foot Recognition (AFR), normal walking after hitting the obstacle. In 1994 the work has
Principal Component Analysis (PCA), Discrete Cosine been carried out by Eng et al. [9] with little modifications for
Transform (DCT), Discrete Wavelet Transform (DWT). the detection of foot angles. In the year 1996 Schillings et al.
[10] modified the work of Grabiner et al. [8] and calculated
the angles of movement. In the year 1999 Schillings et al. [11]
1. Introduction further carried the work that was done in the year 1996 with
The systematic study of human walking is called as little modifications. In the year 2001 Smeesters et al. [12]
GAIT. It is used for diagnosis and the planning of treatment in calculated the trip duration and its threshold value by using
people with medical conditions that affect the way they walk. GAIT analysis. From the literature, it has been observed that
Biometrics such as automatic face and voice recognition very little amount of work has been carried out using Neuro-
continue to be a subject of great interest. Gait [1] is a new Genetic approach for RAF through human GAIT. The
biometric aimed to recognize subjects by the way they walk. schematic diagram for the formation of knowledge-based
However, functional assessment, or outcome model, that is, AFR_MODEL has been shown in figure 1,
measurement is but one small role that quantitative gait below.
analysis can play in the science of rehabilitation. If the From Fig. 1, it has been shown that a known image
expansion on gait analysis has been made, then ultimate has been fed as input. Then it has been pre-processed for
complex relationships between normal and abnormality gait enhancement and segmentation. The enhancement has been
done for the filtering any noise present in the image. Later on
Copyright © 2010 it has been segmented using connected component method
Paper Identification Number: CC-1.4 [13]-[14]. Discrete Cosine Transform (DCT) has been
This peer-reviewed paper has been published by
employed for loss-less compression. DCT has a strong energy
the Pentagram Research Centre (P) Limited.
Responsibility of contents of this paper rests upon compaction property. The main property is that it considers
the authors and not upon Pentagram Research real-values and provides better approximation of an image
Centre (P) Limited. Copies can be obtained from with fewer coefficients.
the company for a cost.
112
Anomaly In Foot Recognition Through Human Gait Using Hybrid Approach
N
Y=
∑i=1
X iW i (2)
113
International Conference on Systemics, Cybernetics and Informatics
The paper has been organized in the following yields to the equation of the form,
manner, section 2 proposes mathematical formulation for AFR M −1 N −1
and its solution methodology, section 3 proposes the I(u,v)= ∑ ∑i(m, n) exp
m=0 n =0
(− j2π (um/ M + vn/ N ) (8)
experimental results and discussions, section 4 gives the
conclusions and further scope of the work and final section for u=0,1,2,…,M-1 and v = 0, 1, 2, ……..,N-1
gives all the references made in completing the present work. In order to compute the magnitude and power
spectrum along with phase angle, conversion from time
domain to frequency domain has been done. Mathematically,
2. Mathematical formulation for AFR and its this can be formulated as, Let R(u,v) and A(u,v) represent the
solution methodology real and imaginary components of I(u,v) respectively.
A biometric system operates in two phases – The Fourier or Magnitude spectrum, yields.
training phase and recognition phase. In the training phase a
knowledge-based corpus has to be formed using Artificial [
I (u , v ) = R 2 ( u , v ) + A 2 (u , v )
1/ 2
(9) ]
Neural Network (ANN). This model has been termed as The phase angle of the transform is defined as,
AFR_MODEL. In the recognition phase, this model will be A(u , v )
used for understanding of an unknown gait for Anomalous φ ( u , v ) = tan −1
R (u , v )
(10)
Foot Recognition (AFR) using GA. The size of the corpus
may be kept limited at initial stage of the work. The testing The power spectrum is defined as the square of the magnitude
has to be performed on different environments like plain flat spectrum. Thus squaring equation (9), it yields,
P ( u , v ) = I ( u , v ) = R 2 ( u , v ) + A 2 ( u , v ) (11)
2
surface, rough surface, slippery surface and so on. An
algorithm has to be developed for AFR using Neuro-Genetic
Due to squaring, the dynamic range of the values in
approach. This algorithm has to be tested with the following
the spectrum has been found very large. Thus to normalize
constraints: walking by carrying some weights and walking
this, logarithmic transformation has been applied in equation
without carrying any weight. The paper aims to analyze and
(9). Thus it, yields.
discuss experimentally the aforesaid problem in the
subsequent subsections. I (u , v ) = log( 1 + I ( u , v ) )
normalize
(12)
A. Mathematical Analysis The expectation value of the enhanced image has been
Based on the assumption that the original image is computed and it yields to the relation,
additive with noise. To compute the approximate shape of the E[I(u,v)] = 1
M −1 N − 1
∫ x(t ) ψ{(t-τ)/a} dt
DCTc(u,v)= M − 1 N − 1 2π T (m + n ) (17)
CWT (a, τ)=(1/ a ) (6) ∑ ∑ I ( m , n ) cos
m =0 n=0 MN
The parameters obtained in equation (6) has been Further for the computation of principal components (i.e.,
discretized, using Discrete Parameter Wavelet transform, Eigen Values and the corresponding Eigen Vectors), a pattern
, τ = n τ0 a m . Thus
m
DPWT (m, n), by substituting a = a vector pn , which can be represented by another vector qn
0 0
equation (6) in discrete form results to equation (7), of lower dimension, has been formulated using (8) by linear
DPWT (m, n) = 2-m/2 ∑ k ∑ l x ( k , l ) ψ(2-mk – n) (7) transformation.
where ‘m’ and ‘n’ are the integers, a0 and τ0 are the sampling Thus p n = [M ] q n (18)
intervals for ‘a’ and ‘τ’, x(k,l) is the enhanced image. The where [M ] = [I (m, n)] for m= 0 to M-1 and n = 0 to N-1.
wavelet coefficient has been computed from equation (7) by
substituting a0 = 2 and τ0 = 1. and qn = min([M]), such that q n > 0
Further the enhanced image has been sampled at regular time Taking the covariance of equation (18), it yields, the
interval ‘T’ to produce a sample sequence {i (mT, nT)}, for m corresponding Eigen vector, given in equation (19),
= 0,1,2, M-1 and n=0,1,2,…N-1 of size M x N image. After P = cov( p n ) (19)
employing Discrete Fourier Transformation (DFT) method, it
114
Anomaly In Foot Recognition Through Human Gait Using Hybrid Approach
∑xw
probability P(wj). Hence it is quite logical to classify the
y-inj = (22)
i ij signal, β, as follows,
i , j =1
If P(wnorm/ β) > P(wabnorm/ β), then the decision yields β Є
where ‘y-inj’ is the output pattern for the input wnorm means ‘normal foot’ else the decision yields β Є wabnorm
pattern ‘xi’ and j = 1 to n. means ‘abnormal foot’. If P(wnorm/ β) = P(wabnorm/ β), then it
Thus the weight matrix for the hetero associative memory remains undecided or there may be 50% chance of being right
neural network has been calculated from equation (22). For decision making. The solution methodology with proposed
this, the activation of the output units has been made algorithms has been discussed in the next section for the
conditional. complete analysis made till now.
+ 1 if y − inj > 0 B. Solution Methodology
yi = (23) Proposed HAAFR Algorithm for “Biometrics”
0 if y − inj = 0
Main program {starts}
− 1 if y < 0
− inj 1. Read the unknown gait image of twelve frames with left-
The output vector ‘y’ gives the pattern associated with the leg and right-leg movements alternatively.
input vector ‘x’. The other activation function may also be 2. Set the frame counter, fcount = 1
used in the case where the target response of the net is binary. 3. Do while fcount <= 12
Thus a suitable activation function has been proposed by, 4. Read the gait_image[fcount]
5. Enhance the image
1 if x>0 6. Apply loss-less Compression
f(x) = (24)
0 if x <= 0 7. Compute the connected components for segmenting the
image
Considering two measures, Accuracy and Precision has been 8. Corp the image for locating the Region of Interest
derived to assess the performance of the system, which may be 9. Compute the step_length, K_A (Knee to Ankle) distance,
formulated as, Foot_length, Shank_width, Foot_angle and walking
Accuracy = Correctly Re cognized feature (25) Speed
Total number of features 10. Compute the genetic parameters using the relation as,
Precision = TPR (26) UB=(((mmax–mmean)/2)*A)+mmean
TPR + FPR LB=(((mmean–mmin)/2)*A)+mmin
where TPR = True positive recognition and FPR = False where ‘A’ is the pre-emphasis coefficient, mmax is the
positive recognition. maximum value and mmean is the mean value and mmin
Further the analysis has been done for the is the minimum value, UB is the upper bound value and
recognition of the abnormal foot with two target classes LB is the lower bound value
(normal and abnormal). Starting from the AFR_MODEL, Store the feature vectors in a look-up table.
which has various states, each of which corresponds to a 11. Perform the best-fit matching with the data set of
segmental feature vector. In one state, the segmental feature GAIT_MODEL (stored in a master file) using Genetic
vector is characterized by eleven parameters. Considering only algorithm
three parameters: the step_length: distance, mean, and the 12. Employ classification for a two-class problem and then
standard deviation, the AFR_MODEL is composed of the make decision
following parameters 13. End do
115
International Conference on Systemics, Cybernetics and Informatics
116
Anomaly In Foot Recognition Through Human Gait Using Hybrid Approach
From figure 10, it has been observed that during 9. Eng J. J., Winter D. A. and Patla A. E., “Strategies for
standing mode of the subject, there are no so much variations. recovery from a trip in early and late swing during human
But during switching time from standing mode to walking walking.”, Experimentation Cerebrale, 102 (2), pp 339-
mode, there are some variations. Only during walking mode 349, 1994.
this variation is almost same. In the work, odd (left-leg at the 10. Schillings A. M., van Wezel B. M. and Duysens J.,
back and right-leg at the front) or even frames (left-leg at the “Mechanically induced stumbling during human
front and right-leg at the back) are considered separately for treadmill walking.”, Journal of Neuro Science Methods,
the analysis. As per the proposed algorithm called NGBRAF, 67 (1), pp 11-7, 1996.
for most of the cases ‘NORMAL FOOT’ has been achieved, 11. Schillings A. M., van Wezel B. M, Mulder T. and
because of minimum variations. If high variations have been Duysens J., “Widespread short-latency stretch reflexes
detected through the proposed algorithm then ‘ABNORMAL and their modulation during stumbling over obstacles.”,
FOOT’ may result. Brain Research, 816 (2), pp 480-6, 1999.
12. Smeesters C., Hayes W. C., McMahon T. A., “The
4. Conclusions and further scope of the work threshold trip duration for which recovery is no longer
Thorough mathematical analysis has been carried out for possible is associated with strength and reaction time.”,
the detection of anomaly in foot in the present paper. The Journal of Biomechanics, 34 (5), pp 589-95, 2001.
problem has been defined and its solution has been achieved 13. Yang, X.D., “An improved Algorithm for Labeling
using Hybrid approach, which means the combination of ANN Connected Components in a Binary Image”, TR 89-981,
and GA. In order to recognize anomalies in the foot of any March 1989.
subject on a plain surface without carrying any weight an 14. Lumia, R., “A New Three-dimensional connected
components Algorithm”, Computer Vision, Graphics, and
algorithm called hybrid Approach Anomalous foot
Recognition (HAAFR) have been proposed in the present Image Processing, Vol. 23, pp. 207-217, 1983.
paper. Limited number of GAIT features has been extracted.
Few more features have to be extracted from the upper torso 6. About the authors
of the subject for achieving better results. Other environments Rajkumar Patra is working as Senior
like rough surface, slippery surface and so on have to be Lecturer at Shri Shankaracharya College
considered for further study and analysis. of Engineering and Technology, Bhilai,
Chhattisgarh, India. He has received B.E,
M.E degree in Computer Science and
5. References Engineering. His main research interest
1. Cunado, D., Nixon, M.S., and Carter, J.N., “Using gait as includes Gait analysis using DIP, Face
a biometric, via phase-weighted magnitude spectra”, in recognition and Identification, Digital Image Processing,
the proceedings of First International Conference, Signal Processing, Computer Graphics and Multimedia and
AVBpA’97, pp. 95-102, Crans-Montana, Switzerland, Networking.
March 1997.
2. Huang, P.S., Harris, C.J., and Nixon, M.S., “Recognizing Rohit Raja is working as Lecturer at Shri
humans by gait via parametric cannonical space”, Shankaracharya College of Engineering
Artificial Intelligence in Engineering, vol. 13, No. 4, pp. and Technology, Bhilai, Chhattisgarh,
359-366, October 1999. India. He has received his B.E, M.E degree
3. Huang, P.S., Harris,C.J., and Nixon,M.S., “Human gait in Computer Science and Engineering. His
recognition in canonical space using temporal templates”, main research interests are in Digital
IEEE Procs. Vision Image and Signal Processing, Vol. Image Processing, Signal Processing and
146, No. 2, pp. 93-1000, 1999. Networking.
4. Scholhorn,W.I., Nigg,B.M., Stephanshyn,D.J., and
Liu,W., “Identification of individual walking patterns Tilendra Shishir Sinha received his Ph.D
using time discrete and time continuous data sets”, Gait degree in Computer Science &
and Posture, Vol. 15, pp. 180-186, 2002. Engineering from National Institute of
5. Garrett M. and Luckwill E. G., “Role of reflex responses Technology, Durgapur, West Bengal,
of knee musculature during the swing phase of walking in India in April, 2009. He is currently
man.”, Eur J Appl Physiol Occup Physiol, 52(1), pp 36- working as professor and head of the
41, 1983. department, CSE at Shri Shankaracharya
6. Berger W., Dietz V. and Quintern J., “Corrective College of Engineering and Technology,
reactions to stumbling in man: neuronal co-ordination of Bhilai, Chhattisgarh, Bhilai., India. He has published more
bilateral leg muscle activity during gait.”, The Journal of than 20 papers in International and National Journals and
Physiology, 357, pp 109-125, 1984. Conferences. He has also reviewed two papers in two
7. Yang J. F., Winter D. A. and Wells R. P., “Postural International Journals. His main research interests are in
dynamics of walking in humans.”, Biological speech and speaker recognition, image processing, soft-
Cybernetics, 62 (4), pp 321-30, 1990. computing techniques and pattern recognition.
8. Grabiner M. D. and Davis B. L., “Footwear and balance
in older men.”, Journal of the American Geriatrics
Society, 41(9), pp 1011-1012, 1993.
117