1

Validation and precision analysis

of InStat Fitness system
Alexeev Dmitriy1, Nosov Mike1, Vaguine Ilya2,5, Ryabchikov Igor2,Bobyrev Alexey3, Belov Mikhail4

1 Moscow State University, faculty of Mechanics and Mathematics, Moscow

2 InStat, Fitness department
3 Center of sports innovation technologies, Moscow Sports Comitee. Moscow
4 FC Torpedo, Moscow
5 InStat, Scientific department

Correspondence
Dmitriy V. Alexeev, Ph.D
Mikhail V. Nosov, Ph.D, assoc. prof.
dvalex@rambler.ru
Tel +7-(495)939-46-37
MSU, Faculty of Mechanics and Mathematics, Russia, 119991, Moscow, GSP-1, 1 Leninskiye Gory, Main
Building

Abstract
The InStat Fitness system was designed for the calculation of the football players movement characteristics
based on video file processing. The standard system workflow consists of three stages:
Raw processing stage in order to create primal trajectory model;
The analysis and checking performed by experts to correct the trajectories;
Calculation of movement characteristics via computer algorithm.
The series of experiments were performed to estimate the precision of the system. The players performed
straight and curved runs on different distances and in different locations of the field in the Saturn stadium.
Two cameras (denoted as cam1 and cam2) were used. The real velocities were determined using the timing
gates situated at the 15m intervals along each trajectory.
The statistical analysis was performed for the following cases: traffic (moving the group of players), wing
runs, center runs, straight and curved runs, changing velocity runs and different distances (15m, 30m, 45m,
60m) runs. The statistical characteristics such as intraclass correlation and linear regression were calculated
for each test case. In all 12 test cases the R2 correlation coefficient was close to 1, that indicates the good
correspondence of the system results to the real velocities of players. The following processing comprised
linear regression calculation in the form Y = kX+b, where X is real data (obtained from the timing gates)
and Y is the data estimated by InStat Fitness system. The coefficient k is close to 1 and b is close to 0 that
indicates that the data of InStat and the real data are almost equal. The correlation between the experimental
and real data (the precision of InStat Fitness data against timing gates) reaches the 99%. Only in one case
the correlation coefficient is equal to 0.987, k=0.923, b=0.58. Also, for each case were determined typical
(from 0.019 to 0.036) and total errors (from 0.020 to 0.037) and their 95% confidence intervals, intraclass
correlation (from 0.990 to 0.9998) and typical error as % of CV.
The statistical results show high precision of data produced by Instat Fitness system.
 2

Introduction
Presently sports statistics is playing an important role in the sport of records. It is especially true to
team sport where quantity calculation of both technical and tactical characteristics of athletes and
teams provides a vast spectrum of opportunities to analyze and improve their results. The most
popular method of such measurements making is video images analysis. High popularity of such
approach is determined by the fact that measuring devices are prohibited to be used as a part of an
athletes equipment during official matches in numerous kinds of sports. Modern compact sensors
officially permitted to be placed on athletes shoes hardly solve the problem as they make serious
errors due to clashes in contact sports and unevenness of running. Hence, let us focus on the history
of video images analysis as currently optimal means of collecting statistical information in terms of
an athlete participation in a match.

The first attempts to perform such analysis were made in the early 90s. However, the speed of
data processing was extremely low because of the technical conditions of those days equipment.
Nevertheless, modern systems allow doing such analysis with much higher speed. Still, the video data
accuracy processed with the help of these systems is far from being perfect.

Starting from 2012 InStat have introduced InStat Fitness system to their customers. It is the system
with the help of which different characteristics of players and referees physical activities in a football
match can be measured. They include the distance covered (total and the one covered in different
speed modes), players maximal and average speed, the number of sprint winds and surging runs
and other characteristics based on a players location at each moment of his being on the field. This
system performs in a semi automatic mode as once players location has been identified with the help
of HD video image analysis which is sent from video cameras checking procedure starts. It includes
three stages and the checking itself is performed by experienced analytical experts of the production-
center of Fitness department of InStat. The procedure targets on complete excluding of errors which
can occur during the moments difficult to identify in an automatic mode such as complicated players
moving, players moving in a crowd, etc.

The data collected by InStat Fitness accuracy had not been tested and therefore, we have made
a complex study ofInStat Fitness system verification in 2014. We are to validate the InStat
measurement against timing gates measurements. Timing gates provided by the Centre of Sport,
Innovative Technologies and Team Training of Moscow Sport Department is a professional time
measuring tool with the accuracy of 0.001 second.Having compared the speed data collected by the
timing gates andInStat Fitness we can evaluate the accuracy of our system
 3

Experiment and methods

Experiment

Three football players from Torpedo FC (Moscow) (average age 21 years, average weight 70 kg,
average height 177 sm) were the subjects of the experiment that was carried out on the Saturn
Stadium (Ramenskoe). The subjects were asked to perform a series of runs at different speeds in
different directions on the Saturn stadium.

Footballers performed the following runs:

1) 60m straight run on the side of the field (on medium speed and with speed changing)
2) 45m curved run with two right turns to 45 (on medium speed)
3) 30m curved run with one right turn to 90 (on high and maximum speed)
4) 15m straight run modeling the breaking through to the penalty box (on high and maximum speed)
5) 60m straight run on the center of the field (on medium speed and with speed changing)

Every series included the solo runs of every player and the movement of all the players (so called
traffic movement when one player runs straight through the timing gates but all other players run not
crossing the timing gates line). The runs were carried out to model the situation in real football match
when system must recognize the movement of the only one player in the crowd. Players performed
the traffic runs and the solo runs one after another.

60m straight run

on the side of
the field

30m curved
run with one
right turn
to 90* 45m curve run with
two right turns
to 45*

60m straight run

on the center of
the field
15m straight run
modeling the
breaking through to
the penalty box

A schematic diagram of the runs and the location of the timing gates on the Saturn stadium is
presented in Figure 1. Following the diagram, the timing gates were placed in 15 meters between
each other. Consequently 60 m distance contains 5 timing gates, 45 m distance 4 timing gates, 30
m distance 3 timing gates, 15 m distance 2 timing gates (only in the end and in the beginning
of the distance). For all the runs, the measurements of the timing gates were compared with the
measurements of the InStat Fitness system on every checkpoint where the gates were placed.
 4

InStat Fitness system

Video is captured with Panasonic HC-V 100, professional video cameras, installed in pairs on each
of the two main stands of Saturn stadium.The portable InStat fitness system set includes 2 video
cameras installed on tripods on one of the stands and each of the cameras covers its half of the field.
In such a way, we can state that the video material was captured by 2 InStat Fitness systems at the
same time. It was made in order to collect data along the near and the far sidelines simultaneously. As
the two systems were installed in an absolutely symmetrical manner the data can be considered from
two different points of view.

Each of the systems was switched on/off by an operator.Later, the data is sent to the production
center of InStat where it is processed. The data processing procedure consists of several stages.
Primarily automatic video materials processing including generation of 2D field model of the
materials received during the system field capture considering the field size and generating primarily
trajectories of moving.

Secondary video materials processing including InStat analysts processing the primarily trajectories,
eliminating potential errors which can occur in complicated moments of the data processing.
That data-checking stage includes supervisors checking the secondary processed data by comparing
the trajectories received by system with the real players moving.For that supervisor uses the special
InStat software.In case of a real football match, this stage is carried out for verification of all the
players and referees moving on the field at the same time.Also in case of the real football match
theanalysis contains one more stage.During the last stage the most experienced specialists of the of
the production center make the super checking at providing the final version of InStat fitness report.

Purposes of the study and statistical analysis

The main purpose of the study is to perform the independent verification of InStat Fitness system
with the help of comparing InStats data with that of collected with timing gates. Conducting of an
experiment by means of series of runs recorded by two InStat fitness systems should solve the task of
InStat fitness system accuracy identification. We can separate this big task to the smaller ones so well
try to identify the accuracy of InStat Fitness system in the following cases:

- players movement on different distances

- recognition of the players in traffic
- comparison of the data recorded at the near and the far sidelines
- comparison of the data recorded on a side of the field and in the central zone
- players movement along a straight line
- players movement along a curve line
- players movement with the speed changing

Having solved all these tasks we will be able to evaluate the accuracy of InStat Fitness system.
The statistical analysis was performed for all these seven cases.
In this study, we used the method of absolute and relative reliability suggested by Hopkins (2000).
The difference between the velocity measured by InStat Fitness system and actual velocity measured
by the timing gates with the highest precision were determined from the Bland and Altman plot.
Regressions were made for every case that was regarded earlier. Statistical analyses were performed
in The Laboratory of Problems of Theoretical Cybernetics of the Chair of Mathematical Theory of
Intelligent Systems (Moscow State University).
 5

Results

Players movement on different distances

Figure 2. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system during the 60m running
tests.

Figure 3. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system during the 45m running
tests.
 6

Players movement on different distances

Figure 4. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system during the 30m running
tests.

Figure 5. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system during the 15m running
tests.
 7

Recognition of the players in traffic

Figure 6. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system during the traffic
running tests. The traffic data
was originated from all the type
of distances. The only cases when
all the subjects made a run were
considered.
 8

Comparison of the data recorded at the near and the far sidelines (cam1 and cam2)

Figure 7. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system with the cam1. The data
from all the 60m (side) and 45m
runs captured only by cam1 was
considered.

Figure 8. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system with the cam2. The data
from all the 60m (side) and
45m captured only by cam2 was
considered.
 9

Comparison of the data recorded on a side of the field and in the central zone

Slide of the field run

Figure 9. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system in the central area of
the field. The data from all the
60m (side) runs captured by both
cameras was considered.

Figure 10. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system in the central area of the
field. The data from all the 60m
(center) runs captured by both
cameras was considered.
 10

Players movement along a straight line

Figure 11. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system on the straight runs. The
data from all the 60m (both
center and side) runs and 15m
runs was considered.

Playersmovement along a curve line

Curved run

Figure 12. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system on the curved runs. The
data from all the 45m and 30m
runs was considered.
 11

Playersmovement with the speed changing

Figure 13. Relationship between

the actual velocity of the subject
measured by timing gates vs
that calculated by InStat Fitness
system. The data from only the
60m runs with velocity changing
was considered.
 12

Summary Table
Table 1. The summary table of the results. The results are reached by using statistical analysis based
on the method suggested by Hopkins.

Typical Error (Confidence Limits) Total Error (Limits of Intraclass Typical Error as CV(%)
agreement) correllation
Distance = 60m 0.026 (0.024-0.029) 0.029 (0.074) 0.99974 0.026
Distance = 45m 0.036 (0.031-0.042) 0.036 (0.101) 0.99906 0.036
Distance = 30m 0.027 (0.021-0.038) 0.030 (0.079) 0.99817 0.027
Distance = 15m 0.026 (0.020-0.040) 0.037 (0.079) 0.99072 0.026
Recognition of the players 0.030 (0.025-0.036) 0.032 (0.084) 0.99974 0.03
Precision(near camera) 0.031 (0.028-0.034) 0.030 (0.085) 0.99967 0.031
Precision(far camera) 0.029 (0.026-0.032) 0.032 (0.081) 0.99971 0.029
Flank run 0.030 (0.026-0.034) 0.034 (0.083) 0.99971 0.03
Center run 0.019 (0.017-0.022) 0.020 (0.054) 0.99985 0.019
Straight run 0.026 (0.024-0.029) 0.029 (0.072) 0.99976 0.026
Curved run 0.034 (0.030-0.039) 0.035 (0.096) 0.99928 0.034
Changing velocity 0.023 (0.020-0.026) 0.024 (0.064) 0.99987 0.023

The InStats data showed the great correlation with the timing gates measurements. Velocities
recorded by InStat showed a perfect correlation (r = 0.999) in all cases except 15m straight runs
and 30m curved runs (See Figures 4 and 5). The average velocity recorded by InStat in these cases
on sprints and maximal speed movements showed an excellent correlation (r = 0.998 and r = 0.990
consequently). All data showed high levels of absolute and relative reliability, typical errors (from
0.019 to 0.036) and total errors (from 0.020 to 0.037).
 13

Discussion
The conducted study has proved that InStat Fitness system allows making accurate measuring of
speed and distances covered by players at different speed and at different length. The results received
have proved high accuracy of measuring in each of the specified modes. The high intercorrelation
coefficients in all the examined cases let us come to a conclusion of InStat Fitness system approach
proper application to any players movement made during a football match.
Besides the high accuracy proved in the study the following aspects can be considered as InStat
Fitness system advantages:

InStat Fitness system can be easily adapted to local conditions at practically any stadium. The
system is able to work in case of only one stand of the stadium corresponding to its height
(10m) requirements. Therefore, InStat can provide teams with their both home and away match
reports.

InStat Fitness system allows receiving data in terms of all the match participants excluding
physical interference into course of match. Besides the players physical activity reports InStat
produces referees activity reports containing the data of the distance between a referee and the
ball in key zones and at key moments of a match. The rest of parameters are available as well.

The given system disadvantage is in a certain cameramans factor at a stadium as he is responsible

for video cameras switching on/off and the system primarily calibration as well. In case of significant
system malfunction at a stadium there is a risk of data delivery failure.
In order to avoid such risk InStat involve only highly skilled operators who have come through a
special training programme. Moreover, the set of eternal stationary InStat Fitness system is available -
it is installed on a team home stadium only once and operated in a fully automatic mode.

Primary data collected by InStat Fitness system is the data in terms of objects location on the field
at any time moment. Based on the data numerous parameters can be calculated including distance
covered at different speed levels, accelerations and decelerations of players and players energy
consumption during a match.
InStat Scientific Department specialists have adapted the following studies of Italian scientists:
Energy Cost and Metabolic Power in Elite Soccer: A New Match Analysis Approach, Osgnach et al.
(2003); Sprint running: a new energetic approach, Di Prampero et al. (2005).
 14

Conclusion
The results of statistical processing of the experimental data show the accuracy and high precision
of InStat Fitness system. The expert correction of the results of the automatic computer processing
allows obtaining the physical activity parameters more precisely. It is especially important in case of
group moving as it happens in real football matches. The using of two cameras is sufficient to make
the results of the high accuracy. The system lets us estimate the velocity and distance covered by each
player on the field. Theoretically, the system can be used in other sports where the physical activity
characteristics of players play a big role. The results in study are reached by using statistical analysis
based on the method suggested by Hopkins in 2000.

References

1. Hopkins, W G. Measures of Reliability in Sports Medicine and Science. SportsMed, 30, 1-15, 2000.
2. Hopkins, W G. Reliability for consecutive pair of trials (Excel Spreadsheet). In: A new view of Statistics. Internet Society
for Sport Science, 2000
3. Glantz Stanton A. Primer of Biostatistics, Seventh Edition. McGraw-Hill companies, Ins. 2012.
4. Probability and mathematical statistics. The encyclopedia. Ed. by a.m. Prokhorov YU.V., M: Publishing house BDT,
1999.
5. Kolmogorov A.N. Probability theory and mathematical statistics. M. Science 1986.
6. Gmurman V.E. Probability Theory and mathematical statistics. M: Higher school, 2003.
7. Osgnach C, Poser S, Bernardini R, Rinaldo R, di Prampero P E. Energy cost and metabolic power in elite soccer: a new
match analysis approach. Med Sci Sports Exerc 2010;
8. di Prampero P E, Fusi S, Sepulcri L, Morin J B, Belli A, Antonutto G. Sprint running: a new energetic approach. J Exp Biol.
2005