2011 IEEE International Conference on Consumer Electronics (ICCE)

A Motion and Similarity-Based Fake Detection Method for Biometric Face Recognition Systems
*

Younghwan Kim*, Jang-Hee Yoo**, and Kyoungho Choi*, Member, IEEE Department of Electronics Eng., Mokpo National University, South Korea ** Electronics and Telecommunication Research Institute, South Korea
Building Background(BG) Model, BGorg Initializing (GMM) Texture Structure BGorg

Abstract--In this paper, a motion and similarity-based fake detection algorithm is presented for biometric face recognition systems. First, an input video is segmented as foreground and background regions. Second, the similarity is measured between a background region, i.e., a region without a face and upper body, and an original background region recorded at an initializing stage. Third, a background motion index is calculated to indicate the amount of motion in the background region compared with the motion in the foreground region. By combining the result of similarity and the result of background motion index, a fake video can be detected robustly with a regular USB camera.

Foreground FGmotion Background Motion Index

I. INTRODUCTION To provide access control solutions for security systems, biometric information, e.g., fingerprints, iris, face, and so on, are used for human authentication [1]. For biometric face recognition systems, copies of high-resolution images, recorded video sequences, and 3D face models can be used to fool the systems. To detect those spoofing attacks, eye-blink detection [2], frequency domain analysis [3], and thermal images [4] can be used. In addition, interactive approaches are proposed, asking to say a word or asking to move a certain direction [5-6]. The weak point of previous approaches is that they require additional lighting sources, thermal imaging sensors, or user interactions. In this paper, we present a novel approach to prevent image and video attacks, which does not require additional hardware or user interactions. II. THE PROPOSED ALGORITHM In the proposed approach, a foreground region is modeled as a region with a face and upper body, and the background region is considered as the rest of the foreground region. Fig. 1 shows the flowchart of the proposed liveness detection system. The proposed algorithm consists of three parts. First, the similarity is measured between two background regions, i.e., current background region and the original background region recorded at an initializing stage. To check a similarity, the structural similarity index measure (SSIM) is used [7]. Second, a background motion index (BMI) is calculated. A BMI is an index that indicates the amount of motion in the background region compared with the one obtained from the foreground region. More specifically, if the value of BMI is small, it means that the background region has less motion.
BGmotion Video Input Combine Linearly BGcur SSIM BGorg Detect Fake Video

Fig. 1 The flowchart of the proposed liveness detection system In other words, if the value of BMI is big, it means there is big amount of motion in the background region of current video sequence, which means the current video is a fake one. Thus, a BMI can be defined as

BMI = MVbg / MVfg

MVbg = 1 Nbg
1 N fg

(1) (2)

P
i =1
N fg

N bg

ibg

(t ) Pibg (t 1) ,

MVfg =

P
i =1

i fg

(t ) Pi fg (t 1) ,

(3)

where Nbg and Nfg means the number of feature points detected from background and foreground regions, and MVbg and MVfg denotes the average value of motion vector magnitude in the background and foreground region, respectively. Feature points

Pibg (t ) and Pi fg (t ) selected from

This work was supported by Priority Research Centers Program (2010-0028295) and "Human Resource Development Center for Economic Region Leading Industry" Project, through the National Research Foundation of Korea(NRF) funded by the Ministry of Education, Science and Technology.

the background and foreground regions at time t are decided automatically by using a feature tracker [8]. The results of SSIM and BMI are combined linearly to decide the liveness of biometric information. We present a liveness measure, i.e., LivenssMeasure, indicating the degree of liveness of biometric information as LivenessMeasure = SSIM + (1 BMI )

978-1-4244-8712-7/11/$26.002011 IEEE

171

where + = 1 . LivenessMeasure = 1 and LivenessMeasure = 0 denotes an input video is live and fake, respectively. III. RESULTS For the experiments, a regular USB camera, Pleomax PWC3800, was used to capture input video sequences. The resolution of input video was 320x240 and 10 video clips were recorded for each fake scenario, e.g., a) regular live video, b) printed pictures, c) wearing a mask with printed pictures, d) pictures in a LCD monitor, e) video displayed in mobile devices. Fig. 2 shows examples of image and video spoofing attacks.

To combine SSIM and BMI results, and were chosen to make the LivenessMeasure become the maximum. In our experiment, =0.4 and =0.6 were chosen, which means the motion of background region is slightly important than the similarity of background regions. The recognition performance of the proposed system for video attacks is shown in Table 1. As shown in Table 1, the proposed approach shows good performances for image and video attacks with a regular USB camera without any additional hardware. There is an assumption in the proposed approach that the foreground and background regions have to be segmented correctly. Table 1. The performance of the proposed fake detection approach
Recognition Results LIVE FAKE Live or Fake LIVE video 100% 0% Image attack 0% 100% Video attack 0% 100%

Fig. 2 Examples of image(left) and video(right) attacks Fig. 3 shows the SSIM results for live, image, and video attacks. For live video, the value of SSIM is around 0.8, which means the background region is very similar to the original background region recorded at the initialization stage. However, for image and video attacks, the value of SSIM is less than 0.7. IV. RESULTS In this paper, we have presented a novel approach to decide the liveness of biometric face recognition systems. The proposed approach has been focused on preventing image and video attacks by using a regular CCD or USB cameras without using additional light sources or hardware devices, e.g., thermal imaging sensors. The proposed approach is based on the idea that the motion and similarity of the background region should contain crucial information for liveness detection. The proposed idea can be applied to build various access control solutions for consumer electronics. Reference
[1] [2] B. Toth: Biometric liveness detection, Information Security Bulletin, Vol. 10, pp. 291297, 2005. Lin Sun, Gang Pan, Zhaohui Wu: Blinking-based live face detection using conditional random fields, LNCS 4642, pp. 252-260, 2007. J. Li, Y. Wang, T. Tan, and A. K. Jain: Live face detection based on the analysis of fourier spectra, SPIE vol. 5404, pp. 296-303, 2004. Y. Kim, J. Na, S. Yoon, and J. Yi: Masked fake face detection using radiance measurements, JOSA A vol. 26, no. 4, pp. 760-766, 2009. G. Chetty, M. Wagner: Biometric person authentication with liveness detection based on audio-visual fusion, Int. journal of biometrics, vol. 1, no. 4, pp.4 63-478, 2009. K. Kollreider, H. Fronthaler, J. Bigun: Verifying liveness by multiple experts in face biometrics, Proc. of CVPR, pp.1-6, 2008. Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli: Image quality assessment: from error visibility to structural similarity, IEEE Tran. on Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004. Shi, J.; Tomasi, C. Good Features to Track, Proc. IEEE Conference on Computer Vision and Pattern Recognition, pp. 593-600, 1994.

Fig. 3 The results of SSIM for live(green), image attack(red), and video attack(blue) Fig. 4 shows the value of BMI for live, image attack, and video attack. Red line denotes the value of a live video sequence, yellow and blue line means the results of image and video attacks, respectively.

[3] [4] [5]

[6] [7]

[8]

Fig. 4 The results of BMI for live(green), image attack(red), and video attack(blue)

172