J. Electromagn. Eng. Sci Search

CLOSE


J. Electromagn. Eng. Sci > Volume 20(4); 2020 > Article
Kim, Kim, Jin, and Lee: Human Identification by Measuring Respiration Patterns Using Vital FMCW Radar

Abstract

This letter proposes a method of human identification that measures respiration patterns using frequency-modulated continuous wave (FMCW) radar. We exploit the fact that respiration signal patterns are unique to each individual, and FMCW radar is employed to obtain the respiration information. Based on the strengths of FMCW radar, the proposed algorithm compensates for the inability to distinguish the respiration signals of multiple users, which are difficult for continuous wave radar to measure. The proposed algorithm also employs a deep neural network algorithm instead of the K-nearest neighbor algorithm that was used in a previous study. The proposed algorithm further improves the performance by using a least mean square filter in the input signal of the DNN. The experimental results show that the proposed human identification method successfully classified four persons.

I. Introduction

Interest in non-contact sensor-based vital-sign detection has been growing, and several studies have been published that show that each individual has a unique pattern of breathing signals [1, 2]. Based on these results, it has been shown that user identification is possible using a pattern of vital signals [2]. Radar sensors have attracted particular attention as they are non-contact sensors, providing convenience to the user, and use radio waves, so they are resistant to external environmental factors, such as strong light, darkness, and fog. Radar systems can also continuously authenticate users [2].
In [2], the authors tried to identify users using a continuous wave (CW) radar and a K-nearest neighbor (KNN) machine learning algorithm. However, CW radar employs only the frequency domain, making it difficult to distinguish the vital signals of multiple users, and the classification accuracy of the KNN algorithm can be degraded when the feature vector is not properly set.
This letter details two developments to improve the classification accuracy of radar-based authentication: first, a frequency-modulated continuous wave (FMCW) radar-based simultaneous recognition method, which has the advantage over CW radar of using both range and vital Doppler frequency parameters [3, 4], and second, a deep learning algorithm with enhanced performance for vital sign-based user authentication. A deep neural network (DNN) is suitable for the detection of vital signs with waveforms that change over time, and we therefore show in this letter improvement in the accuracy of user identification using the proposed algorithm.

II. System Model and Proposed Algorithm

This section describes the system model and the proposed algorithm of the vital FMCW radar. Let a total of L chirp signals be transmitted, reflected by M targets, and received. The received signal is dechirped by mixing the conjugate of the TX signal, and the dechirped signal is sampled as analog-to-digital converter (ADC). The l-th sampled beat signal is denoted by yl[n] for 0 ≤ nNs − 1, where the number of samples is Ns. By omitting the noise term, yl[n] is expressed as
(1)
yl[n]=m=0M-1[amexp (j2πμτmnTs)distance×exp (j(4πλlT(xm(h)+p=1Pxm.p(r))+θ))vital Doppler]
where am is the complex amplitude of the m-th target, μ is the frequency slope of the FMCW chirp symbol, τm is the delay term due to the distance, Ts is the sampling interval, T is the duration of a chirp symbol, and xm(h) and xm,p(r) represent the m-th human’s body motion by heartbeat and p-th harmonic term of respiration, respectively [5]. The sampled beat signal yl[n] is a column vector of size Ns for 1 ≤ lL and is represented as a matrix Y:
(2)
Y=[y1[n],y2[n],,yL[n]].
The beat signal Y is the input to the human identification method using a respiration pattern; this method is performed as follows:
The proposed algorithm finds the distance parameter of multiple targets by using the fast Fourier transform results of the received beat signal [5]; high-classification accuracy is then obtained by performing the DNN using the vital Doppler signal of the distance index. When the heart rates of multiple targets are different, each target has a different vital Doppler component from the perspective of the FMCW signal. To classify targets based on each vital Doppler signal, various classification methods are usually employed. Of these, a KNN classifier is used for conventional identification systems [2], which is a kind of supervised learning that uses the labeled data to classify by referring to close labels of k different data, as shown in Fig. 1. The KNN algorithm is a simple and effective method for multi-class classification and can model non-linear distributions. The KNN classifier uses a Euclidean distance method to calculate the distance between the i-th feature Si obtained from the training data and the features obtained from the testing data. The KNN classifier chooses k training data, and the input feature is then assigned based on the smallest distance difference. However, the KNN algorithm is part of the machine learning category, and machine learning has lower accuracy than deep learning algorithms, such as the DNN algorithm upon which this paper focuses. Compared to other conventional machine learning algorithms, the DNN employs a multi-layer structure to improve generalization and abstraction performance.
For DNN training and testing, the vital Doppler signal from the received data is used to construct the complete dataset. In Fig. 2, the received vital Doppler signal is fed into the least mean square filter, which achieves signal-to-noise ratio improvement. The filtered signal matrix R is the result of the adaptive filter. The output of the DNN is denoted by H and is represented as
(3)
H=σ(WkTσ(W2Tσ(W1TR)))
where Wk is the k-th weight matrix k = 1, 2, …, K; (·)T is a transpose operator; and σ(·) defines the activation function, such as ReLU.
The DNN with three hidden layers is selected as a network structure with final Softmax activation, as shown in Fig. 2. The activation function selected in the hidden layers is ReLU. By using three hidden layers, it is possible to represent an arbitrary decision boundary with a rational activation function that can approximate any type of smooth mapping to any degree of accuracy, and additional layers can learn more complex representations. However, there is a tradeoff between architecture layers (deepness) and the computational complexity of the proposed system. In this work, significant accuracy improvements were not achieved by increasing the number of layers (K>3), whereas the training process time was longer.

III. Experiments

This section presents experimental results to verify the improvement of the proposed algorithm. An experiment was conducted in an indoor room in DGIST in South Korea. The overall experimental environment is shown in the simulation section.
We utilized the 24 GHz FMCW radar system in [6]. The experiment sought the vital Doppler signal of the target selected from among the range estimation results from the human targets. The four human subjects described in this letter produced different vital Doppler signals, and these are shown in Fig. 3. For this experiment, various subjects’ respiration and heartbeat signals, obtained for user authentication, were acquired.
Since the field of view for the radar system is within ±15º in [6], the number of people who can be measured simultaneously is two. The distance between the people in each experiment was therefore set to 2 m. The experimental results are presented to demonstrate the improvement of the proposed algorithm. The four Doppler signals of the individuals are shown in Fig. 3. Human subjects have various vital Doppler signals, as shown in Fig. 3.
Table 1 shows the classifications of the KNN-based and proposed algorithms, comparing their performance. The input feature was of size 1 × 60 and k was set to 3, but the KNN-based user identification results are worse than those of the DNN-based algorithm.
The DNN used to classify the users consisted of an input layer of size 1 × 60, a 1st hidden layer of size 60 × 500, a 2nd hidden layer of size 500 × 250, a 3rd hidden layer of size 250 × 350, and an output layer of size 350 × 4. The DNN-based user identification results are better than those of the KNN-based algorithm, as shown in Table 1, because the conventional algorithm using KNN had 95% accuracy.

IV. Conclusion

This letter proposed a method of human identification by measuring respiration patterns using radar. The radar system overcomes the drawbacks of identification using specific body parts. Using KNN algorithms to classify multiple users has relatively poor classification results, and so a DNN algorithm was proposed to classify the respiration patterns of each person. The DNN-based user identification radar system was shown to classify four persons with 100% accuracy. In future research, heartbeat and respiration-based vital-sign data for user identification will be accumulated to improve vital monitoring techniques.

Acknowledgments

This work was supported by Daegu Gyeongbuk Institute of Science & Technology (DGI-ST) and in part by the DGIST R&D Program of the Ministry of Science, ICT, and Future Planning, Korea (No. 20-IT-02).

Fig. 1
Block diagram of KNN.
jees-2020-20-4-302f1.jpg
Fig. 2
Structure of proposed DNN.
jees-2020-20-4-302f2.jpg
Fig. 3
Doppler signals of four subjects: (a) 1st person, (b) 2nd person, (c) 3rd person, and (d) 4th person.
jees-2020-20-4-302f3.jpg
Table 1
Classification accuracy of KNN-based and proposed algorithms
Accuracy (%)

User 1 User 2 User 3 User 4
User 1 70/100 0/0 30/0 0/0
User 2 10/0 90/100 0/0 0/0
User 3 0/0 0/0 90/100 10/0
User 4 0/0 0/0 0/0 100/100

Values are presented as KNN/proposed algorithms.

References

1. DF Proctor and JB Hardy, "Studies of respiratory air flow; significance of the normal pneumotachogram," Bulletin of the Johns Hopkins Hospital, vol. 85, no. 4, pp. 253–280, 1949.
pmid
2. A Rahman, VM Lubecke, O Boric-Lubecke, JH Prins, and T Sakamoto, "Doppler radar techniques for accurate respiration characterization and subject identification," IEEE Journal on Emerging and Selected Topics in Circuits and Systems, vol. 8, no. 2, pp. 350–359, 2018.
crossref pdf
3. D Oh and JH Lee, "Low-complexity range-azimuth FMCW radar sensor using joint angle and delay estimation without SVD and EVD," IEEE Sensors Journal, vol. 15, no. 9, pp. 4799–4811, 2015.
crossref
4. G Wang, JM Munoz-Ferreras, C Gu, C Li, and R Gomez-Garcia, "Application of linear-frequency-modulated continuous-wave (LFMCW) radars for tracking of vital signs," IEEE Transactions on Microwave Theory and Techniques, vol. 62, no. 6, pp. 1387–1399, 2014.
crossref
5. S Kim and KK Lee, "Low-complexity joint extrapolation-MUSIC-based 2-D parameter estimator for vital FMCW radar," IEEE Sensors Journal, vol. 19, no. 6, pp. 2205–2216, 2019.
crossref
6. S Kim, D Oh, and J Lee, "Joint DFT-ESPRIT estimation for TOA and DOA in vehicle FMCW radars," IEEE Antennas and Wireless Propagation Letters, vol. 14, pp. 1710–1713, 2015.
crossref

Biography

jees-2020-20-4-302f4.jpg
Sangdong Kim was born in Seoul, South Korea, in 1981. He received B.S. degree in Electronics Engineering from Hanyang University, Ansan, in 2004, M.S. degree in Electronics Engineering from Hanyang University, Seoul, in 2006 and Ph.D. degree in Electronics Engineering from Kyungpook National University, Daegu, in 2018. From 2015 to 2016, he was a visiting scholar at the University of Florida. From 2006, he has been working as a Senior Researcher with the Division of Automotive Technology, Daegu Gyeongbuk Institute of Science & Technology (DGIST), Daegu, South Korea. And, from 2020, he has been working as an Assistant professor with the Department of Interdisciplinary Engineering (Adj.), Daegu Gyeongbuk Institute of Science & Technology (DGIST). His research interests include super-resolution algorithms, automotive radar, and vital radar.

Biography

jees-2020-20-4-302f5.jpg
Bongseok Kim received his B.S. degree in Electronics Engineering in 2006 and M.S. and Ph.D. degrees in Information and Communications Engineering from Yeungnam University, Korea, in 2009 and 2014, respectively. From 2014 to 2016, he worked in Daegu Gyeongbuk Institute of Science & Technology (DGIST), Korea, as a post-doc. Since 2016, he has been working in DGIST, Korea, as a senior research engineer. His current interests include multi-functional radar systems and radar signal processing.

Biography

jees-2020-20-4-302f6.jpg
Youngseok Jin received B.S. and M.S. degrees in Communication Engineering from Daegu University, Korea, in 2010 and 2012, respectively. Since 2012, he has been working in Daegu Gyeongbuk Institute of Science & Technology (DGIST), Korea, as a researcher. His current interests include radar signal processing and implementation in FPGA/DSP.

Biography

jees-2020-20-4-302f7.jpg
Jonghun Lee received B.S. degree in Electronics Engineering from Sungkyunkwan University, Korea, in 1996 and M.S. and Ph.D. degrees in Electrical and Electronics and Computer Science from Sungkyunkwan University, Korea, in 1998 and 2002, respectively. From 2002 to 2005, he worked in Samsung Electronics Company as a principal research engineer. Since 2005, he has been working in the Division of Automotive Technology, Daegu Gyeongbuk Institute of Science & Technology (DGIST), Korea, as a director & principal researcher. And, he has been working as a full professor with the Department of Interdisciplinary Engineering of the DGIST. He is a IEEE senior member. His primary research interests are detection, tracking, recognition for radar (FMCW & UWB radar), radar based vehicle sensor and radar signal processing and ML/DL for sensor fusion.

ABOUT
ARTICLE CATEGORY

Browse all articles >

BROWSE ARTICLES
AUTHOR INFORMATION
Editorial Office
#706 Totoo Valley, 217 Saechang-ro, Yongsan-gu, Seoul 04376, Korea
Tel: +82-2-337-9666    Fax: +82-2-6390-7550    E-mail: admin-jees@kiees.or.kr                

Copyright © 2024 by The Korean Institute of Electromagnetic Engineering and Science.

Developed in M2PI

Close layer
prev next