cutelolly / ci4r-activity-recognition-datasets

The Laboratory of Computational Intelligence for RADAR (CI4R)

CI4R- Human-Activity-Recognition-Datasets

Human activity dataset from the laboratory of Computational intelligence for Radar (Ci4R) has been made public here. The associated paper to this dataset is as follows:

CrossFrequency training with Adversarial learning for radar micro-Doppler signature classification [Presentation]

Cite as:

Sevgi Z. Gurbuz, M. Mahbubur Rahman, Emre Kurtoglu, Trevor Macks, and Francesco Fioranelli "Cross-frequency training with adversarial learning for radar micro-Doppler signature classification (Rising Researcher)", Proc. SPIE 11408, Radar Sensor Technology XXIV, 114080A (11 May 2020); https://doi.org/10.1117/12.2559155

Abstract

Deep neural networks have become increasingly popular in radar micro-Doppler classification; yet, a key challenge, which has limited potential gains, is the lack of large amounts of measured data that can facilitate the design of deeper networks with greater robustness and performance. Several approaches have been proposed in the literature to address this problem, such as unsupervised pre-training and transfer learning from optical imagery or synthetic RF data. This work investigates an alternative approach to training which involves exploitation of “datasets of opportunity” – micro-Doppler datasets collected using other RF sensors, which may be of a different frequency, bandwidth or waveform - for the purposes of training. Specifically, this work compares in detail the cross-frequency training degradation incurred for several different training approaches and deep neural network (DNN) architectures. Results show a %70 drop in classification accuracy when the RF sensors for pre-training, fine-tuning, and testing are different, and a %15 degradation when only the pre-training data is different, but the fine-tuning and test data are from the same sensor. By using generative adversarial networks (GANs), a large amount of synthetic data is generated for pre-training. Results show that cross-frequency performance degradation is reduced by %50 when kinematically-sifted GAN-synthesized signatures are used in pre-training.

Description of the dataset [Spectrogram Dataset Download] [Raw Data Download]

Six participants of various ages, heights and weights were involved in this study. Three different sensors and a total of 11 different activities and ambulatory gaits were considered, as listed in the Figure . The choice of these activities were motivated by smart environment applications, where monitoring of activities of daily living are required to support health monitoring and gesture recognition. Each participant conducted 10 repetitions of each activity, resulting in a total of 60 samples per class per sensor. Additionally, data previously acquired at an earlier date from the 24 GHz sensor was used to enrich the dataset with an additional 180 samples per class. All activities were conducted along the radar line-of-sight.