open:deep-convolutional-and-recurrent-models-for-human-activity-recognition-using-wearables [EL]

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
# Deep, Convolutional, and Recurrent Models for Human Activity Recognition using Wearables

# Abstract

Human activity recognition (HAR) in ubiquitous computing is beginning to adopt deep learning to substitute

# 1. Introduction

Human activity recognition (HAR) in ubiquitous computing is beginning to adopt deep learning to substitute for well-established analysis techniques that rely on hand-crafted feature extraction and classification techniques.

From these isolated applications of custom depp archtectures it is, however, difficult to gain an overview of their suitability for problems ranging from the recognition of manipulative gestures to the segmentation and identification of physical activites like running or ascending stairs.

In this paper we rigorously explore deep, convolutional, and recurrent approaches across three representative datasets that contain movement data captured with wearable sensors.

We describe how to train recurrent approaches in this setting, introduce a novel [[regularisation]] approach, and illustrate how they outperform the state-of-the-art on a large benchmark dataset.

Across thousands of recognition experiments with randomly sampled model configurations we investigate the suitability of each model for different tasks in HAR, explore the impact of hyperparameters using the fANVOA framework, and provide guidelines for the practitioner who wants to apply deep learning in their problem setting.

# 6. Discussion

In this work we explored the performance of state-of-the-art deep learning approaches for Human Activity Recognition using wearable sensors.

We described how to train recurrent approaches in this setting and intoduced a novel regularisation approach.

In thousands of experiements we evaluated the performance of the models with randomly sampled hyperparameters.

We found that bi-directional [[LSTM]]s outperform the current state-of-the-art on Opportunity, a large benchmark dataset, by a considerable margin.

However, interesting from a practitioner's point of view is not the peak performance for each mode, but the process of prarameter exploration and insights into their suitability for different tasks in HAR.

Recurrent networks outperform convolutional networks significantly on acitivites that are short in duration but have a natural ordering, where a recurrent approach benefits from the ability to contextualise observations across long periods of time.

For bi-directional [[RNN]]s we found that the number of units per layer has the largest effect on performance across all datasets.

For prolonged and repetitive activities like walking or running we recommend to use [[CNN]]s. 

Their average performance in this setting makes it more likely that the practitioner discovers a suitable configuration, even though we found some RNNs that work similarly well or even outperform CNNs in this setting.

We further recommend to start exploring learning-rates, before optimising the architecuter of the network, as the learning-parameters had the largest effect on performance in our experiments.

We found that models differ in the speard of recognition perfomance for different parameter settings.

Regular [[DNN]]s, a model that is probably the most approachable for a pratitioner, requires a significant investment in parameter exploration and shows a substantial spread between the peak and median performance.

Practitioners should therefore not discard the model even if a preliminary exploration leads to poor recognition performance.

More sophisticated approaches like CNNs or RNNs show a much smaller spread of performance, and it is more likely to find a configuration that works well with only a few iterations.




## 출처

- https://arxiv.org/pdf/1604.08880.pdf
- http://gradschoolstory.net/terry/readingpapers/