Combining Static and Dynamic Features for Multivariate Sequence Classification

• Published in: 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA) pp. 21 - 30
• Main Authors: Leontjeva, Anna, Kuzovkin, Ilya
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-10-2016
• Subjects: Brain modeling; Data mining; Data models; Ensembles; Feature extraction; Heuristic algorithms; Hidden Markov models; HMM; LSTM; Sequence classification; Transforms
• DOI: 10.1109/DSAA.2016.10

Model precision in a classification task is highly dependent on the feature space that is used to train the model. Moreover, whether the features are sequential or static will dictate which classification method can be applied as most of the machine learning algorithms are designed to deal with either one or another type of data. In real-life scenarios, however, it is often the case that both static and dynamic features are present, or can be extracted from the data. In this work, we demonstrate how generative models such as Hidden Markov Models (HMM) and Long Short-Term Memory (LSTM) artificial neural networks can be used to extract temporal information from the dynamic data. We explore how the extracted information can be combined with the static features in order to improve the classification performance. We evaluate the existing techniques and suggest a hybrid approach, which outperforms other methods on several public datasets.