Continual Learning in Recurrent Neural Networks for the Internet of Things: A Stochastic Approach

• Published in: Proceedings - IEEE Symposium on Computers and Communications pp. 1 - 6
• Main Authors: Filho, Josafat Ribeiro Leal, Kocian, Alexander, Frohlich, Antonio Augusto, Chessa, Stefano
• Format: Conference Proceeding
• Language: English
• Published: IEEE 26-06-2024
• Subjects: Computational modeling; Continuing education; Data models; Expectation Maximization; Importance sampling; Internet of Things; Monte Carlo; recurrent neural network; Recurrent neural networks; regression; Smart agriculture; Stochastic processes; Streams; Time series analysis; Training
• ISSN: 2642-7389
• DOI: 10.1109/ISCC61673.2024.10733672

In many applications Internet of Things (IoT) supports decision taking on the base of continuous data acquisition. These data, usually streams of sensed data, are processed and analysed to produce high-level information. The latter task is usually achieved by means of artificial intelligence technologies. Among these, continual learning is emerging as a paradigm that combines well with IoT as it matches the ability of IoT to continuously produce new data. In this context, we address continual learning with Recurrent Neural Networks (RNN) under a stochastic perspective, in which we consider the RNN as a stationary state-space network. This led us to deploy the Generalized Expectation-Maximization algorithm, in a setting suitable for IoT. We demonstrate the effectiveness of our approach by considering a case study taken from digital agriculture, in which we adopt the continual learning model to assess the biomass prediction in the field of horticulture using IoT technology. Results demonstrate that RNNs embedded in the EM framework can learn on their own after a very short training phase covering a few time samples.