Design and Implementation of a Simulation System Based on Deep Q-Network for Mobile Actor Node Control in Wireless Sensor and Actor Networks

• Published in: 2017 31st International Conference on Advanced Information Networking and Applications Workshops (WAINA) pp. 195 - 200
• Main Authors: Oda, Tetsuya, Obukata, Ryoichiro, Ikeda, Makoto, Barolli, Leonard, Takizawa, Makoto
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-03-2017
• Subjects: Deep Q-Network; Games; Mobile Actor Node Control; Mobile communication; Mobile computing; Object oriented modeling; Robot sensing systems; Rust; Simulation System; Wireless Sensor and Actor Networks; Wireless sensor networks
• DOI: 10.1109/WAINA.2017.67

A Wireless Sensor and Actor Network (WSAN) is a group of wireless devices with the ability to sense physical events (sensors) or/and to perform relatively complicated actions (actors), based on the sensed data shared by sensors. This paper presents design and implementation of a simulation system based on Deep Q-Network (DQN) for mobile actor node control in WSANs. DQN is a deep neural network structure used for estimation of Q-value of the Q-learning method. In this work, we implement the proposed simulating system by Rust programming language. We describe the design and implementation of the simulation system, and show some simulation results to evaluate its performance.