Spiking Neural Networks are receiving a lot of attention as a powerful, computationally efficient, and hence energy efficient alternative to traditional artificial neural networks. In this paper, we present a new method to solve the lunar lander problem using a deep Q-learning approach with an Spiking Neural Network (SNN). Our contribution is a new spike encoding algorithm to encode the state vector. This makes it possible to achieve a good result in only one simulation step. In addition, we have tested several input layer sizes and network architectures. Our results are evaluated in terms of performance and runtime on a Graphics Processing Unit (GPU). Our SNN with one-hot encoding outperforms the state-of-the-art Artificial Neural Network (ANNs) with respect to its hardware requirements while still reaching a comparable accuracy.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Solving the Lunar Lander Problem with Spiking Neural Networks and One-Hot Encoding

  • Jonas Hansert,
  • Peter Offermann,
  • Franck Gechter

摘要

Spiking Neural Networks are receiving a lot of attention as a powerful, computationally efficient, and hence energy efficient alternative to traditional artificial neural networks. In this paper, we present a new method to solve the lunar lander problem using a deep Q-learning approach with an Spiking Neural Network (SNN). Our contribution is a new spike encoding algorithm to encode the state vector. This makes it possible to achieve a good result in only one simulation step. In addition, we have tested several input layer sizes and network architectures. Our results are evaluated in terms of performance and runtime on a Graphics Processing Unit (GPU). Our SNN with one-hot encoding outperforms the state-of-the-art Artificial Neural Network (ANNs) with respect to its hardware requirements while still reaching a comparable accuracy.