Spiking neural networks (SNNs), inspired by biological brains, use discrete spikes for communication, offering potential advantages in energy efficiency and temporal processing. These properties make them attractive for low-power, real-time control, but optimizing their structure and parameters is challenging. This work investigates the impact of spatial embedding on recurrent SNN performance and efficiency in continuous control tasks. We evolve SNNs with neurons positioned in a 3D Euclidean space, where connection probabilities and strengths decrease with distance. A genetic algorithm optimizes neuron parameters, connection weights, and network topology. Evaluating various spatial embeddings (none, 1D, 2D, and 3D) across multiple reinforcement learning environments, we find that spatially embedded networks outperform non-embedded counterparts within our framework. We also find that the 2D embedding generally achieves the best performance. Spatial embedding also leads to highly sparse networks, with over 95% of weights being zero. Compared to state-of-the-art deep reinforcement learning models, our evolved SNNs achieve similar performance on simpler tasks using as little as 1.46% of the non-zero weights. A performance gap on more complex tasks suggests the need for future research on larger, spatially embedded networks. These findings show the potential of spatial embedding for designing efficient SNNs for neuromorphic control.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Evolving Spatially Embedded Recurrent Spiking Neural Networks for Control Tasks

  • Alexandru Vasilache,
  • Jona Scholz,
  • Yulia Sandamirskaya,
  • Jürgen Becker

摘要

Spiking neural networks (SNNs), inspired by biological brains, use discrete spikes for communication, offering potential advantages in energy efficiency and temporal processing. These properties make them attractive for low-power, real-time control, but optimizing their structure and parameters is challenging. This work investigates the impact of spatial embedding on recurrent SNN performance and efficiency in continuous control tasks. We evolve SNNs with neurons positioned in a 3D Euclidean space, where connection probabilities and strengths decrease with distance. A genetic algorithm optimizes neuron parameters, connection weights, and network topology. Evaluating various spatial embeddings (none, 1D, 2D, and 3D) across multiple reinforcement learning environments, we find that spatially embedded networks outperform non-embedded counterparts within our framework. We also find that the 2D embedding generally achieves the best performance. Spatial embedding also leads to highly sparse networks, with over 95% of weights being zero. Compared to state-of-the-art deep reinforcement learning models, our evolved SNNs achieve similar performance on simpler tasks using as little as 1.46% of the non-zero weights. A performance gap on more complex tasks suggests the need for future research on larger, spatially embedded networks. These findings show the potential of spatial embedding for designing efficient SNNs for neuromorphic control.