This study presents a novel Variational Autoencoder (VAE) implementation using an actor-based distributed architecture with built-in fault tolerance mechanisms. The key innovation lies in transforming a traditional autoencoder into a variational autoencoder by implementing a specialized bottleneck actor that learns deviations from the normal distribution. The developed system utilizes a distributed actor model in which each component (encoder, decoder, and variational bottleneck) operates as an independent actor, enabling robust parallel processing and fault recovery. The implementation incorporates TensorFlow’s distributed strategy for GPU utilization and includes a comprehensive fault tolerance system that can handle actor failures with a 0.5% failure rate. The results demonstrated successful training on the utilized dataset, achieving a reconstruction loss of 0.089 and a Kullback-Leibler (KL) divergence loss of 0.076 after 50 epochs. The system maintained 99.5% uptime during training, automatically recovering from simulated actor failures without significant performance degradation.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Distributed Variational Autoencoder Using Actor-Based Architecture

  • Sithembiso Dyubele,
  • Duncan Anthony Coulter

摘要

This study presents a novel Variational Autoencoder (VAE) implementation using an actor-based distributed architecture with built-in fault tolerance mechanisms. The key innovation lies in transforming a traditional autoencoder into a variational autoencoder by implementing a specialized bottleneck actor that learns deviations from the normal distribution. The developed system utilizes a distributed actor model in which each component (encoder, decoder, and variational bottleneck) operates as an independent actor, enabling robust parallel processing and fault recovery. The implementation incorporates TensorFlow’s distributed strategy for GPU utilization and includes a comprehensive fault tolerance system that can handle actor failures with a 0.5% failure rate. The results demonstrated successful training on the utilized dataset, achieving a reconstruction loss of 0.089 and a Kullback-Leibler (KL) divergence loss of 0.076 after 50 epochs. The system maintained 99.5% uptime during training, automatically recovering from simulated actor failures without significant performance degradation.