Distributed Variational Autoencoder Using Actor-Based Architecture
摘要
This study presents a novel Variational Autoencoder (VAE) implementation using an actor-based distributed architecture with built-in fault tolerance mechanisms. The key innovation lies in transforming a traditional autoencoder into a variational autoencoder by implementing a specialized bottleneck actor that learns deviations from the normal distribution. The developed system utilizes a distributed actor model in which each component (encoder, decoder, and variational bottleneck) operates as an independent actor, enabling robust parallel processing and fault recovery. The implementation incorporates TensorFlow’s distributed strategy for GPU utilization and includes a comprehensive fault tolerance system that can handle actor failures with a 0.5% failure rate. The results demonstrated successful training on the utilized dataset, achieving a reconstruction loss of 0.089 and a Kullback-Leibler (KL) divergence loss of 0.076 after 50 epochs. The system maintained 99.5% uptime during training, automatically recovering from simulated actor failures without significant performance degradation.