Deploying Large AI Models on Micro-electronics with RISC-V: Federated Learning for Energy Monitoring and Robotics
摘要
This paper introduces an innovative architecture for deploying AI models in edge and cloud environments, leveraging Federated Learning and RISC-V processors for privacy and real-time inference. It addresses the constraints of edge devices like Raspberry Pi and Jetson Nano by training models locally and aggregating results in the cloud to mitigate overfitting and catastrophic forgetting. RISC-V processors enable high-speed inference at the edge. Applications include energy consumption monitoring with LSTM models and recommendations via collaborative filtering, and multi-robot human collaboration using CNN and YOLO models. Model compression and partitioning optimize performance on RISC-V, with experiments demonstrating scalability and responsiveness under varying computational demands.