FakeGuard: Novel Architecture Support for Deepfake Detection Networks

Deepfake technologies are evolving rapidly, the malicious or illegal uses of deepfakes have raised serious threats in societal, political, and business fields. To tackle such threats, the latest and most effective methods combine the advantages of vision transformer and CNN to detect deepfakes. However, deploying the deepfake detection networks on the existing CNN and transformer accelerators faces several critical issues such as the inefficiency and underutilization. We propose a novel accelerator architecture for deepfake detection networks, FakeGuard, which enables a cost-effective, high performance hybrid network execution. It features a flexible computing engine with reconfigurable adder tree to support for different computing patterns within a single hardware architecture. A fine-grained, dependency-free task scheduling mechanism is designed to maximize hardware resources utilization. Extensive experiments show that FakeGuard surpasses the state-of-art accelerators.