MoT: A Mixture of TriPlanes Framework for Frequency-Aware Dynamic Neural Radiance Fields
摘要
Dynamic Neural Radiance Fields (Dynamic NeRF) have become increasingly important for 3D scene reconstruction, particularly in modeling dynamic environments. However, they often face challenges in rendering high-frequency details with sufficient quality. To address this issue, we propose a novel frequency-aware approach using the Mixture of TriPlanes (MoT) framework. Inspired by the Mixture of Experts (MoE) paradigm, our method combines high-low frequency and dynamic-static triplanes, allowing for adaptive handling of different scene regions. This design enables specialized triplanes to process varying frequency and temporal components, resulting in more precise and flexible 3D reconstructions. Additionally, we propose a frequency-based feature fusion mechanism that dynamically adjusts weights for blending high and low-frequency information, improving the representation of complex scenes. Extensive experiments validate the effectiveness of our approach, demonstrating significant improvements over existing dynamic NeRF methods, particularly in capturing high-frequency details and dynamic elements.