This study presents a minimalistic but perception-based framework for real-time rendering decisions in virtual reality (VR) applications. The proposed system utilizes a highly compressed visual input representation based on Discrete Cosine Transform (DCT) coefficients and combines it with a tiny neural network to determine whether full scene re-rendering is perceptually necessary. By reframing the rendering task as a binary decision problem, the method enables selective frame reuse, reducing redundant render cycles without sacrificing visual experience. The tiny neural approximator is designed to be extremely compact, ensuring inference times and enabling real-time integration on resource-constrained VR devices. A practical training methodology is proposed that leverages pre-recorded motion sequences and perceptual similarity metrics, such as Structural Similarity (SSIM) and Signal-to-Noise Ratio (SNR), to automatically generate binary training labels without human supervision. Extensive analysis demonstrates the approach’s theoretical feasibility, perceptual relevance, and real-time performance characteristics. The results indicate that perceptually-aware, resource-efficient rendering decisions can be achieved even with minimal model complexity, providing a promising path toward more intelligent and power-conscious VR rendering systems.

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Tiny Neural Approximators for Real-Time Rendering Decisions Based on Discrete Cosine Transform Image Representation

  • Armin Grasnick,
  • Elnaz Gholipour

摘要

This study presents a minimalistic but perception-based framework for real-time rendering decisions in virtual reality (VR) applications. The proposed system utilizes a highly compressed visual input representation based on Discrete Cosine Transform (DCT) coefficients and combines it with a tiny neural network to determine whether full scene re-rendering is perceptually necessary. By reframing the rendering task as a binary decision problem, the method enables selective frame reuse, reducing redundant render cycles without sacrificing visual experience. The tiny neural approximator is designed to be extremely compact, ensuring inference times and enabling real-time integration on resource-constrained VR devices. A practical training methodology is proposed that leverages pre-recorded motion sequences and perceptual similarity metrics, such as Structural Similarity (SSIM) and Signal-to-Noise Ratio (SNR), to automatically generate binary training labels without human supervision. Extensive analysis demonstrates the approach’s theoretical feasibility, perceptual relevance, and real-time performance characteristics. The results indicate that perceptually-aware, resource-efficient rendering decisions can be achieved even with minimal model complexity, providing a promising path toward more intelligent and power-conscious VR rendering systems.