Home News Deep Combiner for Independent and Correlated Pixel Estimates

Deep Combiner for Independent and Correlated Pixel Estimates

Abstract

Monte Carlo integration is an efficient method to solve a high-dimensional integral in light transport simulation, but it typically produces noisy images due to its stochastic nature. Many existing methods, such as image denoising and gradient-domain reconstruction, aim to mitigate this noise by introducing some form of correlation among pixels. While those existing methods reduce noise, they are known to still suffer from method-specific residual noise or systematic errors. We propose a unified framework that reduces such remaining errors. Our framework takes a pair of images, one with independent estimates, and the other with the corresponding correlated estimates. Correlated pixel estimates are generated by various existing methods such as denoising and gradient-domain rendering. Our framework
then combines the two images via a novel combination kernel. We model our combination kernel as a weighting function with a deep neural network that exploits the correlation among pixel estimates. To improve the robustness of our framework for outliers, we additionally propose an extension to handle multiple image buffers. The results demonstrate that our unified framework can successfully reduce the error of existing methods while treating them as black-boxes.

Authors: Hua, B.S. and other authors

Read more about the article here

Read more about the author’s publications here

Recent News

Seven VinUniversity Faculty Recognized in the 2024 World’s Most Influential Researchers Rankings
September 25, 2024

Seven VinUniversity Faculty Recognized in the 2024 World’s Most Influential Researchers Rankings

We are proud to announce that seven faculty members from VinUniversity have been recognized among the world’s most influential scientists in the August 2024 global rankings, developed by Stanford University using data from Scopus, the largest abstract and citation database of peer-reviewed literature. These rankings evaluate not only the quantity of research but also its […]

VinUni’s Research Affairs Committee for the Academic Year 2024 – 25 
September 23, 2024

VinUni’s Research Affairs Committee for the Academic Year 2024 – 25 

VinUniversity has established its Research Affairs Committee (RAC) for the 2024-2025 academic year. Formed in September 2024, the RAC is a key standing committee that plays a crucial role in advancing VinUni’s research and innovation initiatives. The committee’s primary objectives include: Supporting the Provost and Executive Board in policy development Creating mechanisms to solve problems […]

Professor Laurent El Ghaoui Attends the Launching Ceremony of the US International Innovation and Technology Security (ITSI) Fund in Vietnam
September 16, 2024

Professor Laurent El Ghaoui Attends the Launching Ceremony of the US International Innovation and Technology Security (ITSI) Fund in Vietnam

September 16, 2024 Professor Laurent El Ghaoui, VinUniversity Vice Provost of Research and Innovation, participated in discussions during the Distinguished Panel on Strengthening Semiconductor Investments and Ecosystem in Vietnam: A Focus on Policy Challenges and Opportunities, held from September 11-13 in Hanoi. The event was organized by the National Innovation Center (NIC) in collaboration with […]