Home News Deep Combiner for Independent and Correlated Pixel Estimates

Deep Combiner for Independent and Correlated Pixel Estimates

Abstract

Monte Carlo integration is an efficient method to solve a high-dimensional integral in light transport simulation, but it typically produces noisy images due to its stochastic nature. Many existing methods, such as image denoising and gradient-domain reconstruction, aim to mitigate this noise by introducing some form of correlation among pixels. While those existing methods reduce noise, they are known to still suffer from method-specific residual noise or systematic errors. We propose a unified framework that reduces such remaining errors. Our framework takes a pair of images, one with independent estimates, and the other with the corresponding correlated estimates. Correlated pixel estimates are generated by various existing methods such as denoising and gradient-domain rendering. Our framework
then combines the two images via a novel combination kernel. We model our combination kernel as a weighting function with a deep neural network that exploits the correlation among pixel estimates. To improve the robustness of our framework for outliers, we additionally propose an extension to handle multiple image buffers. The results demonstrate that our unified framework can successfully reduce the error of existing methods while treating them as black-boxes.

Authors: Hua, B.S. and other authors

Read more about the article here

Read more about the author’s publications here

Recent News

Professor Laurent El Ghaoui Attends the Launching Ceremony of the US International Innovation and Technology Security (ITSI) Fund in Vietnam
September 16, 2024

Professor Laurent El Ghaoui Attends the Launching Ceremony of the US International Innovation and Technology Security (ITSI) Fund in Vietnam

September 16, 2024 Professor Laurent El Ghaoui, VinUniversity Vice Provost of Research and Innovation, participated in discussions during the Distinguished Panel on Strengthening Semiconductor Investments and Ecosystem in Vietnam: A Focus on Policy Challenges and Opportunities, held from September 11-13 in Hanoi. The event was organized by the National Innovation Center (NIC) in collaboration with […]

[Job Opportunity] Data Collection Volunteer for Flood Simulation Project – Center for Environmental Intelligence
September 12, 2024

[Job Opportunity] Data Collection Volunteer for Flood Simulation Project – Center for Environmental Intelligence

Job Title: Data Collection Volunteer for Flood Simulation Project Project: COSMOS Lab – River Basin Flood Modeling Position: Volunteer Number of Positions: 3 Duration: 1 week, starting immediately Job Description: We are seeking enthusiastic volunteers to assist with data collection for a flood simulation project focused on river basin areas. This is an excellent opportunity […]

[Job Opportunity] Postdoctoral Fellow and Research Assistant Position – Center for Environmental Intelligence: Electrochemistry, Batteries or Supercapacitors
July 24, 2024

[Job Opportunity] Postdoctoral Fellow and Research Assistant Position – Center for Environmental Intelligence: Electrochemistry, Batteries or Supercapacitors

  About CEI: The Center for Environmental Intelligence (CEI) is a hub for “Green and Sustainable Tech Transfer” at VinUni. It fosters global collaborations to address environmental challenges using advanced technology and interdisciplinary research. CEI focuses on smart and sustainable development, driving transformative solutions for Vietnam and beyond. Its mission includes creating a robust platform […]