Skip to content
Hallway
0:00 / 0:00

#denoising#raytracing#montecarlo

AI Learns Noise Filtering For Photorealistic Videos | Two Minute Papers #215

Two Minute Papers

1.8M subscribers • 14 videos on Hallway

YouTube
  • Recommended by 2 people: 2 on Hacker News.
  • May be out of date. Uploaded 8 years ago, in an area where tools change fast.

Intermediate. Assumes working knowledge.

64K views8 years ago2 recommendations

Graphics and audioAI and machine learningRenderingNeural networks and deep learningGPUs, shaders and CUDA

An explanation of NVIDIA's recurrent denoising autoencoder, which uses deep learning to clean up noisy real-time Monte Carlo ray-traced images.

The paper "Interactive Reconstruction of Monte Carlo Image Sequences using a Recurrent Denoising Autoencoder" is available here: research.nvidia.com/publication/interactive-reconstruction-m… The paper with the notoriously difficult "Spheres" scene: users.cg.tuwien.ac.at/zsolnai/gfx/adaptive_metropolis/ We would like to thank our generous Patreon supporters who make Two Minute Papers possible: Andrew Melnychuk, Brian Gilman, Christian Ahlin, Christoph Jadanowski, Dave Rushton-Smith, Dennis Abts, Eric Haddad, Esa Turkulainen, Evan Breznyik, Kaben Gabriel Nanlohy, Malek Cellier, Marten Rauschenberg, Michael Albrecht, Michael Jensen, Michael Orenstein, Raul Araújo da Silva, Robin Graham, Steef, Steve Messina, Sunil Kim, Torsten Reil. patreon.com/TwoMinutePapers One-time payments: PayPal: paypal.me/TwoMinutePapers Bitcoin: 13hhmJnLEzwXgmgJN7RB6bWVdT7WkrFAHh Ethereum: 0x002BB163DfE89B7aD0712846F1a1E53ba6136b5A Music: Antarctica by Audionautix is licensed under a Creative Commons Attribution license (creativecommons.org/licenses/by/4.0/) Artist: audionautix.com/ Thumbnail background image credit: pixabay.com/photo-2379965/ Splash screen/thumbnail design: Felícia Fehér - felicia.hu Károly Zsolnai-Fehér's links: Facebook: facebook.com/TwoMinutePapers/ Twitter: twitter.com/karoly_zsolnai Web: cg.tuwien.ac.at/~zsolnai/

Why it's here

2 people recommend this

What people say. Recommended as a clear explanation of how deep learning denoisers enable real-time ray tracing with very few samples per pixel.

halflingson Hacker News • Recommends

On “Neural scene representation and rendering”

Disney actually does a lot of research combining the world of graphics with deep learning. Some examples that you might appreciate (from the excellent channel "Two Minute Papers"): . "Disney's AI Learns To Render Clouds" 0 . "AI Learns Noise Filtering For Photorealistic Videos" 1 0 link 1 link to this video
View on Hacker News

jonas21on Hacker News • Recommends

On “Ray Tracing Denoising”

It's only briefly mentioned, but NVIDIA's recurrent denoising autoencoder is pretty amazing. link Two Minute Papers did a nice explanation of it: link to this video
View on Hacker News

u/edwardkmettin r/haskell • Mentions

On “Monad transformers objections”

I'm not using any type families there. MonadReader is a "multi parameter type class" but it was already there. `HasMyStuff` is just that little class I sketched below. There `m` determines some type `e` that I want to have a lens into to get out `MyStuff`. I'll typically use this when writing larger applications. Let's see an example! link to this video defines how I handle input events from SDL2 (a graphics / user interaction management library). Then I just build up more and more constraints: https://github.com/ekmett/quine/blob/5a74c503d45d9d92365ff77d51823b9c126f050e/Toy.hs#L154 To run things, I bolt that `Input` type and whatever else I need into a larger `System` type that contains all the…
7View on Reddit

scrumptionon Hacker News • Mentions

On “Nvidia announces RTX 2000 GPU series with ‘6x more performance’ and ray-tracing”

I don't think your estimations take into account the massive gains from AI denoising techniques such as link to this video
View on Hacker News

blooopon Hacker News • Mentions

On “Path Tracing vs. Ray Tracing (2016)”

This uses a neural network link to this video video results start around 1:15 This one does not use a neural network: link
View on Hacker News

kuzehankaon Hacker News • Mentions

On “Quake II RTX: Re-Engineering a Classic with Ray Tracing Effects on Vulkan”

Deep learning denoiser. I don't know if NVIDIA came up with some marketing term for it. It's what allows RTX to produce meaningful images at all despite the renderer running at 0.5-2 samples per pixel which looks little better than random noise. I kind of assumed they'd call it DLDN because they called their deep learning supersampling DLSS. I guess not, go figure. link to this video
View on Hacker News