Improved Spatial Upscaling through FidelityFX Super Resolution for Real-Time Game Engines

Timothy Lottes explains the inner workings of AMD's FSR1 spatial upscaling algorithm and its integration into Unity's rendering pipeline.

This talk provides in-depth intuition and details about AMD's FSR1 scaling algorithm, as well as shares the architecture behind integrating this technique into Unity's high-definition rendering pipeline. Part of the SIGGRAPH 2021 Advances in Real-Time Rendering in Games course (advances.realtimerendering.com/). All methods shared in the presentation are illustrated with diagrams, images, and performance numbers. First part dives into the details and inner workings of FSR1 scaling algorithm. With a focus on teaching the optimization principles used in its design, and to leave the viewer with some creative thoughts on image processing. Second part covers integration into a modern physically-based deferred and forward rendering pipeline in Unity. Speaker Bios: Timothy Lottes specializes in GPU algorithms and optimization with a background in photography. Currently focusing on new graphics technology at Unity as part of the Graphics Innovation Group. Prior work included authoring FidelityFX shaders like CAS and LPM at AMD, working on TAA and mobile post processing at Epic, and authoring FXAA/TXAA at NVIDIA. Kleber Garcia has a M. Sc. in Computer Science from the Florida Institute of Technology. He led the rendering team for the Madden franchise during the first drop of Xbox One and PS4. He later joined the Frostbite rendering team in Stockholm where he implemented shadow systems, character material and lighting models, and post process effects. He architected and led the development of an open world GPU probe system currently shipping in Battlefield 6 and Need for Speed HEAT. Kleber has joined the frontlines at Unity Technologies where he has delivered the DLSS integration. He is an avid coffee drinker, foodie, and has a passion for all things GPU and work pranks.