An animated deep dive into the internal architecture of modern graphics cards, focusing on the NVIDIA GA102 GPU.
Interested in working with Micron to make cutting-edge memory chips? Work at Micron: bit.ly/micron-careers
Learn more about Micron's Graphic Memory! Explore Here: bit.ly/micron-graphic-memory
Curious about AI memory and HBM3E? Take a look: bit.ly/micron-hbm3e
Graphics Cards can run some of the most incredible video games, but how many calculations do they perform every single second? Well, some of the most advanced graphics perform 36 Trillion calculations or more every single second. But how can a single device manage these tens of trillions of calculations? In this video, we explore the architecture inside the 3090 graphics card and the GA102 GPU chip architecture.
Note: We chose to feature the 30 series of GPUs because, to create accurate 3D models, we had to tear down a 3090 GPU rather destructively. We typically select a slightly older model because we're able to find broken components on eBay. If you're wondering, the 4090 can perform 82.58 trillion calculations a second, and then we're sure the 5090 will be even more.
Table of Contents:
- How many calculations do Graphics Cards Perform?
- The Difference between GPUs and CPUs?
- GPU GA102 Architecture
- GPU GA102 Manufacturing
- CUDA Core Design
- Graphics Cards Components
- Graphics Memory GDDR6X GDDR7
- All about Micron
- Single Instruction Multiple Data Architecture
- Why GPUs run Video Game Graphics, Object Transformations
- Thread Architecture
- Help Branch Education Out!
- Bitcoin Mining
- Tensor Cores
- Outro
We're working on more ambitious subjects like computer architecture and graphics cards. Any contribution would greatly help make these videos. patreon.com/brancheducation
Branch Education Website: branch.education
Branch Education Facebook: facebook.com/BranchEducation/
Key Branches from this video are: How do Video Game Graphics Work? youtu.be/C8YtdC8mxTU
Animation: Mike Radjabov, Sherdil Davronov, Adrei Dulay, Parvesh Khatri
Research, Script and Editing: Teddy Tablante
Twitter: @teddytablante
Modeling: Mike Radjabov, Prakash Kakadiya
Voice Over: Phil Lee
Sound Design by Drilu: www.drilu.world
Sound Design and mix: David Pinete
Additional Sound Design: Raúl Núñez
Supervising Sound Editor: Luis Huesca
Erratum:
Ubuntu is a type of Linux
3080 has 10GB, not 12GB.
Image Attribution:
Williams, George. Jacquard Loom 6/6 flickr.com/photos/ghwpix/18056523/in/album-72157631870990316…
Eiermann, Georg. A close up of a weaving machine in a room. Jacquard Loom. unsplash.com/photos/a-close-up-of-a-weaving-machine-in-a-roo…
Wikipedia contributors. "Embarrassingly Parallel", "Graphics Processing Unit", "Parallel Computing" , " SIMD", " Single Instruction, Multiple Threads" , "Thread block (CUDA Programming)". Wikipedia, The Free Encyclopedia. Wikipedia, The Fre
Why it's here
1 person recommends this
What people say. Recommended as an exceptionally clear and highly visual introduction to GPU architecture and graphics pipelines.
w
u/warampedin r/GraphicsProgramming • Recommends
Want to get started in Graphics Programming? Start Here!
First of all, credit goes to u/CorySama and u/Better_Pirate_7823 for most of this, I am mostly just copy-pasting from them.
If all goes well, we can Sticky this for everyone to see.
Courtesy of u/CorySama:
The main thing you need to know is https://fgiesen.wordpress.com/2016/02/05/smart/
OpenGL is a good API to start with. There's a lot to learn regardless of which API you use. Once you can do an animated character in a scene with lighting, shadows, particles and basic full-screen post processing, you'll know how to proceed forward on your own from there.
https://learnopengl.com/
https://raytracing.github.io/
https://ga…