0:00 / 0:00

Playing a Neural Network's version of GTA V: GAN Theft Auto

Name: Playing a Neural Network's version of GTA V: GAN Theft Auto
Uploaded: 2021-06-18T13:40:13Z
Duration: 17 min 8 s
Channel: sentdex
Description: Sentdex demonstrates GAN Theft Auto, a neural network trained to simulate the environment and physics of Grand Theft Auto V.

sentdex

1.4M subscribers • 1 video on Hallway

YouTube

Recommended by 3 people: 3 on Hacker News.
A classic. People kept recommending it from 2021 to 2024.
Linked in the descriptionsentdex/GANTheftAuto

Intermediate. Assumes working knowledge.

765K views5 years ago3 recommendations

AI and machine learning Game development Neural networks and deep learning Game programming

Sentdex demonstrates GAN Theft Auto, a neural network trained to simulate the environment and physics of Grand Theft Auto V.

GAN Theft Auto is a Generative Adversarial Network that recreates the Grand Theft Auto 5 environment. It is created using a GameGAN fork based on NVIDIA's GameGAN research. With GAN Theft Auto, the neural network *is* the environment and you can play within it. Github: github.com/sentdex/GANTheftAuto/ Unboxing and reviewing the DGX Station A100 80GB: youtube.com/watch?v=0mAesfFt4us Neural Networks from Scratch book: nnfs.io Channel membership: youtube.com/channel/UCfzlCWGWYyIQ0aLC5w48gBQ/join Discord: discord.gg/sentdex Reddit: reddit.com/r/sentdex/ Support the content: pythonprogramming.net/support-donate/ Twitter: twitter.com/sentdex Instagram: instagram.com/sentdex Facebook: facebook.com/pythonprogramming.net/ Twitch: twitch.tv/sentdex

Why it's here

3 people recommend this

What people say. Highly praised as a mind-blowing demonstration of AI-generated game worlds and the potential for neural networks to simulate complex environments.

ALittleLighton Hacker News • 5 years agoRecommends

On “Where are the robotic bricklayers?”

This video really amazed me in terms of automated game development. My fantasies are something like this and GPT-3 plus a couple decades of progress. I think we'll get to genuinely open ended sand box games. link to this video

View on Hacker News

ALittleLighton Hacker News • 4 years agoRecommends

On “DALL-E, the Metaverse, and Zero Marginal Content”

This YouTube video, to me, shows the promise of things to come. AI generated game worlds. Language models to generate plots and dialog, transformers and GANs to create illustrations. Imagine a game, a truly open world sand box, Grand Theft Auto meets AI Dungeon - every NPC is a "real" person with unlimited dialog options, the buildings you drive by you could easily walk in and investigate, unlimited play space - you could type in more general instructions and ideas to the plot generator ("add in a vampire romance and murder mystery angle") on the fly. link to this video

View on Hacker News

eruon Hacker News • 3 years agoRecommends

On “Netflix: 30% bitrate saving using Film Grain Synthesis”

> You could directly encode the elements as understanded by the process used to generate them, rather than attempting to reconstitute things from a stream of bitmaps. You might like Gan Theft Auto: link to this video

View on Hacker News

7734128on Hacker News • 2 years agoRecommends

On “Diffusion models are real-time game engines”

What you're describing reminded me of this cool project: link to this video "Playing a Neural Network's version of GTA V: GAN Theft Auto"

View on Hacker News

magic_quoteson Hacker News • 5 years agoMentions

On “GAN Theft Auto [video]”

Have you seen the video? The author even goes as far as suggesting the technique might useful for (generating?) entire operating systems at link to this video . That's just wild.

View on Hacker News

bentcorneron Hacker News • 5 years agoMentions

On “The art of asking nicely”

GAN Theft Auto also had a similar dream-like quality, especially with anything involving collisions (cars and how "big" the road was). link to this video

View on Hacker News

eruon Hacker News • 3 years agoMentions

On “Chip design shifts as fundamental laws run out of steam”

…commercial success. AKA, I can utilize just about every core i'm given with parallel compiles, or rendering a 4K video, but I'm pretty sure i'm the only one in my immediate family that needs that. My wife in the past might have done some simulation work, but these days the heaviest thing she runs on her PC is office products. See GAN Theft Auto at link to this video Someone trained a neural network to convert controller input into video output that simulates the game Grand Theft Auto. If technology keeps improving, I expect many future games will be such 'dreams' of neural networks. You are right that running Word or Excel won't really benefit from more cores.…

View on Hacker News

eruon Hacker News • 3 years agoMentions

On “Netflix: 30% bitrate saving using Film Grain Synthesis”

I guess unless your codec handles water physics. Which is not quite as absurd as it sounds. Have a look at the reflections in link to this video

View on Hacker News

SXXon Hacker News • 2 years agoMentions

On “Stable Video Diffusion”

Actually it was already done by sentdex with GAN Theft Auto: link to this video To an extent... PS: Video is 2 years old, but still really impressive.

View on Hacker News

KhoomeiKon Hacker News • 2 years agoMentions

On “Diffusion models are real-time game engines”

NVIDIA did something similar with GANs in 2020 1, except users could actually play those games (unlike in this diffusion work which just plays back simulated video). Sentdex later adapted this to play GTA with a really cool demo 2. 1 link 2 link to this video

View on Hacker News

spyderon Hacker News • 2 years agoMentions

On “Leak claims RTX 5090 has 600W TGP, RTX 5080 hits 400W”

True, but also AI could be the reason why games would need more powerful GPUs in the future (but not yet). For example LLMs for NPC dialogs, or the wilder things like running the whole game inside a neural network, or running an AI style filter over the output of the regular game engines. link link to this video link

View on Hacker News

imtringuedon Hacker News • 11 months agoMentions

On “Spatial intelligence is AI’s next frontier”

>There's some progress in video generation which takes a short clip and extrapolates what happens next. That's a promising line of development. The key to "common sense" is being able to predict what happens next well enough to avoid big mistakes in the short term, a few seconds. How's that coming along? And what's the internal world model, assuming we even know? link to this video This has been a thing for a while. It's actually a funny way to demonstrate model based control by replacing the controller with a human.

View on Hacker News