Skip to content
0:00 / 0:00

#trackmania#reinforcementlearning#tminterface

Training an unbeatable AI in Trackmania

Yosh

424K subscribers • 1 video on Hallway

YouTube
  • Recommended by 1 person: 1 on Hacker News.

Intermediate. Assumes working knowledge.

17M views3 years ago1 recommendation

AI and machine learningGame developmentReinforcement learningGame programming

Yosh explains how he trained a reinforcement learning agent to drive Trackmania and the design choices involved in preventing exploits.

I trained an AI in Trackmania with reinforcement learning, until I couldn't beat it. Join my Patreon: patreon.com/Yoshtm There’s also a membership option directly on YouTube: youtube.com/channel/UCh1zLfuN6F_X4eoNKCsyICA/join Contact: • Mail: yoshtm.yt@gmail.com • Discord: yosh_tm • Twitter: yoshtm1 Most of the music I use is from Epidemic Sound: share.epidemicsound.com/13vf27 (affiliate link) Special thanks to Donadigo, for TMInterface ! ______________________________________________________________ If you want to try these maps, you first need to have both Trackmania Nations Forever (TMNF) and TMInfinity installed. Then, you can download the maps on Trackmania Exchange (TMX). Everything is free, and you can use the links below. • TMNF : files.trackmaniaforever.com/tmnationsforever_setup.exe • TMInfinity: unlimiter.net/download • Download the maps on TMX : tmnf.exchange/tracksearch?query=author%3a+yoshtm

Why it's here

1 person recommends this

What people say. Recommended as an amazing and practical explanation of how reinforcement learning works in a real-world gaming environment.

smokelon Hacker News • Recommends

On “The History of Machine Learning in Trackmania”

For those who only read the comments, be sure to check out the videos by Yosh. They're amazing, and do a great job explaining how reinforcement learning works in practice: link to this video link

emporason Hacker News • Mentions

On “Chess-GPT's Internal World Model”

…See for example this training experiment for Trackmania 1. There are techniques that the ML algorithm will *never* figure out by itself if this information is not encoded in it's training data. The point still stands. PGN notation certainly is not a good format if the goal (or one of the goals) of the experiment is to be a good chess player. 1 link to this video…

fragmedeon Hacker News • Mentions

On “OmniParser for Pure Vision Based GUI Agent”

Depends what you consider fun, and how far you take it. Some people enjoy programming more than repetitive clicking in a GUI. For a clicker game, writing a bot lets you iterate on strategies easier - is it faster to get to level 2 if I buy the upgrade for A or B first? For Trackmania, it lets you get a world record and a YouTube video with 14M views. link to this video

szvswon Hacker News • Mentions

On “AI-designed chips are so weird that 'humans cannot understand them'”

There’s a few very cool examples where someone recently used RL to solve trackmania, and ends up having to add all sorts of constraints/penalties to prevent extremely strange exploits/glitches that are discovered IIRC… been a while since I watched. link to this video link