Skip to content
Hallway
0:00 / 0:00

#aisafety#alignment#instrumentalconvergence

Intro to AI Safety, Remastered

Robert Miles AI Safety

174K subscribers • 9 videos on Hallway

YouTube
  • Recommended by 6 people: 6 on Hacker News.
  • Presented by Robert Miles

Beginner. No background in the topic needed.

209K views5 years ago6 recommendations

AI and machine learningAI safety and impactTransformers and LLMs

Robert Miles provides a comprehensive introduction to AI safety, explaining why advanced AI systems pose risks and how alignment works.

An introduction to AI Safety, remastered from a talk I gave at "AI and Politics" in London The second channel: youtube.com/channel/UC4qH2AHly_RSRze1bUqSSNw Experts' Predictions about the Future of AI: youtu.be/HOJ1NVtlnyQ 9 Examples of Specification Gaming: youtu.be/nKJlF-olKmg patreon.com/robertskmiles With thanks to my wonderful Patreon supporters: Gladamas Timothy Lillicrap Kieryn AxisAngles James Nestor Politics Scott Worley James Kirkland James E. Petts Chad Jones Shevis Johnson JJ Hepboin Pedro A Ortega Said Polat Chris Canal Jake Ehrlich Kellen lask Francisco Tolmasky Michael Andregg David Reid Peter Rolf Teague Lasser Andrew Blackledge Frank Marsman Brad Brookshire Cam MacFarlane Craig Mederios Jon Wright CaptObvious Brian Lonergan Jason Hise Phil Moyer Erik de Bruijn Alec Johnson Clemens Arbesser Ludwig Schubert Eric James Matheson Bayley Qeith Wreid jugettje dutchking Owen Campbell-Moore Atzin Espino-Murnane Johnny Vaughan Carsten Milkau Jacob Van Buren Jonatan R Ingvi Gautsson Michael Greve Tom O'Connor Laura Olds Jon Halliday Paul Hobbs Jeroen De Dauw Cooper Lawton Tim Neilson Eric Scammell Igor Keller Ben Glanton Tor Barstad Duncan Orr Will Glynn Tyler Herrmann Ian Munro Joshua Davis Jérôme Beaulieu Nathan Fish Peter Hozák Taras Bobrovytsky Jeremy Vaskó Richárd Benjamin Watkin Andrew Harcourt Luc Ritchie Nicholas Guyett James Hinchcliffe 12tone Oliver Habryka Chris Beacham Zachary Gidwitz Nikita Kiriy Andrew Schreiber Steve Trambert Braden Tisdale Abigail Novick Serge Var Mink Chris Rimmer Edmund Fokschaner J Nate Gardner John Aslanides Mara ErikBln DragonSheep Richard Newcombe Joshua Michel Alex Altair P David Morgan Fionn Dmitri Afanasjev Marcel Ward Andrew Weir Kabs Ammar Mousali Miłosz Wierzbicki Tendayi Mawushe Jake Fish Wr4thon Martin Ottosen Robert Hildebrandt Andy Kobre Kees Darko Sperac Robert Valdimarsson loopuleasa Marco Tiraboschi Michael Kuhinica Fraser Cain Klemen Slavic Patrick Henderson Oct todo22 Melisa Kostrzewski Hendrik Daniel Munter Alex Knauth Kasper Ian Reyes James Fowkes Tom Sayer Len Alan Bandurka Ben H Simon Pilkington Daniel Kokotajlo Yuchong Li Diagon Andreas Blomqvist Bertalan Bodor Qwijibo (James) Zubin Madon Zannheim Daniel Eickhardt lyon549 14zRobot Ivan Jason Cherry Igor (Kerogi) Kostenko ib_ Thomas Dingemanse Stuart Alldritt Alexander Brown Devon Bernard Ted Stokes Jesper Andersson DeepFriedJif Chris Dinant Raphaël Lévy Johannes Walter Matt Stanton Garrett Maring Anthony Chiu Ghaith Tarawneh Julian Schulz Stellated Hexahedron Caleb Scott Viteri Clay Upton Conor Comiconor Michael Roeschter Georg Grass Isak Renström Matthias Hölzl Jim Renney Edison Franklin Piers Calderwood Mikhail Tikhomirov Matt Brauer Jaeson Booker Mateusz Krzaczek Artem Honcharov Michael Walters Tomasz Gliniecki Mihaly Barasz Mark Woodward Ranzear Neil Palmere Rajeen Nabid Christian Epple Clark Schaefer Olivier Coutu Iestyn bleasdale-shepherd MojoExMachina Marek Belski L

Why it's here

6 people recommend this

What people say. Highly recommended as one of the clearest and most accessible introductions to AI safety and alignment concepts.

Moments people linked to

durbleflorpon Hacker News • Recommends

On “We could stumble into AI catastrophe”

…stential threat you don't need a high probability to take them seriously. I also happen to think that if you watch all the material he makes a compelling argument that the odds of something going wrong are fairly high unless we start approaching AI research (and particularly safety and ethical concerns) drastically differently than we are now. 1 link to this video…
View on Hacker News

WhitneyLandon Hacker News • Recommends

On “Beyond Hyperanthropomorphism”

Venkatesh’s argument is so poor it comes close to “not even wrong” territory. He doesn’t really cite any specific people or literature to disagree with, and instead makes only vague references to the “non-sense” of others. The most significant concerns around AI safety are not discussed nor even mentioned leading it to read almost as if he has no expertise whatsoever in this field, and indeed that seems to be the case. No need for an appeal to authority though - just taking a little time to hear the actual concerns and opinions on topic would be welcome. Great intro to the subject here, I wonder what his response would be? link to this video
View on Hacker News

casebashon Hacker News • Recommends

On “Show HN: Help, I let GPTChat control my computer”

Is there any chance you could add some links to AI Safety Resources such as Joe Carlsmith's Power Seeking AI ( link ) or Rob Miles Introduction to AI Safety ( link to this video )? Perhaps you could link to a resource on the AI box experiment as well? I know you vaguely gesture at it, but would likely be better to explicitly link people to resources if they haven't heard of it themselves.
View on Hacker News

Veedracon Hacker News • Recommends

On “Statement on AI Risk”

…ow to make AI systems encode any complex preference robustly. Robert Miles' videos are among the best presented arguments about specific points in this list, primary on the alignment side rather than the capabilities side, that I have seen for casual introduction. Eg. this one on instrumental convergence: link Eg. this introduction to the topic: link to this video He also has the community-led AI Safety FAQ, link , which gives brief answers to common questions. If you have specific questions I might be able to point to a more specific argument at a higher level of depth.…
View on Hacker News

lambertsimnelon Hacker News • Recommends

On “Statement on AI Risk”

I recommend Robert Miles's YouTube channel, and his "Intro to AI Safety, Remastered" is a good place to start: link to this video I find Robert Miles worryingly plausible when he says (about 12:40 into the video) "if you have a sufficiently powerful agent and you manage to come up with a really good objective function, which covers the top 20 things that humans value, the 21st thing that humans value is probably gone forever"
View on Hacker News

albumenon Hacker News • Recommends

On “Many scientists don’t want to tell the truth about climate change. Here’s why”

If only. There's a lot of space in between "our morality" (please do define that) and "what we want to be" where AGI can royally screw us. Check out Robert Miles on AI safety, here's a good intro: link to this video
View on Hacker News

u/SirLichin r/compsci • Mentions

On “Programming/computer science stories with real-world consequences?”

Hmm. We did a few case studies, I will try to recall a few. We learned about the Toyota acceleration bit-flip (which apparently has been debunked?) --- Additionally, we talked about safety topics related to software, including how to prevent incidents, redundancy, reporting, test-driven-development, etc. Some of the topics we covered in this broad discussion was: Flight safety, space safety (more radiation requires more redundancy). We learned how much value the U.S. Government puts on the human life.. We spoke about AI Safety. We spoke about proving correctness of our algorithms. Lots more. It was a fun, two credit class.
8View on Reddit

mitthrowaway2on Hacker News • Mentions

On “OpenAI chief goes before US Congress to propose licenses for building AI”

Take your pick? link link link to this video link link I could keep going but the reading on this spans for tens of thousands of pages of detailed reasoning and analysis, including mathematical proofs and lab-scale experiments.
View on Hacker News

u/sadhukarin r/compsci • Mentions

On “Is General Intelligence really possible in the next 50 years?”

I'm curious then why so many AI experts think it's possible within the next 50 years, assigning 50% probabilities to them? In this video, there are some experts who seem to think we'll reach general intelligence in *25 years*
1View on Reddit

u/richardathomein r/compsci • Mentions

On “Should we be worried about ai?”

…h brings me to my next point: We don't know how to stop a General AI doing whatever it needs to fulfil it's task, other than pulling the plug. And a general AI will have already thought of that outcome... Robert Miles has done a series of excellent videos on the current state of AI safety and the kinds of problems were are anticipating... [video…
1View on Reddit