Skip to content
0:00 / 0:00

#aisafety#alignment#concreteproblemsinaisafety

Avoiding Negative Side Effects: Concrete Problems in AI Safety part 1

Robert Miles AI Safety

174K subscribers • 9 videos on Hallway

YouTube
  • Recommended by 2 people: 2 on Hacker News.
  • A classic. People kept recommending it from 2018 to 2023.
  • Presented by Robert Miles, AI safety communicator
  • Linked in the descriptionarXiv 1606.06565
  • May be out of date. Uploaded 9 years ago, in an area where tools change fast.

Beginner. No background in the topic needed.

160K views9 years ago2 recommendations

AI and machine learningAI safety and impact

Robert Miles explains how AI systems can cause accidental negative side effects and introduces the paper Concrete Problems in AI Safety.

We can expect AI systems to accidentally create serious negative side effects - how can we avoid that? The first of several videos about the paper "Concrete Problems in AI Safety". Earlier on Computerphile: youtube.com/watch?v=AjyM-f8rDpg The Stop Button Problem: youtu.be/3TYT1QfdfsM Read the full paper here: arxiv.org/abs/1606.06565 Thanks again to all my wonderful Patreon Supporters: - Chad Jones - Ichiro Dohi - Stefan Skiles - Katie Byrne - Ziyang Liu - Joshua Richardson - Fabian Consiglio - Jonatan R - Øystein Flygt - Björn Mosten - Michael Greve - robertvanduursen - The Guru Of Vision - Fabrizio Pisani - Alexander Hartvig Nielsen - Volodymyr - Peggy Youell - Konstantin Shabashov - Adam Dodd - DGJono - Matthias Meger - Scott Stevens - Emilio Alvarez - Benjamin Aaron Degenhart - Michael Ore - Robert Bridges - Dmitri Afanasjev patreon.com/robertskmiles

Why it's here

2 people recommend this

What people say. Highly recommended as an accessible starting point for understanding the challenges of AI alignment and safety.

jononoron Hacker News • Recommends

On “Not worried about AI that passes Turing test, but AI that fails it on purpose”

For those curious about AI safety I heavily recommend Robert Miles channel on YouTube. He has lot of good content describing out the challenges we face when trying to create safe AI. Here is one potential starting point: link to this video

nmcaon Hacker News • Recommends

On “Uber Self-Driving Car That Struck Pedestrian Wasn’t Set to Stop in an Emergency”

This highlights an interesting general point - in many situations, there is no simple safe fallback policy. On a highway, an emergency stop is not safe. This is a general problem in AI safety and is covered nicely in this youtube video, as well as the paper referenced there - link to this video

pason Hacker News • Mentions

On “Superintelligence: The Idea That Eats Smart People (2016)”

Re: alignment, see the "Where are we" part of this talk: link See also the AI safety problems for concrete problems that people are currently working on - as in with code and real simulations, not "just" math and thinking: link to this video Re: scaling up. That's called intelligence explosion, there are a lot of write ups about it, but the gist of it is just that by simply increasing working memory size, thinking speed, prediction precision, pattern matching, and so on, you get to unimaginably high levels. Furthermore, if you can make a human level AI, it naturally follows that it's only a matter of time to make it slightly better. At first simply faster, simply more eloquent, a bit more emotional d…