Skip to content
0:00 / 0:00

#migrations#doordash#dualwrite

Migrations - The Hardest Actual Problem in Computer Science • Matt Ranney • YOW! 2022

GOTO Conferences

1M subscribers • 96 videos on Hallway • Conference channel

YouTube
  • Recommended by 1 person: 1 in engineering communities.
  • Presented by Matt Ranney

Advanced. Deep dive for people who know the field.

41K views3 years ago1 recommendation

Distributed systemsDatabases and dataDatabase internalsScaling and large-scale architectureSoftware architecture

Matt Ranney shares strategies and lessons learned from executing complex, zero-downtime system and database migrations at DoorDash.

This presentation was recorded at YOW! 2022. #GOTOcon #YOW yowcon.com Matt Ranney - Principal Engineer at #DoorDash RESOURCES twitter.com/mranney linkedin.com/in/mranney ABSTRACT #Migrations sound boring and hard. If you do them wrong, migrations can cause outages, data corruption, and slow down your whole engineering team. But how can you do them right? In this talk, I'll share some learnings from working on different migrations over the years and offer some ideas for how to avoid as much pain as possible. [...] TIMECODES Introduction Why Are Migrations Hard? DoorDash Migration Example Making Changes to Always-On Systems This Sounds Bad Database "Dual Write" Surprising Third Option What Did DD Do? Ways to Make Migrations Easier Good Abstractions Why Is It REALLY So Hard? Download slides and read the full abstract here: yowcon.com/sydney-2022/sessions/2373 RECOMMENDED BOOKS Simon Brown • Software Architecture for Developers Vol. 2 • leanpub.com/visualising-software-architecture David Farley • Modern Software Engineering • amzn.to/3GI468M Dave Farley & Jez Humble • Continuous Delivery • amzn.to/3ocIHwd Woods, Erder & Pureur • Continuous Architecture in Practice • amzn.to/2QWAmkl George Fairbanks • Just Enough Software Architecture • amzn.to/3uZzVo0 twitter.com/GOTOcon linkedin.com/company/goto- instagram.com/goto_con facebook.com/GOTOConferences #MattRanney #SoftwareEngineering #Programming #SoftwareDevelopment #YOWcon CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at gotopia.tech Sign up for updates and specials at gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. youtube.com/user/GotoConferences/?sub_confirmation=1

Why it's here

1 person recommends this

What people say. Recommended as a cautionary and insightful talk on the immense difficulties of rewriting and migrating large-scale systems.

u/Asyncrosaurusin r/dotnet • Recommends

On “What should I watch out for when migrating a large Rails app to .NET?”

I'd be pretty weary of following most advice in this sub, there's a lot of Microsoft-only acolytes and devs who've worked for 10 years, but have only had 2 years of experience 5 times. Especially when they're all cheerleading you going full steam on a bad decision. Because when I hear, "I want to re-write my site", followed up with "and I have ~4000 active users", the only logical advice is *don't do it*. The engineering effort to migrate a live site is astronomical, and you'll still deal with various fuck ups. Having gone through a few migrations now (even one from WebForms to MVC where we kept all the dlls and database), it is never easy or pretty and alwalys impacts some users. You reall…