Skip to content
0:00 / 0:00

#uber#microservices#distributedsystems

What I Wish I Had Known Before Scaling Uber to 1000 Services • Matt Ranney • GOTO 2016

GOTO Conferences

1M subscribers • 87 videos on Hallway • Conference channel

YouTube
  • Recommended by 4 people: 3 on Hacker News and 1 on Lobsters.
  • Presented by Matt Ranney, Chief Systems Architect at Uber

Intermediate. Assumes working knowledge.

333K views10 years ago4 recommendations

Distributed systemsSoftware designMicroservices and monolithsSoftware architectureScaling and large-scale architecture

Matt Ranney shares the architectural and organizational lessons Uber learned while scaling to over one thousand production microservices.

This presentation was recorded at GOTO Chicago 2016. #gotocon #gotochgo gotochgo.com Matt Ranney - Chief Systems Architect at Uber, Co-founder of Voxer ABSTRACT To Keep up with Uber's growth, we've embraced microservices in a big way. This has led to an explosion of new services, crossing over 1,000 production services in early March 2016. Along the way we've learned a lot, and if we had to do it all over again [...] Download slides and read the full abstract here: gotocon.com/chicago-2016/presentation/What%20I%20Wish%20I%20… RECOMMENDED BOOKS Sam Newman • Monolith to Microservices • amzn.to/2Nml96E Sam Newman • Building Microservices • amzn.to/3dMPbOs Ronnie Mitra & Irakli Nadareishvili • Microservices: Up and Running• amzn.to/3c4HmmL Mitra, Nadareishvili, McLarty & Amundsen • Microservice Architecture • amzn.to/3fVNAb0 Chris Richardson • Microservices Patterns • amzn.to/2SOnQ7h Adam Bellemare • Building Event-Driven Microservices • amzn.to/3yoa7TZ Dave Farley • Continuous Delivery Pipelines • amzn.to/3hjiE51 twitter.com/GOTOcon linkedin.com/company/goto- instagram.com/goto_con facebook.com/GOTOConferences #Microservices #ScalingSoftware #scaling #MattRanney CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at gotopia.tech Sign up for updates and specials at gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. youtube.com/user/GotoConferences/?sub_confirmation=1

Why it's here

4 people recommend this, 1 disputes it

What people say. Recommended as an honest and open retrospective on the challenges, regrets, and organizational effects of scaling microservices at Uber.

smclon Hacker News • Recommends

On “Why's that company so big? I could do that in a weekend”

Joking aside I enjoyed that video ( link to this video - for those who didn't see it), the presenter was pretty honest and way more open than I expected. I'm just so curious how those services break down - if it's genuinely on the "lstrip as a service" level or whatever, whether that's "1,000 services" figure was actually a relatively simple API with 10 versions at various levels of deprecation, whether he meant it was 1,000 different service endpoints (250 services each with POST, GET, PUT, DELETE) or what. I want to know more basically :)

kartDon Hacker News • Recommends

On “Ask HN: Recommended (recent) videos for a Lunch and Learn”

Little drunk so bear with me :) Rich Hickey: Clojure concurrency[link ] Keynote - Rust: confident, productive systems programming by Aaron Turon [link ] RustConf 2016 - A Modern Editor Built in Rust by Raph Levien [link ] Microservices at Netflix Scale: Principles, Tradeoffs & Lessons Learned[link ] What I Wish I Had Known Before Scaling Uber to 1000 Services[video ] Dynamic Code Optimization and the NVIDIA Denver Processor [link ] * if you can get anything on Apple's Ax series that's even better

jppopeon Hacker News • Recommends

On “Ask HN: What are the things keep in mind while giving/preparing for a tech talk?”

…have a tendency to want to show off the size of their intellect, and the level their competency- having a speech be entertaining is way way more important. 7) DO NOT READ FROM YOUR SLIDES. know your shit. slides are supplementary Extra Credit. Here's a collection of some fantastic technical speeches: * link * link * link * link * link * link to this video…

tallgeoffon Lobsters • Recommends

GOTO 2016 • What I Wish I Had Known Before Scaling Uber to 1000 Services • Matt Ranney

developer2on Hacker News • Disputes

On “Why's that company so big? I could do that in a weekend”

You're going to talk about Uber? Watch this video: 1. He talks about every regret regarding their infrastructure. At first you kind of nod your head along with "yeah, it's not that easy", but as he keeps talking you can't help but wonder why the company has absolutely no internal technical direction whatsoever . They employ over 2000 engineers (just devs, excluding support staff, etc.). They use micro-services designed to the point where teams can't reuse pre-existing services. They are rewriting the same functionality over and over, and over and over again, as separate teams don't even have a clue what has already been written. Pick a piece of functionality you need. There are straight up…

securingsincityon Hacker News • Mentions

On “Uber launches 'urgent investigation' into sexual harassment claims”

…ding services that are duplicative. The goal of which is to show value and get promoted. Given the blog, the communication and reporting structure is also broken. Which, results in >1000 services in production and it being unclear how many there are and what they all do. Most likely, this is how the teams are structured as well. 1 - link 2 - link to this video…

itsmenotyouon Hacker News • Mentions

On “On the Moral Economy of Tech (2016)”

I think as technologists we have a natural preference for clean technological solutions that don't involve politics or messy interpersonal relationship issues. Failing to confront that whole human sphere of life leads to negative consequences everywhere, and the talk does a great job of pointing out some of the macro social effects. On a similar note but a more localized scale I'm reminded of this talk on one of the downsides of moving to microservices being that people can avoid difficult conversations link to this video

tzhenghaoon Hacker News • Mentions

On “Why Google Stores Billions of Lines of Code in a Single Repository (2016)”

Having worked at different companies adopting both monorepo and the multiple repos approach, I find monorepo a better normalizer at scale in consolidating all "software" that runs the company. Just like what many commenters here have mentioned, the monorepo approach is a forcing function on keeping compatibility issues at bay. What you don't want is to end up in a situation where teams reinvent their own wheels instead of building on top of existing code, and at scale, I think the multiple repo approach tends to breed such codebase smell. 1 I'm sure 8000 repos is living hell for most organizations. 1 - link to this video

djsumdogon Hacker News • Mentions

On “Microservices Considered Harmful (2019)”

At a goto; talk, an Uber engineer said they had so many microservices it was impossible to really count how many they had: link to this video

belteron Hacker News • Mentions

On “Uber migrates microservices to multi-cloud platform running Kubernetes and Mesos”

Apparently they started at 1000 and went from there... "What I Wish I Had Known Before Scaling Uber to 1000 Services" - link to this video