Skip to content
Hallway
0:00 / 0:00

#twitter#notifications#fanout

Real-Time & Personalized Notifications @Twitter

InfoQ

234K subscribers • 64 videos on Hallway • Conference channel

YouTube
  • Recommended by 2 people: 2 in engineering communities.

Advanced. Deep dive for people who know the field.

20K views9 years ago2 recommendations

Distributed systemsSoftware designSoftware architectureScaling and large-scale architectureEvent-driven systems and messaging

Gary Lam and Saurabh Pathak explain Twitter's hybrid push/pull notification architecture, covering aggregation, filtering, and large-graph fanout.

Gary Lam and Saurabh Pathak talk about the hybrid push/pull-based architecture adopted by Twitter Notification platform and how they perform aggregation & filtering, fanout for very large graphs, empower relevance, and enable experimentation. Download the slides & audio at InfoQ: bit.ly/2wcyc0B This presentation was recorded at QCon London 2017.

Why it's here

2 people recommend this

What people say. Recommended for understanding how Twitter efficiently handles notification delivery and fanout for users with millions of followers.

u/Arik1313in r/softwarearchitecture • Recommends

On “In social sites - when we want to send notifications for a 1000+ followers - how to get them efficiently?”

…the users. Imagine Beyonce tweets, i hardly think going over 20m users than filtering them out would hold the scale. Even if I have just thousand active users with thousands followers. Even if it's less than 100ms per query, it seems inefficient to join 2 tablesw moreover - it can't be done as they exist in 2 different databases (microservices) link to this video Twitter as seen here prepares a materialized view of top followers and top keywords per user, and saves it in memory (i just don't understand if they loop all users first, and not having a prepared filtered list). https://sns.cs.princeton.edu/assets/papers/2010-sigmod-silberstein.pdf This paper talks about materializing a timeline for he…
1View on Reddit

u/buddh4rin r/softwarearchitecture • Recommends

On “Twitter Architecture Diagram of their Read Path”

Here are some old talks (6 years old) about the twitter read/wrtie path and notifications. link to this video link to this video
1View on Reddit