Skip to content
0:00 / 0:00

#linear#syncengine#local-first

Scaling the Linear Sync Engine

Linear

15K subscribers • 1 video on Hallway

YouTube
  • Recommended by 3 people: 2 on Hacker News and 1 in engineering communities.
  • Presented by Karri, engineer at Linear
  • Made by the vendor. The company whose product it covers made or sponsored it.

Advanced. Deep dive for people who know the field.

36K views3 years ago3 recommendations

Distributed systemsWeb developmentKafka and stream processingScaling and large-scale architectureSoftware architecture

An in-depth look at how Linear designed and scaled its local-first synchronization engine to handle large organizations and massive datasets.

Sign up to Linear to see the sync engine in action: linear.app We are hiring: linear.app/careers Watch the previous talk here: youtube.com/live/WxK11RsLqp4?feature=share&t=2175

Why it's here

3 people recommend this

What people say. Highly recommended as a premier resource on building and scaling local-first sync engines and collaborative application architectures.

YousefEDon Hacker News • Recommends

On “Local-first software: You own your data, in spite of the cloud (2019)”

…you've modeled and implemented the data-layer (which does require you to rethink / unlearn a few principles), you don't need to worry about data-fetching, errors etc. as much as in a regular "API-based" app. Another interesting video I recommend on this topic is about Linear's "Sync Engine" which employs some of the local-first techniques as well: link to this video…

saqadrion Hacker News • Recommends

On “You don't need a CRDT to build a collaborative experience”

You may not need CRDT per-se, but building a collaborative experience is so difficult. I worked on collaborative systems for a bit, and also have read a bit about how Figma and Notion do it (this is a good read: link ) -- it's still super hard to get right. This talk by Karri about Linear's "sync engine" is also a good watch: link to this video .

u/gapmunkyin r/softwarearchitecture • Recommends

How Linear scaled their sync engine

notamyon Hacker News • Mentions

On “Scaling Linear's Sync Engine”

Heads-up: This is a video ( link to this video ) embedded in a blog post; there doesn't seem to be an accompanying text-only version.

dgroshevon Hacker News • Mentions

On “Local First, Forever”

(this should probably be a post) CRDTs and local first are ideas that is perpetually in the hype cycle for the last decade or so, starting around the time Riak CRDTs became a thing and continuing all the way to today. Niki's post is a perfect illustration: CRDTs offer this "magical" experience that seems perfectly good until you try building a product with them. Then it becomes a nightmare of tradeoffs: - state-based or operation-based? do you trim state? how? - is it truly a CRDT (no conflicts possible), a structure with explicit conflict detection, or last-writer-wins/arbitrary choice in a trench coat that will always lose data? Case in point: Automerge uses pseudo-random conflict resoluti…

probabletrainon Hacker News • Mentions

On “Sync Engines Are the Future”

> Previous sync engines really want you to sync all data Linear had to do all sorts of shenanigans to be able to sync all data, for orgs with lots of it – there's a talk on that here: link to this video