Skip to content
Hallway
0:00 / 0:00

#linear#syncengine#local-first

Scaling the Linear Sync Engine

Linear

15K subscribers • 1 video on Hallway

YouTube
  • Recommended by 3 people: 2 on Hacker News and 1 in engineering communities.
  • Presented by Karri, engineer at Linear
  • Made by the vendor. The company whose product it covers made or sponsored it.

Advanced. Deep dive for people who know the field.

36K views3 years ago3 recommendations

Distributed systemsWeb developmentKafka and stream processingScaling and large-scale architectureSoftware architecture

An in-depth look at how Linear designed and scaled its local-first synchronization engine to handle large organizations and massive datasets.

Sign up to Linear to see the sync engine in action: linear.app We are hiring: linear.app/careers Watch the previous talk here: youtube.com/live/WxK11RsLqp4?feature=share&t=2175

Why it's here

3 people recommend this

What people say. Highly recommended as a premier resource on building and scaling local-first sync engines and collaborative application architectures.

YousefEDon Hacker News • Recommends

On “Local-first software: You own your data, in spite of the cloud (2019)”

…you've modeled and implemented the data-layer (which does require you to rethink / unlearn a few principles), you don't need to worry about data-fetching, errors etc. as much as in a regular "API-based" app. Another interesting video I recommend on this topic is about Linear's "Sync Engine" which employs some of the local-first techniques as well: link to this video…
View on Hacker News

saqadrion Hacker News • Recommends

On “You don't need a CRDT to build a collaborative experience”

You may not need CRDT per-se, but building a collaborative experience is so difficult. I worked on collaborative systems for a bit, and also have read a bit about how Figma and Notion do it (this is a good read: link ) -- it's still super hard to get right. This talk by Karri about Linear's "sync engine" is also a good watch: link to this video .
View on Hacker News

u/gapmunkyin r/softwarearchitecture • Recommends

How Linear scaled their sync engine
1View on Reddit

notamyon Hacker News • Mentions

On “Scaling Linear's Sync Engine”

Heads-up: This is a video ( link to this video ) embedded in a blog post; there doesn't seem to be an accompanying text-only version.
View on Hacker News

dgroshevon Hacker News • Mentions

On “Local First, Forever”

(this should probably be a post) CRDTs and local first are ideas that is perpetually in the hype cycle for the last decade or so, starting around the time Riak CRDTs became a thing and continuing all the way to today. Niki's post is a perfect illustration: CRDTs offer this "magical" experience that seems perfectly good until you try building a product with them. Then it becomes a nightmare of tradeoffs: - state-based or operation-based? do you trim state? how? - is it truly a CRDT (no conflicts possible), a structure with explicit conflict detection, or last-writer-wins/arbitrary choice in a trench coat that will always lose data? Case in point: Automerge uses pseudo-random conflict resoluti…
View on Hacker News

probabletrainon Hacker News • Mentions

On “Sync Engines Are the Future”

> Previous sync engines really want you to sync all data Linear had to do all sorts of shenanigans to be able to sync all data, for orgs with lots of it – there's a talk on that here: link to this video
View on Hacker News

u/kokjinsamin r/elixir • Mentions

On “Using Elixir Phoenix with offline first app”

I was just tinkering on an offline/local-first app a few weeks ago. This biggest issue with using LiveView as the rendering layer was that I had to do a lot of client-side caching in order to make the offline portion work because markups were generated on the server-side. Then I had to use a client-side framework (React in my case) to patch the DOMs with data updates. All in all, I don't think it's worth the effort to use LiveView for a local-first app. BUT, LiveState (aka LiveView for JSON) is very suitable for building a sync engine. https://github.com/launchscout/live\_state Sync Engine references: [video [video
1View on Reddit