Skip to content
Hallway
0:00 / 0:00

#crdt#automerge#martinkleppmann

CRDTs and the Quest for Distributed Consistency

InfoQ

234K subscribers • 64 videos on Hallway • Conference channel

YouTube
  • Recommended by 4 people: 3 on Hacker News and 1 curated list.
  • Presented by Martin Kleppmann, researcher and author

Intermediate. Assumes working knowledge.

68K views8 years ago4 recommendations

Distributed systemsDatabases and dataConsensus: Raft and PaxosReplication and consistencyData structures

Martin Kleppmann explores how conflict-free replicated data types (CRDTs) enable data consistency and collaborative editing in distributed, peer-to-peer systems.

Download the slides & audio at InfoQ: bit.ly/2P1IGJe Martin Kleppmann explores how to ensure data consistency in distributed systems, especially in systems that don't have an authoritative leader. He explains how to sync data between a phone and a laptop without sending it via a remote server. He also explores algorithms that allow several people to collaborate on a shared document, communicating via a peer-to-peer network. This presentation was recorded at QCon London 2018: bit.ly/2hxsoN1 #SoftwareArchitecture #DistributedSystems #CRDT #Consistency #InfoQ #QCon #QConLondon

Why it's here

4 people recommend this

What people say. Highly recommended as an excellent, accessible introduction to CRDTs and the challenges of distributed consistency.

Moments people linked to

hardwaresoftonon Hacker News • Recommends

On “Lessons learned from creating a real-time collaborative rich-text editor”

Recently saw a fantastic intermediate talk on this subject called CRDTs and the Quest for Distributed Consistency0. One product of the research was automerge1, a library for handling collaborative editing of JSON-like data models 0: link to this video 1: link
View on Hacker News

raphlinuson Hacker News • Recommends

On “Creating a Collaborative Editor”

I think the original statement is defensible. Many of the original OT papers proposed algorithms that have since been shown not to converge in particular cases (especially the TP2 puzzle). It took a while for the fog to clear, in part because TP2 requires concurrent edits from 3 peers. I also highly recommend the talk "CRDTs and the Quest for Distributed Consistency"0 from Martin Kleppmann, which I believe surveys the landscape in as clear and accessible a manner as I've seen; much of the literature is pretty dense. 0: link to this video
View on Hacker News

syspecon Hacker News • Recommends

On “Summary: Designing Data-Intensive Applications by Martin Kleppmann”

Recently going through this book. I highly recommend it, and any videos by the author, Martin Kleppmann I especially like this one: > CRDTs and the quest for distributed consistency link to this video
View on Hacker News

awesome-distributed-systemscurated list on GitHubRecommends

Under “Distributed Consensus and Fault-Tolerance”

Conflict-free Replicated Data Types presents an approach for Strong Eventual Consistency which as been applied in projects such as Riak, Redis and Akka. A great talk on the subject by Martin Kleppmann can be found here
View the list

Joeon Stack Overflow • Mentions

On “Differences between OT and CRDT”

One another notable difference is that: OT requires a central server for co-ordination. CRDT can adopt any network topology like P2P over WebRTC and it is resilient to network partitions, which makes it decentralized. Reference: link to this video by Martin Kleppmann, author of "Designing Data-Intensive Applications".
15View the answer