marknadalon Hacker News • Recommends
On “Distributed algorithms in NoSQL databases”
#crdt#operationaltransformation#automerge
1M subscribers • 96 videos on Hallway • Conference channel
Intermediate. Assumes working knowledge.
46K views9 years ago3 recommendations
Distributed systemsDatabases and dataConcurrency and parallelismConsensus: Raft and PaxosReplication and consistency
Martin Kleppmann explains how collaborative editors and distributed databases handle concurrent updates using operational transformation and CRDTs.
This presentation was recorded at GOTO Berlin 2016 gotober.com Martin Kleppmann - Researcher at University of Cambridge @kleppmann ABSTRACT What do collaborative editors like Google Docs, the calendar app on your phone, and multi-datacenter database clusters have in common? Answer: They all need to cope with network interruptions, and still work offline. They all allow state to be updated concurrently in several different places, and asynchronously propagate changes to other nodes. If data is concurrently changed on different nodes, you get conflicts that need to be resolved. There are different approaches to handling those conflicts: some systems let the user manually resolve them; some systems choose one version as the winner and throw away the other versions; and some systems try to merge concurrent updates automatically. For example, Google Docs uses an algorithm called Operational Transform (OT) to perform this merge, while Riak uses Conflict-Free Replicated Datatypes (CRDTs) to achieve a similar thing. In this talk we will explore these algorithms for automatic merging. They start out quite simple, but as we shall see, they soon become fascinatingly mind-bending once you start trying to do more ambitious things. For example, if you wanted to write your own spreadsheet app or graphics software that allows several users to edit the same document concurrently, how would you go about doing that? [...] Download slides and read the full abstract here: gotocon.com/berlin-2016/presentations/show_talk.jsp?oid=7910 RECOMMENDED BOOKS Martin Kleppmann • Designing Data-Intensive Applications • amzn.to/3mk2Roj Martin Kleppmann • Secret Colors: A Gentle Introduction to Cryptography • amzn.to/3PgAcyj twitter.com/GOTOcon linkedin.com/company/goto- instagram.com/goto_con facebook.com/GOTOConferences #EventualConsistency #MartinKleppmann CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at gotopia.tech Sign up for updates and specials at gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. youtube.com/user/GotoConferences/?sub_confirmation=1What people say. Highly recommended as an exceptionally clear and engaging introduction to CRDTs and conflict resolution in distributed systems.
marknadalon Hacker News • Recommends
On “Distributed algorithms in NoSQL databases”
marknadalon Hacker News • Recommends
On “Automerge: JSON-like data structure for building collaborative apps”
lachenmayeron Hacker News • Recommends
On “Applied Monotonicity: A Brief History of CRDTs in Riak”
marknadalon Hacker News • Recommends
On “Applied Monotonicity: A Brief History of CRDTs in Riak”
lewisl9029on Hacker News • Recommends
On “Why CRDT didn't work out as well for collaborative editing xi-editor”
marknadalon Hacker News • Recommends
On “Show HN: Graphite – A decentralized and encrypted Google Docs alternative”
marknadalon Hacker News • Recommends
On “Differential Synchronization (2009)”
marknadalon Hacker News • Recommends
On “Resistant protocols: How decentralization evolves”
marknadalon Hacker News • Recommends
On “Local-first software: You own your data, in spite of the cloud”
marknadalon Hacker News • Recommends
On “Open source collaborative text editors”
marknadalon Hacker News • Recommends
On “OT and CRDT trade-offs for Real-Time collaboration”
z3t4on Hacker News • Mentions
On “Show HN: Airborn – Private Google Docs Alternative”
marknadalon Hacker News • Mentions
On “PeerPad – A realtime P2P collaborative editing tool powered by IPFS”