appwizon Hacker News • Recommends
On “Learning to Build Distributed Systems”
Here are a couple videos from reInvent 2018: Jaso talking about DynamoDB internals link to this video Marc talking about Lambda internals link
0:00 / 0:00
AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Amazon Web Services
849K subscribers • 14 videos on Hallway
- Recommended by 2 people: 2 on Hacker News.
- Made by the vendor. The company whose product it covers made or sponsored it.
Advanced. Deep dive for people who know the field.
111K views7 years ago2 recommendations
Databases and dataDistributed systemsDatabase internalsNoSQL and document databasesScaling and large-scale architecture
This AWS re:Invent talk reveals the internal architecture of Amazon DynamoDB, explaining how it handles authentication, metadata, storage, and global replication.
Come to this session to learn how Amazon DynamoDB was built as the hyper-scale database for internet-scale applications. In January 2012, Amazon launched DynamoDB, a cloud-based NoSQL database service designed from the ground up to support extreme scale, with the security, availability, performance, and manageability needed to run mission-critical workloads. This session discloses for the first time the underpinnings of DynamoDB, and how we run a fully managed nonrelational database used by more than 100,000 customers. We cover the underlying technical aspects of how an application works with DynamoDB for authentication, metadata, storage nodes, streams, backup, and global replication.Why it's here
2 people recommend thisWhat people say. Highly recommended by engineers as a rare and detailed deep dive into the actual distributed systems architecture powering DynamoDB.
mjbon Hacker News • Recommends
On “DynamoDB 10 years later”
We don't have a paper on DynamoDB's internals (yet?), but here's a talk you might find interesting from one of the folks who built and ran DDB for a long time: link to this video And Doug Terry talking through the details of how DynamoDB's transaction protocol works: link If we did publish more about the internals of DDB, what would you be looking to learn? Architecture? Operational experience? Developer experience? There's a lot of material we could share, and it's useful to hear where people would like us to focus.
manigandhamon Hacker News • Mentions
On “Amazon's cloud business is competing with its own customers”
DynamoDB is different from their published paper, which is mostly about designing a highly available key/value system that can be run on top of any other datastore. The paper does mention MySQL as a storage option. The recent MySQL info comes from this 2016 thread on DynamoDB storing empty strings: link Confirmed by this comment specifically: link The latest 2018 ReInvent deep dive on DynamoDB doesn't reveal anything but still fits if mysql is powering the storage nodes: link to this video
talawahtechon Hacker News • Mentions
On “Amazon DocumentDB, with MongoDB compatibility”
Saying DynamoDB is built on top of InnoDB is a pretty big oversimplification of a much more complex distributed system1 and for all we know they could have switched out the low level the storage engine on the backend to something like RocksDB or WiredTiger. The Aurora storage subsystem is much more limited in terms of horizontal scalability and performance, they probably chose it because it was a better/quicker fit. 1. link to this video
u/zackphanin r/softwarearchitecture • Mentions
On “What are the best resources to learn in-depth on Amazon DynamoDB?”
You can start with this DynamoDB under the hood
u/too_much_exceptionsin r/softwarearchitecture • Mentions
On “What distributed data store to learn the architecture concepts?”
My bad, I sent the wrong video
This one explains how ddb works under the hood link to this video
Ddb depends heavily on AWS infrastructure