Skip to content
0:00 / 0:00

#noria#unsaferust#lock-free

Rust at speed — building a fast concurrent database

Jon Gjengset

111K subscribers • 7 videos on Hallway

YouTube
  • Recommended by 5 people: 2 on Hacker News, 2 in engineering communities and 1 curated list.
  • Presented by Jon Gjengset, PhD student at MIT CSAIL
  • Linked in the descriptionSlides on jon.thesquareplanet.com

Advanced. Deep dive for people who know the field.

224K views7 years ago5 recommendations

Systems programmingDatabases and dataRustConcurrency and parallelismDatabase internals

Jon Gjengset discusses using Rust to build Noria, a high-performance research database, focusing on concurrent data structures and unsafe code.

This is a guest lecture I gave at Two Sigma in November 2018 where I discussed the experience of using Rust for building larger, high-performance systems. In it, I cover what makes Rust an attractive option for such projects; Noria, the high-performance research database prototype I've built using Rust; an interesting concurrent data-structure we use in Noria; and how I've found Rust to work in that context. The presentation slides are available at jon.thesquareplanet.com/slides/rust-twosigma/ . You can read more about Noria at pdos.csail.mit.edu/noria .

Why it's here

5 people recommend this

What people say. Highly recommended for its deep dive into concurrent data structures, database design, and practical systems programming in Rust.

programming-talkscurated list on GitHubRecommends

Under “Rust”

Rust at speed - building a fast concurrent database 00:52:53 by **Jon Gjengset** (2018)

u/codetrotterin r/databasedevelopment • Recommends

Jon Gjengset: Rust at speed – building a fast, concurrent database (2018)

u/conscellsin r/databasedevelopment • Recommends

Developing a Fast Concurrent Database

harikbon Hacker News • Recommends

On “There’s plenty of room at the Top: computer performance after Moore’s law”

Anecdotal - One of favorite YouTube live-streaming personalities, Jon Gjengset1 is a Ph.D student at MIT CSAIL. His talks are very detailed4 and captivating3 1 link Talks 2 link to this video 3 link Rust Details(my favorites) 4 link

Orouon Hacker News • Recommends

On “Noria: Dynamic, partially-stateful data-flow for high-perf web applications”

The author of Noria, Jon Gjengset, gave a great talk about the system: link to this video The speeds achieved are impressive but you do not get consistency.

dpezelyon Hacker News • Mentions

On “Rust at speed – building a fast concurrent database [video]”

He explains this at roughly the 40 minute mark. 1 "There's 7 more lines of `unsafe` that avoids keeping both maps. You still keep two maps, but you de-duplicate the data between those two maps." link to this video

Jonhooon Hacker News • Mentions

On “How PlanetScale Boost serves SQL queries faster”

…challenges and solutions involved. It also has a chapter (Appendix A) that covers how it all works by analogy, which the less-technical among the audience may appreciate :) A recording of my thesis defense on this, which may be more digestible than the thesis itself, is also online at link , as well as a shorter talk from a few years earlier at link to this video . And the Noria research prototype (written in Rust) is on GitHub: link . As others have already mentioned in the comments, I co-founded ReadySet ( link ) shortly after graduating specifically to build off of Noria, and they're doing amazing work to provide these kinds of speed-ups for general-purpose relational databases. If you're usi…