Designing A Data-Intensive Future: Expert Talk • Martin Kleppmann & Jesse Anderson • GOTO 2023

Martin Kleppmann and Jesse Anderson discuss the future of data-intensive applications, local-first software, and the evolution of data engineering.

This interview was recorded at GOTO Amsterdam for GOTO Unscripted. #GOTOcon #GOTOunscripted #GOTOams gotopia.tech Read the full transcription of this interview here: gotopia.tech/articles/284 Martin Kleppmann - Researcher at the Technical University of Munich & Author of "Designing Data-Intensive Applications" @kleppmann Jesse Anderson - Managing Director of Big Data Institute, Host of The Data Dream Team Podcast @jessetanderson RESOURCES Jesse Anderson: youtu.be/cWSCI1LpoGY Martin Kleppmann: youtu.be/esMjP-7jlRE Prag. Dave Thomas: youtu.be/ug8XX2MpzEw Kafka in Action: youtu.be/2l-JsB10WaI Kasun Indrasiri: youtu.be/lDT2DBaNRC4 Kevlin & Sander: youtu.be/JAl3QFae_dE Eli & Mark: youtu.be/Gs1exPFXnQ8 Robert Metzger: youtu.be/DkNeyCW-eH0 Laura & Maureen: youtu.be/iMx8otu3rFg automerge.org Martin martin.kleppmann.com twitter.com/martinkl nondeterministic.computer/@martin linkedin.com/in/martinkleppmann Jesse twitter.com/jessetanderson jesse-anderson.com sodapodcast.libsyn.com/site linkedin.com/in/jessetanderson jesse-anderson.com/category/blog DESCRIPTION Jesse Anderson, director at Big Data Institute, and Martin Kleppmann, author of "Designing Data-Intensive Applications" explore together the evolving data landscape. They start with the origins of Martin’s book, emphasizing the crucial art of asking the right questions. Martin unveils industry shifts since 2017, spotlighting the transformative rise of cloud services. The conversation then takes a twist as Martin delves into academia, sharing insights on local-first collaboration software and the fascinating world of Automerge. Aspiring software engineers are treated with some advice on how to navigate the delicate balance between simplicity and adaptability. The interview concludes with a glimpse into diverse career paths in the dynamic realm of data engineering, making it a must-watch for professionals at every stage of their journey. TIMECODES 00:00 Intro 02:01 Evolution of data systems 12:18 Embracing change & timeless principles in startups 14:28 Local-first collaboration software 16:46 Reflections on academia 25:29 Advice for aspiring data engineers 27:29 Outro RECOMMENDED BOOKS Martin Kleppmann • Designing Data-Intensive Applications • amzn.to/3mk2Roj Martin Kleppmann • Secret Colors: A Gentle Introduction to Cryptography • amzn.to/3PgAcyj Jesse Anderson • Data Teams • amzn.to/3N0c2H7 Jesse Anderson • Data Engineering Teams • bigdatainstitute.io/data-engineering-teams-book Jesse Anderson • The Ultimate Guide to Switching Careers to Big Data • jesse-anderson.com/books Viktor Gamov, Dylan Scott & Dave Klein • Kafka in Action • amzn.to/3CrB8KU Fabian Hueske & Vasiliki Kalavri • Stream Processing with Apache Flink • amzn.to/41fNsss twitter.com/