Designing A Data-Intensive Future: Expert Talk • Martin Kleppmann & Jesse Anderson • GOTO 2023

This interview was recorded at GOTO Amsterdam for GOTO Unscripted. #GOTOcon #GOTOunscripted #GOTOams http://gotopia.tech Read the full transcription of this interview here: https://gotopia.tech/articles/284 Martin Kleppmann - Researcher at the Technical University of Munich & Author of "Designing Data-Intensive Applications" @kleppmann Jesse Anderson - Managing Director of Big Data Institute, Host of The Data Dream Team Podcast @jessetanderson RESOURCES Jesse Anderson: https://youtu.be/cWSCI1LpoGY Martin Kleppmann: https://youtu.be/esMjP-7jlRE Prag. Dave Thomas: https://youtu.be/ug8XX2MpzEw Kafka in Action: https://youtu.be/2l-JsB10WaI Kasun Indrasiri: https://youtu.be/lDT2DBaNRC4 Kevlin & Sander: https://youtu.be/JAl3QFae_dE Eli & Mark: https://youtu.be/Gs1exPFXnQ8 Robert Metzger: https://youtu.be/DkNeyCW-eH0 Laura & Maureen: https://youtu.be/iMx8otu3rFg https://automerge.org Martin https://martin.kleppmann.com https://twitter.com/martinkl https://nondeterministic.computer/@martin https://linkedin.com/in/martinkleppmann Jesse https://twitter.com/jessetanderson https://www.jesse-anderson.com https://sodapodcast.libsyn.com/site https://linkedin.com/in/jessetanderson https://www.jesse-anderson.com/category/blog DESCRIPTION Jesse Anderson, director at Big Data Institute, and Martin Kleppmann, author of "Designing Data-Intensive Applications" explore together the evolving data landscape. They start with the origins of Martin’s book, emphasizing the crucial art of asking the right questions. Martin unveils industry shifts since 2017, spotlighting the transformative rise of cloud services. The conversation then takes a twist as Martin delves into academia, sharing insights on local-first collaboration software and the fascinating world of Automerge. Aspiring software engineers are treated with some advice on how to navigate the delicate balance between simplicity and adaptability. The interview concludes with a glimpse into diverse career paths in the dynamic realm of data engineering, making it a must-watch for professionals at every stage of their journey. TIMECODES 00:00 Intro 02:01 Evolution of data systems 12:18 Embracing change & timeless principles in startups 14:28 Local-first collaboration software 16:46 Reflections on academia 25:29 Advice for aspiring data engineers 27:29 Outro RECOMMENDED BOOKS Martin Kleppmann • Designing Data-Intensive Applications • https://amzn.to/3mk2Roj Martin Kleppmann • Secret Colors: A Gentle Introduction to Cryptography • https://amzn.to/3PgAcyj Jesse Anderson • Data Teams • https://amzn.to/3N0c2H7 Jesse Anderson • Data Engineering Teams • https://www.bigdatainstitute.io/data-engineering-teams-book Jesse Anderson • The Ultimate Guide to Switching Careers to Big Data • https://www.jesse-anderson.com/books Viktor Gamov, Dylan Scott & Dave Klein • Kafka in Action • https://amzn.to/3CrB8KU Fabian Hueske & Vasiliki Kalavri • Stream Processing with Apache Flink • https://amzn.to/41fNsss https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #Privacy #CRDTs #Data #LocalFirst #Automerge #ApacheKafka #ApacheFlink #StatefulStream #WebApp #CloudvsLocalFirst #Peritext #Data #DataProject #DataTeams #DataEngineeringTeams #SoftwareEngineering #Programming #DataEngineering #JesseAnderson #MartinKleppmann CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1