A Kafkaesque Series of Events • Lily Mara • YOW! 2022

This presentation was recorded at YOW! 2022. #GOTOcon #YOW https://yowcon.com Lily Mara - Engineering Manager at OneSignal @lily-mara RESOURCES https://lilymara.xyz https://twitter.com/TheLily_Mara https://linkedin.com/in/lily-mara ABSTRACT You may have heard that Rust eliminates concurrency bugs, and this is largely true. This talk will be a deep-dive into the investigation of a concurrency bug that could not be caught by the Rust type system. We'll walk through the background on the asynchronous messaging systems at OneSignal that process billions of events per day, and discuss how a massive series of unfortunate coincidences caused almost a total stoppage of work. [...] TIMECODES 00:00 Intro 00:35 Once upon a time 03:53 Kafka 08:55 Issues 10:40 Subpartition processing 15:02 Concession 16:12 Review 18:04 Goals 22:13 Observability 27:27 OneSignal 30:14 Why is that a problem? 35:37 Q&A 42:02 Outro Download slides and read the full abstract here: https://yowcon.com/sydney-2022/sessions/2323 RECOMMENDED BOOKS Viktor Gamov, Dylan Scott & Dave Klein • Kafka in Action • https://amzn.to/3CrB8KU Shapira, Palino, Sivaram & Petty • Kafka: The Definitive Guide • https://amzn.to/3RPtdLP Bill Bejeck • Kafka Streams in Action • https://amzn.to/3CGJiiM Martin Kleppmann • Designing Data-Intensive Applications • https://amzn.to/3mk2Roj Jono Bacon • People Powered • https://amzn.to/3UYuqTT Mary Thengvall • The Business Value of Developer Relations • https://amzn.to/3C6kRKc https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #ApacheKafka #Kafka #Apache #EventStreaming #EventDrivenArchitecture #EventDriven #KafkaTutorial #KafkaInAction #Concurrency #Streaming #Batching #DataIntegration #Programming #OneSignal #DataPipelines #StreamingAnalytics #ETL #Docker #LilyMara #YOWcon Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1