Streaming with Structure • Katherine Stanley • GOTO 2021

This presentation was recorded at GOTOpia February 2021. #GOTOcon #GOTOpia http://gotopia.eu Katherine Stanley - Software engineer at IBM Event Streams ABSTRACT Using a publish-subscribe messaging system like Apache Kafka is a great way to minimise coupling between your applications. The stream history that Kafka provides allow consumers to come and go, without the producers ever being aware. This works fine until an application changes the shape of the events it is producing — how do consumers understand and handle the change? This is where schemas and a schema registry comes in. This session will introduce the common schema formats that are used in the Kafka community and some schema registries that support these. It will also cover how to use schemas in different types of Kafka applications. Learn how to effectively [...] TIMECODES 00:00 Intro 00:53 Barista example 08:49 Using JSON 10:20 Adding structure with schemas 13:20 Schema registry 14:07 What format to use? 19:33 Which schema to choose? 27:02 Serdes and converters 34:41 Apicurio registry 36:06 Confluent schema registry 36:51 Summary 37:28 Outro Download slides and read the full abstract here: https://gotopia.eu/february-2021/sessions/1700/streaming-with-structure https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #Streaming #ApacheKafka #Kafka #Stream #EventStreaming #KafkaStreams #EventDriven #SoftwareArchitecture #StringSerializer #JSON #ApacheAvro #KafkaRecords #Serdes #Converter #KafkaConnect #Apicurio #Confluent Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1