Cloud Native Event Streaming with Kafka & Open Standards • Kasun Indrasiri • GOTO 2023

This presentation was recorded at GOTO Chicago 2023. #GOTOcon #GOTOchgo https://gotochgo.com Kasun Indrasiri - Author of Multiple Books & Senior Product Manager at Microsoft@kasunindrasiri RESOURCES https://twitter.com/kasunindrasiri https://medium.com/@kasunindrasiri https://linkedin.com/in/kasun-indrasiri ABSTRACT Modern software applications heavily rely on analyzing large volumes of sequences of events or ‘event streams’ that are continuously generated by different sources in real-time to capture actionable insights and immediately respond to business challenges. As modern business applications require to ingest, collect, store and process terabytes of data that comes in the form of event streams, you need to choose an Event Streaming Platform that is performant, interoperable, scalable, reliable, secure, and cost-efficient. The popularity and adoption of Event Streaming platforms such as Apache Kafka, Azure Event Hubs, AWS Kinesis, etc. are increasing. In this session, we’ll take a closer look at the key characteristics of cloud native event streaming platforms. These characteristics include: • Multi-protocol: Ability to ingest and consume event streams with a wide array of protocols such as AMQP, Kafka, HTTP, WebSockets, and so on • High-Performance data streaming: Low end-to-end latency, high throughput • Dynamic scaling: Scale event stream ingestion capacity dynamically • Multi-tenanted PaaS with workload isolation • Elasticity • High availability and resiliency: Replicas. availability Zones • Geo Disaster recovery with data and state replication • Security and Compliance • Stream governance: Using schema-driven formats, Fine-grained resource governance [...] TIMECODES 00:00 Intro 00:57 Agenda 02:18 Why event streaming? 04:13 What is event streaming? 09:07 Cloud native event streaming 12:01 Key components of an event stream ingestion 25:10 High performant streaming 41:40 Azure Event Hubs under the hood 47:13 Outro Read the full abstract here: https://gotochgo.com/2023/sessions/2508 RECOMMENDED BOOKS Kasun Indrasiri & Sriskandarajah Suhothayan • Design Patterns for Cloud Native Applications • https://amzn.to/3szGx0p Kasun Indrasiri & Danesh Kuruppu • gRPC: Up and Running • https://amzn.to/3sBGBJJ Kasun Indrasiri & Prabath Siriwardena • Microservices for the Enterprise • https://amzn.to/40FhxkQ Kasun Indrasiri • Beginning WSO2 ESB • https://amzn.to/3sx9NF0 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #CloudNative #EventStreaming #Kafka #ApacheKafka #OpenStandards #StreamGovernance #Governance #Elasticity #PaaS #DynamicScaling #AMQP #WebSocket #MultiProtocol #EventHub #AzureEventHubs #KasunIndrasiri Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1