Serverless & Event-driven Patterns for GenAI • Uma Ramadoss & Dhiraj Mahapatro • GOTO 2023

This presentation was recorded at GOTO EDA Day 2023. #GOTOcon #GOTOeda #GOTOedaday http://gotopia.tech Uma Ramadoss - Sr. Solutions Architect, Integration Services at AWS Dhiraj Mahapatro - Principal Serverless Solutions Architect at AWS RESOURCES Uma https://linkedin.com/in/uma-r-96578910 https://twitter.com/uma_ramadoss Dhiraj https://twitter.com/dhirajmahapatro https://linkedin.com/in/dmahapatro ABSTRACT GenAI creates new and exciting opportunities for application development. GenAI also introduces challenges in how developers build application architecture to meet the different needs of AI. Developers need efficient and cost-effective ways to host, train, and ultimately, consume GenAI. In this session, you will learn about new event-driven architectural patterns that are helping developers to build GenAI solutions quickly and effectively run on AWS at scale. By the end of the session, you will walk away with several EDA pattern options for hosting, context tuning, and consuming GenAI to cater to different business use cases. [...] TIMECODES 00:00 Intro 00:52 Agenda 01:40 Introduction to generative Al 07:26 Use cases 11:36 Why use serverless with generative Al? 15:01 Serverless services 18:52 Serverless patterns for generative Al 30:11 How to build context based on internal knowledge? 37:08 Hosting foundation models 37:46 Documents summarization on SageMaker at scale 43:12 Summary 44:09 Outro Download slides and read the full abstract here: https://gotopia.us/2023-eda-aws-day/sessions/2827 RECOMMENDED BOOKS James Urquhart • Flow Architectures • https://amzn.to/3Tyz8cY Adam Bellemare • Building Event-Driven Microservices • https://amzn.to/3WfNKfM Peter Sbarski • Serverless Architectures on AWS • https://amzn.to/3hJzEUM Michael Stack • Event-Driven Architecture in Golang • https://amzn.to/3G5e8ST Ford, Richards, Sadalage & Dehghani • Software Architecture: The Hard Parts • https://amzn.to/3v4pKQS Gerardus Blokdyk • Event-Driven Architecture EDA • https://amzn.to/3FOfUHE https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #GenAI #GenerativeAl #LLM #SageMaker #Serverless #EDA #EventDrivenArchitecture #SoftwareArchitecture #AWS #EventDriven #Microservices #AsynchronousEvents #UmaRamadoss #DhirajMahapatro Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1