How to Make Smart Architecture Decisions when Building Gen AI Apps • Gillian Armstrong • GOTO 2024

This presentation was recorded at GOTO EDA Day 2024. #GOTOcon #GOTOeda #GOTOldn http://gotoldn.com Gillian Armstrong - Senior Solutions Architect, Generative AI Solutions at AWS ORIGINAL TALK TITLE Outsmarting the Genie: How to Make Smart Architecture Decisions when Building Gen AI Apps RESOURCES https://twitter.com/virtualgill https://www.linkedin.com/in/gillian-armstrong https://github.com/virtualgill https://virtualgill.medium.com https://virtualgill.com ABSTRACT The genie is out of the bottle. Generative AI is everywhere, and promising to fulfil your every wish. Just like wishes however, building generative AI apps can be risky if not well thought out. This session explores the architectural decisions and trade-offs you need to consider to build reliable and performant generative AI applications. We’ll look at what generative AI is (and isn’t), what factors drive model and tooling choices, techniques for enhancing safety and accuracy, considerations for testing and optimising, as well as responsible AI principles. We’ll look at some real-life use-cases to help understand how to apply the best practices, and explore how to identify good and bad use-cases for generative AI. Whether you are playing about with POCs, or ready to jump into large-scale production apps, this talk will equip you with the architectural knowledge to "outsmart the genie", use those wishes wisely, and unlock the full potential of generative AI. [...] TIMECODES 00:00 Intro 01:36 Generative AI 11:40 Use case 1 19:56 Objective 1: Fast 22:08 Objective 2: Accurate 35:22 Objective 3: Safe 37:52 Use case 2 45:41 Advice Summary 48:02 Outro Download slides and read the full abstract here: https://gotoldn.com/2024-eda-aws-day/sessions/3250 RECOMMENDED BOOKS James Urquhart • Flow Architectures • https://amzn.to/3Tyz8cY Adam Bellemare • Building Event-Driven Microservices • https://amzn.to/3WfNKfM Peter Sbarski • Serverless Architectures on AWS • https://amzn.to/3hJzEUM Michael Stack • Event-Driven Architecture in Golang • https://amzn.to/3G5e8ST Ford, Richards, Sadalage & Dehghani • Software Architecture: The Hard Parts • https://amzn.to/3v4pKQS Gerardus Blokdyk • Event-Driven Architecture EDA • https://amzn.to/3FOfUHE https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #EDA #GenAI #GenerativeAI #LLM #Serverless #DDD #EventDrivenArchitecture #SoftwareArchitecture #AWS #EventDriven #Backend #EventBridge #GillianArmstrong Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1