The RAG Really Ties the App Together • Jeff Vestal • GOTO 2024

This presentation was recorded at GOTO Chicago 2024. #GOTOcon #GOTOchgo https://gotochgo.com Jeff Vestal - Principal Customer Enterprise Architect at Elastic @JeffVestal RESOURCES https://github.com/jeffvestal https://www.linkedin.com/in/jeffvestal ABSTRACT In this talk, we'll focus on the challenges of building retrieval augmented generation (RAG) chat applications and how to overcome them efficiently. We'll explore common issues such as file processing, semantic search, and prompt iteration, showing how Elasticsearch helps streamline these tasks. Using Elastic Playground, we'll fine-tune settings and quickly test RAG prompts to optimize performance. I'll also walk through the process of transforming files into sparse vector embeddings for better search results, and demonstrate how to seamlessly export code for integration into a functional chat application. [...] TIMECODES 00:00 Intro 01:44 Lexical 101 03:28 Semantical 101 09:20 ELSER 12:16 Query problem 15:05 Inference API 16:27 Semantic text 19:56b RAG (Retrieval Augmented Generation) 23:17 Generative caching 26:06 LLM caching benefits 27:19 LLM helpy helper 31:19 Demo 43:20 Outro Read the full abstract here: https://gotochgo.com/2024/sessions/3536 RECOMMENDED BOOKS Bahaaldine Azarmi & Jeff Vestal • Vector Search for Practitioners with Elastic • https://amzn.to/3ZCGSfa Madhusudhan Konda • Elasticsearch in Action • https://amzn.to/3P4sQ16 Huage Chen & Yazid Akadiri • Elastic Stack 8.x Cookbook • https://amzn.to/3DymaFW Asjad Athick • Getting Started with Elastic Stack 8.0 • https://amzn.to/41Cu8YN https://bsky.app/profile/gotocon.com https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #RetrievalAugmentedGeneration #RAG #Elasticsearch #ELSER #VectorSearch #ElasticPlayground #GenerativeCaching #VectorEmbedding #JeffVestal CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1