Spring AI Is All You Need • Christian Tzolov • GOTO 2024

This presentation was recorded at GOTO Amsterdam 2024. #GOTOcon #GOTOams https://gotoams.nl Christian Tzolov - Spring Framework Engineer at Broadcom & Lead Developer for the Spring AI project @tzolov RESOURCES https://twitter.com/christzolov https://www.linkedin.com/in/tzolov https://github.com/tzolov https://spring.io/team/tzolov ABSTRACT This session explores Spring AI, a new framework enabling Java developers to integrate AI seamlessly into enterprise applications. Spring AI was born from the realisation that using a Generative AI is before all an integration problem that boils down to integrating your enterprise data and APIs with the AI Models. In this talk, the Spring AI project lead will introduce you to the main AI concepts you need to know and how to start writing AI applications quickly. Spring AI provides many components required in creating an AI software stack and brings Spring’s traditional design principles, such as portability and modular design, to promote POJOs as the building blocks of an AI application. This session will introduce many Spring AI features, starting with a portable client API to interact with AI models. You will learn how to create effective AI prompts, including using user-defined functions, and converting AI responses into POJOs. Use cases like “query over your docs” are demonstrated by showcasing Spring AI features such as creating Embeddings and storing them in a Vector Database. Also, Spring AI provides a lightweight ETL framework that takes your documents and stores them in the Vector Database. The popular RAG pattern and ways you can effectively evaluate how your AI application is performing are discussed. [...] TIMECODES 00:00 Intro 00:58 Journey to GenAI 04:30 Applying GenAI 06:08 Capabilities 07:37 Constraints 12:33 Demo 13:31 GenAI patterns 13:53 Demo: System prompt 17:44 Demo: Output converters 20:28 Demo: Prompt stuffing 22:55 Demo: RAG 31:46 Demo: Chat memory 33:44 Demo: Function calling 39:39 Demo: Multimodality 40:53 Demo: Evaluation 42:05 Demo: Semantic search 44:14 Use case 53:15 Outro Read the full abstract here: https://gotoams.nl/2024/sessions/3314 RECOMMENDED BOOKS Banu Parasuraman • Mastering Spring AI • https://amzn.to/41siONh Thomas Vitale • Cloud Native Spring in Action • https://amzn.to/3kLu1ns Josh Long • Reactive Spring • https://amzn.to/49CxQ5k Josh Long, Marten Deinum & Daniel Rubio • Spring 6 Recipes • https://amzn.to/3T78NB1 Kevlin Henney & Trisha Gee • 97 Things Every Java Programmer Should Know • https://amzn.to/3kiTwJJ Markus Eisele & Natale Vinto • Modernizing Enterprise Java • https://amzn.to/3EsEtZ3 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #SpringAI #GenerativeAI #GenAI #SpringFramework #Java #ChristianTzolov CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1