Optimizing a Prompt for Production • Mike Taylor • GOTO 2024

This presentation was recorded at GOTO Chicago 2024. #GOTOcon #GOTOchgo https://gotochgo.com Mike Taylor - Founder & Co-Author of “Prompt Engineering for Generative AI” RESOURCES http://saxifrage.xyz https://twitter.com/hammer_mt https://www.linkedin.com/in/mjt145 ABSTRACT Trial and error can only get you so far when working with generative AI, because when you're running a prompt hundreds or thousands of times a day, you need to know when and why it fails. Prompt engineering isn't about finding the right combination of magic words that tricks the AI to do what you want, it's a process for building a production-grade AI system that delivers the results you need, reliably and at scale. We'll apply prompt engineering principles to a real-world AI use-case and make the strategic trade-offs needed to make your AI products economically viable. If you have tried prompting to automate a task, but couldn't get good enough results, this talk will give you actionable steps for closing that gap. You'll take away a checklist for optimizing prompts from idea to production, using principles that are transferable across models and modalities. [...] TIMECODES 00:00 Intro 02:27 Agenda 04:25 What is prompt engineering? 11:14 5 principles of prompting 11:36 1. Give direction 13:42 2. Specify format 16:54 3. Provide examples 20:29 4. Evaluate quality 25:14 5. Divide labor 28:22 Optimization in production 31:45 A/B testing 33:09 DSPy optimizers 34:20 Fine-tuning 38:07 The business case for prompting 38:29 Outro Download slides and read the full abstract here: https://gotochgo.com/2024/sessions/3285 RECOMMENDED BOOKS James Phoenix & Mike Taylor • Prompt Engineering for Generative AI • https://amzn.to/3CbqKtG Jay Alammar & Maarten Grootendorst • Hands-On Large Language Models • https://amzn.to/40iCUJ7 Chip Huyen • AI Engineering • https://amzn.to/4jltaGT https://bsky.app/profile/gotocon.com https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #PromptEngineering #GenerativeAI #ChatGPT #DSPyOptimizers #GenAI #AIUseCase #ArtificialIntelligence #ML #DataScience #MikeTaylor CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1