Going production scale with Gen AI - Patterns for your API - Scott Holden - NDC Sydney 2024

This talk was recorded at NDC Sydney in Sydney, Australia. #ndcsydney #ndcconferences #developer #softwaredeveloper Attend the next NDC conference near you: https://ndcconferences.com https://ndcsydney.com/ Subscribe to our YouTube channel and learn every day: / @NDC Follow our Social Media! https://www.facebook.com/ndcconferences https://twitter.com/NDC_Conferences https://www.instagram.com/ndc_conferences/ #ai #openai #chatgpt #azure "Hey AI, build me a production ready, secure, scalable, monitored, customer facing system driven by an LLM" In this session we will look at the architectural patterns and practices required to drive production-ready systems backed by large language models, considerations around content filtering, approaches to stop your enterprise bots leaking secrets as a pirate sea shanty, and how to leverage services like OpenAI ChatGPT and Azure OpenAI.