Building Owly: An AI Comic Video Generator for My Son • Agustinus Nalwan • YOW! 2023

This presentation was recorded at YOW! Perth 2023. #GOTOcon #YOW https://yowcon.com Agustinus Nalwan - GM of AI, Data Platform & Data Science @agustinusnalwan2200 RESOURCES https://twitter.com/gusnalwan https://linkedin.com/in/agustinus-nalwan https://agustinus-nalwan.medium.com ABSTRACT Utilising an Amazon Bedrock Large Language Model (LLM) and a fine-tuned Stable Diffusion 2.1 on Amazon SageMaker JumpStart, I developed an AI tech called Owly that crafts personalised comic videos with music, starring my son’s toys as the lead characters. I will take you through the process (but not limited to) how I utilised LLM to generate the story script via prompt engineering and how I fine-tuned the model to learn to generate an image with a new characters. [...] TIMECODES 00:00 Intro 02:04 Project faAi 02:56 Project Ellee 04:20 Demo: Ellee in action 06:12 Owly – a personalized comic video generator 07:44 What does Owly do? 08:09 Demo: Owly in action 10:49 How does Owly work? 12:58 LLM 13:18 Demo 16:52 Amazon Bedrock 17:10 Building the comic image generator 17:45 How the Stable Diffusion model was built 19:52 Challenges & enhancements 24:28 Problems & solutions 26:44 unplanned cool feature 30:10 Architecture 32:15 Something cool 33:48 Outro Download slides and read the full abstract here: https://yowcon.com/perth-2023/sessions/2705 RECOMMENDED BOOKS Sean Moriarity • Genetic Algorithms in Elixir • https://amzn.to/3PdlmZu Sean Moriarity • Machine Learning in Elixir • https://pragprog.com/titles/smelixir Ian Goodfellow, Yoshua Bengio & Aaron Courville • Deep Learning • https://amzn.to/48mo9rN Francois Chollet • Deep Learning with Python • https://amzn.to/3LwDpsC https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #Owly #AI #ArtificialIntelligence #AIVideoGenerator #LLM #AmazonBedrock #AmazonSageMaker #StableDiffusion #AgustinusNalwan #YOWcon Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1