ChatGPT from Scratch: How to Train an Enterprise AI Assistant • Phil Winder • GOTO 2023

This presentation was recorded at GOTO Copenhagen 2023. #GOTOcon #GOTOcph https://gotocph.com Phil Winder - CEO of Winder.AI, Author of "Reinforcement Learning" @philwinder263 RESOURCES https://twitter.com/DrPhilWinder https://linkedin.com/in/drphilwinder https://github.com/philwinder https://winder.ai https://winder.ai/blog Links https://arxiv.org/abs/2203.02155 https://arxiv.org/pdf/2201.05601 https://arxiv.org/abs/2305.11206 https://arxiv.org/pdf/2210.15424 https://arxiv.org/pdf/2306.01116 https://arxiv.org/pdf/1904.09483 https://arxiv.org/pdf/2306.01116 https://arxiv.org/pdf/2309.11295 https://github.com/Zjh-819/LLMDataHub https://arxiv.org/abs/2210.15424v1 https://github.com/huggingface/peft https://github.com/TimDettmers/bitsandbytes https://github.com/AutoGPTQ/AutoGPTQ https://mr-ranedeer.com https://llm-attacks.org https://winder.ai/using-reinforcement-learning-to-attack-web-application-firewalls https://github.com/huggingface/text-generation-inference https://github.com/vllm-project/vllm https://developer.nvidia.com/triton-inference-server https://www.langchain.com https://arstechnica.com/information-technology/2023/09/can-you-melt-eggs-quoras-ai-says-yes-and-google-is-sharing-the-result ABSTRACT In today's fast-paced business environment, the demand for intelligent enterprise assistants that can help optimize workflow, handle customer queries, and even automate tasks is at an all-time high. But how do you go about creating a powerful and reliable conversational agent like ChatGPT? This tutorial aims to answer exactly that question. We invite developers, data scientists, and tech enthusiasts to a rapid tutorial on building Large Language Models (LLMs) tailored for enterprise applications. We will delve into the architecture, training methodologies, data pipeline construction, and optimization techniques required for creating a state-of-the-art enterprise assistant. Participants will gain experience with LLM with a comprehensive LLM walkthrough along with the foundational knowledge required to build, fine-tune, and deploy LLMs in an enterprise setting. Key Takeaways: • A Brief History of LLMs: Tracing the evolutionary journey of Large Language Models from their rudimentary forms to cutting-edge architectures like GPT-4, and understanding their impact on the field of Natural Language Processing (NLP). • Understanding the core architecture and components of Large Language Models like ChatGPT. • Techniques for curating and pre-processing domain-specific datasets that result in a highly specialized and efficient LLM. • Strategies for efficient and cost-effective model training, from fine-tuning pre-trained models to training from scratch. • Deployment considerations for LLMs, including the use of cloud-based services like AWS and Azure. • Security and ethical considerations in deploying LLMs in a business environment, including data privacy and model interpretability. By the end of the tutorial, attendees will have a working knowledge of LLMs and the confidence to prototype intelligent conversational agents for their organizations. Whether you are a novice exploring the world of NLP and machine learning or an experienced developer looking to upskill, this tutorial has something for everyone. Come join us as we demystify the intricacies of developing [...] TIMECODES 00:00 Intro 01:33 1. History 06:01 2. Core architecture & components 12:33 3. Data preparation 20:36 4. Modelling & training 26:20 5. Deployment 30:22 6. Extras 36:53 7. Demo 48:05 Outro Download slides and read the full abstract here: https://gotocph.com/2023/sessions/2906 RECOMMENDED BOOKS Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ Holden Karau, Trevor Grant, Boris Lublinsky, Richard Liu & Ilan Filonenko • Kubeflow for Machine Learning • https://amzn.to/3JVngcx Kelleher & Tierney • Data Science (The MIT Press Essential Knowledge series) • https://amzn.to/3AQmIRg Lakshmanan, Robinson & Munn • Machine Learning Design Patterns • https://amzn.to/2ZD7t0x Lakshmanan, Görner & Gillard • Practical Machine Learning for Computer Vision • https://amzn.to/3m9HNjP Aurélien Géron • Hands-On Machine Learning with Scikit-Learn, Keras & TensorFlow • https://amzn.to/2XZaQy8 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #ChatGPT #LLM #AIAssistant #LargeLanguageModels #AITutorial #AIDemo #NaturalLanguageProcessing #NLP #Huggingface #ReinforcementLearning #PhilWinder CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1