Hello Deep Learning • Bert Hubert • GOTO 2023

This presentation was recorded at GOTO Amsterdam 2023. #GOTOcon #GOTOams https://gotoams.nl Bert Hubert - Geeky Entrepreneur @ahuopjouwbuis RESOURCES https://berthub.eu/articles/posts/hello-deep-learning https://arxiv.org/abs/1706.03762 https://github.com/ggerganov/whisper.cpp https://github.com/ggerganov/llama.cpp https://github.com/berthubert/hello-dl https://berthub.eu/articles/posts/ai-is-guaranteed-to-disrupt-us Bert https://twitter.com/bert_hu_bert https://linkedin.com/in/bert-hubert-b05452 https://github.com/berthubert https://berthub.eu ABSTRACT Deep learning/generative AI is taking the world by storm. Until late 2022 I had mostly dismissed all of this as hype, but the advent of ChatGPT made it impossible to ignore this any longer. By now there are tons YouTube videos telling you how you too can script up "an AI". If you feel like I did in 2022 that you must catch up rapidly, these videos are not the way to go. I have created a "Hello Deep Learning" project which explains the essence of deep learning absolutely from scratch. By this I mean an empty directory. In this presentation we'll build an OCR solution that can read actual handwritten letters, absolutely from scratch. The goal of "hello deep learning" is to get in on the ground floor so you can start learning more, while actually knowing what is going on. This talk introduces “Hello Deep Learning”, and also covers the fascinating actual basics of machine learning - stuff that most deep learning users have no idea about. This knowledge should help you find your way in the brave new world of AI. [...] TIMECODES 00:00 Intro 01:03 Deep learning from scratch 05:21 Hello deep learning project 05:52 Attention is all you need 11:41 Weirdly impressive 15:34 That can't possibly work 16:49 This really is magic 17:11 The loss function 20:00 Layers 28:07 Auto-gradient 28:26 Gradient descent with momentum 31:13 Percentage of digits classified correctly 34:51 The rules 37:12 Parting thoughts 42:05 Useful links 43:45 Outro Download slides and read the full abstract here: https://gotoams.nl/2023/sessions/2740 RECOMMENDED BOOKS Stefan Helzle • Low-Code Application Development with Appian • https://amzn.to/3rAC0Xq Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ Kelleher & Tierney • Data Science (The MIT Press Essential Knowledge series) • https://amzn.to/3AQmIRg Lakshmanan, Robinson & Munn • Machine Learning Design Patterns • https://amzn.to/2ZD7t0 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #DeepLearning #GenerativeAI #DeepNeuralNetworks #DNNs #AI #AIModels #ML #ArtificialIntelligence #MachineLearning #Programming #BertHubert #ChatGPT #OCR #ReinforcementLearning Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1