The Importance of Forgetting for Both Humans & Machines • Robert Crowe • GOTO 2022

This presentation was recorded at GOTO Copenhagen 2022. #GOTOcon #GOTOcph http://gotocph.com Robert Crowe - TensorFlow Developer Advocate at Google @robertcrowe3724 RESOURCES Robert https://twitter.com/robert_crowe https://github.com/rcrowe-google https://linkedin.com/in/robert-crowe TFX https://www.tensorflow.org/tfx https://github.com/tensorflow/tfx https://github.com/tensorflow/tfx-addons https://discuss.tensorflow.org/tag/tfx https://goo.gle/tfx-youtube Studies https://doi.org/10.1016/j.neuron.2017.04.037 https://www.frontiersin.org/articles/10.3389/fncom.2022.757244/full https://journals.plos.org/plosbiology/article/file?id=10.1371/journal.pbio.2004633&type=printable ABSTRACT As humans, we often think of forgetting as a failure of memory, but there is increasing evidence that forgetting is actually a core function of memory. This is clearly true for machine learning, where forgetting is required in order to adapt to new realities, and comparisons between human and machine memory point towards potential reasons why even the simplest organisms have evolved to forget. While in humans change often causes stress, with the negative effects that stress brings, in machines change often leads to failure. In both humans and machines adapting to change requires accepting change as a constant, and working to adapt on an ongoing basis. In both cases, adaptation generally improves with experience. While in humans change is part of our lived experience, machines must generally rely on external actors (humans) to help them adapt. This talk will explore: The importance of forgetting for both humans and machines, and the role of forgetting and relearning in adapting to the stresses of change. State of the art processes for adaptation of machine learning models in production settings, and Google’s experience and approach for its products and services. [...] TIMECODES 00:00 Intro 00:24 Remember, learn, forget 08:15 Testing the hypothesis 10:19 What about ML? 16:13 How do models forget? 18:48 MLOps 20:57 Training & deploying models 25:11 What about tomorrow? 29:11 Learning from studying our brains 31:03 Resources 31:20 Outro Download slides and read the full abstract here: https://gotocph.com/2022/sessions/2208/the-importance-of-forgetting-for-both-humans-and-machines RECOMMENDED BOOKS Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ Kelleher & Tierney • Data Science (The MIT Press Essential Knowledge series) • https://amzn.to/3AQmIRg Lakshmanan, Robinson & Munn • Machine Learning Design Patterns • https://amzn.to/2ZD7t0x Lakshmanan, Görner & Gillard • Practical Machine Learning for Computer Vision • https://amzn.to/3m9HNjP Thushan Ganegedara • TensorFlow in Action • https://amzn.to/3nbBJfa Aurélien Géron • Hands-On Machine Learning with Scikit-Learn, Keras & TensorFlow • https://amzn.to/2XZaQy8 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #MachineLearning #ML #AI #ArtificialIntelligence #TensorFlow #DataScience #MLTutorial #AITutorial #DataScienceTutorial #TensorFlowTutorial #MLOps #TFX #RobertCrowe #ScikitLearn CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1