Design Compact Deep Learning Models: Small is the New Big • Davis Sawyer • GOTO 2020

This presentation was recorded at GOTO Chicago 2020. #GOTOcon #GOTOchgo http://gotochgo.com Davis Sawyer - Co-founder and chief product officer at AI software startup Deeplite ORIGINAL TALK TITLE Small is the New Big: Designing Compact Deep Learning Models ABSTRACT The emergence of deep neural networks (DNNs) in recent years has enabled ground-breaking abilities and applications for modern intelligent systems. State-of-the-art DNNs have been found to achieve high accuracy on tasks in computer vision and natural language processing, even outperforming humans on object recognition tasks. Concurrently, the increasing complexity and sophistication of DNNs is predicated on significant power consumption, model size and computing resources. For example, since 2012, the training complexity of AI models has increased by 350,000x. These factors have been found to limit deep learning’s performance in real-time applications, in large-scale systems, and on low-power devices. Furthermore, many low-end and cost-effective devices do not have the resources to execute DNN inference, causing users to sacrifice privacy and offload processing to the cloud. Application developers, software engineers and algorithm architects must now create intelligent solution that deal with strict latency constraints, such as in smart city, mobility and healthcare applications which often require that inference be performed in a matter of milliseconds [...] TIMECODES 00:00 Intro 01:33 Embedded AI 101 02:06 Deep learning models are growing rapidly 03:05 These demands force AI to the cloud 03:50 Edge computing challenges 04:27 Time to deploy AI on edge devices 05:01 Edge computing solutions: small is the new big 05:31 Designing compact deep learning models 06:40 Where does this fit in an ML/AI workflow? 07:25 Levels of optimization 08:29 Types of optimization 10:07 Optimization benchmarks - computer vision 11:15 Accelerating autonomous perception 11:53 AI on low cost, low power chips 13:07 Bringing AI to daily life Download slides and read the full abstract here: https://gotochgo.com/2020/sessions/1261 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #DeepLearning #DeepNeuralNetworks #DNNs #AI #AIModels #ML #ArtificialIntelligence #MachineLearning #Programming Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at http://gotocon.com SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1