Kubeflow for Machine Learning • Holden Karau & Adi Polak • GOTO 2022

This interview was recorded for the GOTO Book Club. #GOTOcon #GOTObookclub http://gotopia.tech/bookclub Read the full transcription of the interview here: https://gotopia.tech/bookclub/episodes/kubeflow-for-machine-learning Holden Karau - Co-Author of "Kubeflow for Machine Learning" & Open Source Engineer at Netflix @HoldenKarau Adi Polak - VP of Developer Experience at Treeverse & Contributing to lakeFS OSS @polakadi DESCRIPTION Machine Learning has been declared dead several times but that’s far from true. Join Adi Polak, vice president of developer experience at Treeverse, and Holden Karau, open source engineer at Netflix, in their conversation about Kubeflow and how it provides better tooling in the ML space. The discussion touches on Holden’s book “Kubeflow for Machine Learning” and expands to cover the worlds of Ray and Dask: https://amzn.to/3JVngcx TIMECODES 00:00 Intro 02:51 How does Kubeflow work? 07:04 Structure of the book 14:52 Scaling Python with Dask / Scaling Python with Ray 20:51 API Comparison: Ray and Dask vs Apache Spark 25:56 Pluggable architecture 28:44 How to write three books in parallel? 35:28 Functional programming for kids 39:36 Pain points in data infrastructure 42:50 Outro RECOMMENDED BOOKS Holden Karau, Trevor Grant, Boris Lublinsky, Richard Liu & Ilan Filonenko • Kubeflow for Machine Learning • https://amzn.to/3JVngcx Holden Karau • Distributed Computing 4 Kids • https://www.distributedcomputing4kids.com Holden Karau • Scaling Python with Dask • https://www.oreilly.com/library/view/scaling-python-with/9781098119867 Holden Karau & Boris Lublinsky • Scaling Python with Ray • https://amzn.to/44GU6cC Holden Karau & Rachel Warren • High Performance Spark • https://amzn.to/3v2eLbn Holden Karau, Konwinski, Wendell & Zaharia • Learning Spark • https://amzn.to/397e2NE Holden Karau & Krishna Sankar • Fast Data Processing with Spark 2nd Edition • https://amzn.to/3xKhXKu Holden Karau • Fast Data Processing with Spark 1st Edition • https://amzn.to/3rHQgOu Adi Polak • Machine Learning with Apache Spark • https://amzn.to/3ppdUkB Phil Winder • Reinforcement Learning • https://amzn.to/3t1S1VZ Aurélien Géron • Hands-On Machine Learning with Scikit-Learn, Keras & TensorFlow • https://amzn.to/2XZaQy8 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #Kubeflow #HoldenKarau #AdiPolak #ML #MachineLearning #AI #ArtificialIntelligence #Netflix #Treeverse #CloudNative #Kubernetes #k8s #Cloud #ClusterTypes #ScikitLearn #Scikit #TensorFlow #TF #ApacheSpark #Ray #Dask #Python #Spark #SoftwareEngineering #Programming #Coding #DataFrame #NumPy #SparkRDD #API #APIs #Metadata #LakeOSS #SodaCL #KubeflowTutorial #MLTutorial #AITutorial CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1