Unveiling much Simplified Functional Programming in Scala • Afsal Thaj • YOW! 2020

This presentation was recorded at YOW! 2020. #GOTOcon #YOW https://yowcon.com Afsal Thaj - Principal Consultant at Simple Machines ORIGINAL TALK TITLE Unveiling much Simplified Functional Programming in Scala for Data Engineering RESOURCES https://www.linkedin.com/in/afsal-thaj-10ab2842 https://twitter.com/afsalt2 https://medium.com/@afsal-taj06 ABSTRACT I will talk about a much simplified version of #FunctionalProgramming in #Scala, in building an abstraction for Feature Generation in #DataEngineering space. The program made using this abstraction will get interpreted to the popular data source languages of our choice - such as #Spark or #Flink. However, before it gets interpreted to any of these engines, we will explain how these programs could be optimised by introspecting its nodes, and help run these interpretations faster. The core idea is similar to that of Free Applicative, however, implementing it in Scala hasn't been straight forward. Here, we provide a similar capability but without mentioning much about FreeAp, and without the usual Scala boilerplates of implicits, macros and a proliferated usage of type classes. The purpose of the talk is not just to demonstrate a set of code, but to showcase the fact that sticking on to fundamentals of Functional Programming, and finding the right abstraction enables writing solutions quickly and relatively easily. It proves we don't need to learn a bulk of libraries to apply these concepts in real world applications. The learning curve and a massive set of libraries was often termed as the functional programming in Scala industry, resulting in lesser adoption and developers moving away from it. With this talk my intention is to motivate developers to come back and start writing FP even if they are in the world of #JVM. [...] RECOMMENDED BOOKS Martin Odersky • Programming in Scala 5th Edition • https://amzn.to/44rXiaM Joshua D. Suereth • Scala in Depth • https://amzn.to/3QVADk6 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #ApacheSpark #ApacheFlink #ScalaLang #Programming #AfsalThaj #YOWcon Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1