Apache Spark Beyond Shuffling • Holden Karau • GOTO 2017

This presentation was recorded at GOTO Chicago 2017. #GOTOcon #GOTOchgo http://gotochgo.com Holden Karau - Software development engineer at IBM's Spark Technology Center @HoldenKarau ORIGINAL TALK TITLE Apache Spark Beyond Shuffling - Why it isn't Magic - but also where there is some really cool Magic ABSTRACT Apache Spark is one the most popular general purpose distributed systems in the past few years. Apache Spark has APIs in Scala, Java, Python and more recently a few different attempts to provide support for R, C#, and Julia. This talk looks at Apache Spark from a performance/scaling point of view and the work we need to do to be able to handle [...] Download slides and read the full abstract here: https://gotochgo.com/2017/sessions/33 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences #ApacheSpark #Scala #Java #Python #APIs Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1