Applied Data Science & Engineering for Local Weather Forecasts • Nikhil Podduturi • GOTO 2016

This presentation was recorded at GOTO Berlin 2016 http://gotober.com Nikhil Podduturi - Senior Data Engineer/Data Scientist at MeteoGroup ABSTRACT Progress in weather forecasting and in climate modelling over the past 50 years has been dramatic. Due to these dramatic improvements the data being generated increased exponentially. While the first computer ENIAC (Electronic Numerical Integrator and Computer) took 24 hours to make a 24 hour integration weather forecast, right now at MeteoGroup we generate weather forecasts for next 10 days on the fly from the browser. At the core of [...] TIMECODES 0:00 Introduction 0:57 Agenda 4:25 Types of data 6:21 Numerical weather prediction models 7:45 Outcome 8:55 MeteoGroup forecasting system 10:42 Next generation forecasting system 12:47 Iteration 1 13:40 Iteration 2 16:04 Baseline model engineering 19:09 Scaling with Apache Airflow 20:31 Apache Airflow DAG 21:31 Airflow and Mesos 23:44 Model improvement cycle 24:09 Forecast verification 24:35 Verification metrics 25:42 Results 27:37 Improvements 33:19 CONFERENCES Download slides and read the full abstract here: https://gotocon.com/berlin-2016/presentations/show_talk.jsp?oid=7999 https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.facebook.com/GOTOConferences Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1