Why Most Data Projects Fail & How to Avoid It • Jesse Anderson • GOTO 2023

This presentation was recorded at GOTO Amsterdam 2023. #GOTOcon #GOTOams https://gotoams.nl Jesse Anderson - Managing director of Big Data Institute, Host of The Data Dream Team Podcast @jessetanderson RESOURCES https://twitter.com/jessetanderson https://www.jesse-anderson.com https://sodapodcast.libsyn.com/site https://linkedin.com/in/jessetanderson https://www.jesse-anderson.com/category/blog ABSTRACT Unfortunately, the majority of data projects fail. Yet, they fail for the same reasons. Most management and data teams don’t know the reasons a project succeeds or fails. It just appears to be random, hard work, or luck. To help understand the reasons teams succeed, we will introduce the who, what, when, where, and how of data projects. By answering these questions, teams will understand what they’re trying to accomplish far better. Who: Data teams all start with people. This needs to be the right people, with the right skills, and at the right ratios. You will need data scientists, data engineers, and operations all working together. What: Just saying you want AI isn’t enough. You need to know what business value will be generated. There should be a clear and attainable path to value creation. You have to clearly state what you are going to do to create value. When: Unattainable timelines aren’t feasible and neither are “when it’s ready” timeframes. Data projects need to deliver value on a sane timeline. This will include delivering in tranches so the team can gain velocity. Where: Clusters need to be spun up somewhere. Data needs to be stored somewhere. The data needs to come from somewhere. Data teams need to have a clear plan and architecture of where each piece will be done. How: Data teams need a clear plan that they are executing. This plan needs a singular focus or the work will go in different directions. There need to be clear technical choices and specific technologies chosen. Main Takeaways • We need all three teams to be successful with data projects. • We need to answer who, what, when, where, and how for a successful data project. • Management is at the center of planning for data projects. [...] TIMECODES 00:00 Intro 01:13 85% of data projects fail 02:14 The right questions 02:55 The right people at the right ratios 08:21 Data teams 10:28 What is the business value? 11:40 When will you generate value? 13:24 Where will data be processed? 15:15 How will the plan be executed? 16:47 Why is data valuable? 18:38 Not all gaps are technology 20:28 Should you get help? 21:15 Outro Download slides and read the full abstract here: https://gotoams.nl/2023/sessions/2493 RECOMMENDED BOOKS Jesse Anderson • Data Teams • https://amzn.to/3N0c2H7 Jesse Anderson • Data Engineering Teams • https://www.bigdatainstitute.io/data-engineering-teams-book Jesse Anderson • The Ultimate Guide to Switching Careers to Big Data • https://www.jesse-anderson.com/books https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #Data #DataProject #DataTeams #DataEngineeringTeams #AI #ML #SoftwareEngineering #Programming #JesseAnderson #DataEngineering #DataEngineeringProject #DataScience #DataScientist #OperationsEngineer CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1