Professional Data: Using Elasticsearch's Aggregation Framework • Mark Harwood • GOTO 2015

This presentation was recorded at GOTO Amsterdam 2015 http://gotoams.nl Mark Harwood - Software Engineer at Elastic ORIGINAL TALK TITLE Professional Data - Wrestling Techniques Using Elasticsearch's Aggregation Framework ABSTRACT Getting useful answers out of your data doesn't require a team of expensive data scientists. Elasticsearch aggregations include some powerful algorithms out of the box that can wrestle your large datasets [...] TIMECODES 0:00 Introduction 1:45 Search interface 20 2:57 Analytics interface of today 4:27 Optimised for real time 6:15 Worked examples 9:41 UK Housing data: percentiles 10:51 UK Housing data: terms 13:56 Geo as a common link between datasets: housing crime 15:13 Connected data: Enron emails 22:34 Recommendations: MovieLens data 23:05 Random samples should hold no surprises 24:38 Non random sample: people who liked Talladega nights 26:11 Problem: avoid analysis of poorly focused sets 27:31 How do we get a smaller, representative sample of users? 28:55 Putting search and analytics together.. 32:37 Amazon marketplace reviews 35:58 Anatomy of an entity indexing groovy script 38:33 Drilling down into seller #187's fanboys 39:15 UK car roadworthiness test: raw data 39:37 Derived car attributes 41:29 Miles driven vs number of days for fix 43:19 In summary 44:24 Questions? Download slides and read the full abstract here: http://gotocon.com/amsterdam-2015/presentation/Professional%20Data%20-%20Wrestling%20Techniques%20Using%20Elasticsearch's%20Aggregation%20Framework https://twitter.com/gotoamst https://www.facebook.com/GOTOConference http://gotocon.com #Elasticsearch #Elastic #ELKstack #Data #bigdata Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1