DuckDB: Crunching Data Anywhere, From Laptops to Servers • Gabor Szarnyas • GOTO 2024

This presentation was recorded at GOTO Amsterdam 2024. #GOTOcon #GOTOams https://gotoams.nl Gábor Szárnyas - Technical Writer at DuckDB @gaborszarnyas4656 RESOURCES https://twitter.com/szarnyasg https://github.com/szarnyasg https://www.linkedin.com/in/szarnyasg https://szarnyasg.github.io https://duckdb.org ABSTRACT DuckDB is an analytical relational database management system which runs in-process, i.e., it is embedded within its host application that may be written in many popular languages (C/C++, Python, R, Java, etc.). DuckDB has full SQL support and can natively read/write formats such as CSV, Parquet, and JSON. It is built according to a modern system architecture, which allows running complex queries in parallel and spilling to disk for larger-than-memory workloads. This talk discusses DuckDB's key building blocks and demonstrates how it can handle hundreds of GBs of data on a laptop, or terabytes of data on a single server. [...] TIMECODES 00:00 Intro 01:23 What is DuckDB? 02:48 Demo 05:09 What is DuckDB? continued 06:48 Demo 11:09 In-process architecture 13:44 Internals: Storage & execution 19:21 Portability 20:56 Ergonomic 24:48 State of DuckDB 25:58 Extensions 27:10 Use cases 31:34 Limitations 32:57 Business model 35:03 Summary 36:06 Outro Download slides and read the full abstract here: https://gotoams.nl/2024/sessions/3114 RECOMMENDED BOOKS Mark Needham, Michael Hunger & Michael Simons • DuckDB in Action • https://amzn.to/45QwSli Simon Aubury & Ned Letcher • Getting Started with DuckDB • https://amzn.to/3VPk4qS Wei-Meng Lee • DuckDB: Up and Running • https://amzn.to/3xJsHeu https://twitter.com/GOTOcon https://www.linkedin.com/company/goto- https://www.instagram.com/goto_con https://www.facebook.com/GOTOConferences #DuckDB #MotherDuck #Data #DataManagement #Parquet #RelationalDatabase #SQL #WebAssembly #WASM #ApacheSpark #GaborSzarnyas CHANNEL MEMBERSHIP BONUS Join this channel to get early access to videos & other perks: https://www.youtube.com/channel/UCs_tLP3AiwYKwdUHpltJPuA/join Looking for a unique learning experience? Attend the next GOTO conference near you! Get your ticket at https://gotopia.tech Sign up for updates and specials at https://gotopia.tech/newsletter SUBSCRIBE TO OUR CHANNEL - new videos posted almost daily. https://www.youtube.com/user/GotoConferences/?sub_confirmation=1