This presentation was recorded at GOTO Aarhus 2012 http://gotocon.com Adrian Cockcroft - Director of Architecture for the Cloud Systems Team at Netflix @adriancockcroft ABSTRACT Netflix grew rapidly and moved its streaming video service to the AWS cloud between 2009 and 2010. In 2011 the architecture was extended to use Apache Cassandra as a backend, and the service was internationalized to support Latin America. Early in 2012 Netflix launched in the UK and Ireland, using the the combination of AWS capacity in Ireland and Cassandra to create a truly global backend service. Since then the code that manages and operates the global Netflix platform is being released as a series of open source projects at netflix.github.com (Asgard, Priam etc.). The platform is structured as a large scale PaaS, strongly leveraging advanced features of AWS to deploy many thousands of instances. The platform has primary language support for Java/Tomcat with most management tools built using Groovy/Grails and operations tooling in Python. Continuous integration and deployment tooling leverages Jenkins, Ivy/Gradle, Artifactory. This talk will explain how to build your own custom PaaS on AWS using these components. TIMECODES 0:00 Introduction 0:49 What Netflix Did 4:32 Keeping up with Developer Trends 6:32 Portability vs. Functionality 10:35 Freedom and Responsibility 12:42 Member Web Site 13:09 Content Delivery Service 14:25 Streaming Device API 14:47 Major Front End Services 15:12 Component Services 15:37 Web Server Dependencies Flow 16:22 One Request Snapshot 17:13 Current Architectural Patterns for Availability 18:39 Isolated Services 19:19 Three Balanced Availability Zones 20:52 Triple Replicated Persistence 22:15 Isolated Regions 26:15 Failure Modes and Effects 28:45 Netflix Deployed on AWS 33:03 Datacenter to Cloud Transition Goals 35:48 Netflix Datacenter vs. Cloud Arch 37:21 Chaos Monkey 39:03 Responsibility and Experience 41:34 Resilient Design - Circuit Breakers 43:22 Components 44:37 Build Pipeline 45:36 Jenkins Architecture 46:30 Netflix Extensions to Jenkins 46:59 The Bakery 48:17 Accounts Isolate Concerns 50:30 Reservations and Billing 52:10 Cloud Access Control 54:24 Runtime 54:38 Open Source Projects 57:15 Roadmap for 2012 58:03 Amazon Cloud Terminology Reference https://twitter.com/gotocon https://www.facebook.com/GOTOConference http://gotocon.com
Get notified about new features and conference additions.