HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)

Amazon Web ServicesCited 3× on HN, 2018-2022
YouTube
18K views · 8 years ago · talk · dated

A Netflix performance engineer presents how Netflix tunes EC2 instances, covering instance type choice, Xen modes, SR-IOV and kernel tuning. The goal is near bare-metal performance in the cloud.

HN cites it as an example of workload-dependent performance tuning at scale and of Netflix's AWS practices.

Cloud, DevOps & reliabilitySoftware performance & optimizationOperating systems & kernels#ec2#netflix#kerneltuning#aws#linuxperformance

3 comments from Hacker News

@dijit2022 · in “Cloud Pricing Comparison: AWS vs. Azure vs. Google Cloud Platform in 2022”

it was actually 5x, my bad, but here's the references: Original info being mentioned as a rumour (2016): link Slides for confirmation by Greeg (2017): link Talk (2017): ▶ this video More discussion: link Original tweet has been deleted, but I have a screenshot here slide 9: link

CitesView on HN
@ignoramous2019 · in “The creation of the io.latency block I/O controller”

Well, most distributions choose saner defaults. For instance, RHEL/CentOS/AmazonLinux use noop io-scheduler by default for SSD based machines. Though, I get your point: for instance, the TCP keep-alive defaults aren't suitable for all kinds of workloads: link I guess, that's why performance tuning is an art form as it is workload dependant: ▶ this video

CitesView on HN
@scarface742018 · in “Show HN: Corral – A Serverless MapReduce Framework”

They use a lot of AWS services - not just virtual machines - First they use Ubuntu Linux - SES (Email) - ElasticSearch (AWS has their own managed version) - SQS (queueing system) - S3 (storage) -auto scaling Most of the optimization's they do are standard things at scale where they are tuning by measuring performance. ▶ this video and the slide deck from the presentation. link But that's even more of a reason to choose AWS, Netflix has open sourced dozens of tools specifically related to AWS. You get to take advantage of their tools and knowledge.

CitesView on HN
FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 202244:05

FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 2022

EuroBSDCon
28K views • 4 years ago
Why We Run FreeBSD current at Netflix – Drew Gallatin40:20

Why We Run FreeBSD current at Netflix – Drew Gallatin

OpenFest Bulgaria
21K views • 2 years ago
Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin47:42

Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin

EuroBSDCon
9K views • 5 years ago
AWS re:Invent 2018: Powering Next-Gen EC2 Instances: Deep Dive into the Nitro System (CMP303-R1)1:05:06

AWS re:Invent 2018: Powering Next-Gen EC2 Instances: Deep Dive into the Nitro System (CMP303-R1)

Amazon Web Services
57K views • 7 years ago
Velocity 2011:  Jon Jenkins, "Velocity Culture"15:14

Velocity 2011: Jon Jenkins, "Velocity Culture"

O'Reilly
52K views • 15 years ago
AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)53:43

AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)

Amazon Web Services
112K views • 7 years ago
Mastering Chaos - A Netflix Guide to Microservices53:14

Mastering Chaos - A Netflix Guide to Microservices

InfoQ
2.3M views • 9 years ago
"Performance Matters" by Emery Berger42:15

"Performance Matters" by Emery Berger

Strange Loop Conference
502K views • 7 years ago
AWS re:Invent 2018: [REPEAT 1] A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1)59:13

AWS re:Invent 2018: [REPEAT 1] A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1)

Amazon Web Services
72K views • 7 years ago
AWS re:Invent 2014: AWS Innovation at Scale with James Hamilton (SPOT301)47:51

AWS re:Invent 2014: AWS Innovation at Scale with James Hamilton (SPOT301)

Amazon Web Services
70K views • 11 years ago
Breaking the 1000ms Time to Glass Mobile Barrier45:49

Breaking the 1000ms Time to Glass Mobile Barrier

InfoQ
104K views • 13 years ago
React.js Conf 2015 - Beyond the DOM: How Netflix plans to enhance your television experience25:55

React.js Conf 2015 - Beyond the DOM: How Netflix plans to enhance your television experience

Meta Developers
26K views • 11 years ago
XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner49:16

XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner

Linux.conf.au 2012 -- Ballarat, Australia
29K views • 14 years ago
High Performance Web Sites and YSlow1:00:34

High Performance Web Sites and YSlow

Google TechTalks
90K views • 18 years ago
How Netflix Uses Java - 2025 Edition47:43

How Netflix Uses Java - 2025 Edition

Java
300K views • 1 year ago
CppCon 2015: Chandler Carruth "Tuning C++: Benchmarks, and CPUs, and Compilers! Oh My!"1:29:54

CppCon 2015: Chandler Carruth "Tuning C++: Benchmarks, and CPUs, and Compilers! Oh My!"

CppCon
188K views • 11 years ago
AWS re:Invent 2014 | (SPOT302) Under the Covers of AWS: Its Core Distributed Systems46:15

AWS re:Invent 2014 | (SPOT302) Under the Covers of AWS: Its Core Distributed Systems

Amazon Web Services
10K views • 11 years ago
How is this Website so fast!?13:39

How is this Website so fast!?

Wes Bos
2.4M views • 2 years ago
"Performance (Really) Matters" with Emery Berger1:04:48

"Performance (Really) Matters" with Emery Berger

Association for Computing Machinery (ACM)
7K views • 6 years ago
AWS re:Invent 2016: Tuesday Night Live with James Hamilton1:33:27

AWS re:Invent 2016: Tuesday Night Live with James Hamilton

Amazon Web Services
133K views • 9 years ago