AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)
Amazon Web ServicesCited 3× on HN, 2018-2022
18K views · 8 years ago · talk · dated
A Netflix performance engineer presents how Netflix tunes EC2 instances, covering instance type choice, Xen modes, SR-IOV and kernel tuning. The goal is near bare-metal performance in the cloud.
HN cites it as an example of workload-dependent performance tuning at scale and of Netflix's AWS practices.
44:05FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 2022
EuroBSDCon
28K views • 4 years ago
40:20Why We Run FreeBSD current at Netflix – Drew Gallatin
OpenFest Bulgaria
21K views • 2 years ago
47:42Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin
EuroBSDCon
9K views • 5 years ago
1:05:06AWS re:Invent 2018: Powering Next-Gen EC2 Instances: Deep Dive into the Nitro System (CMP303-R1)
Amazon Web Services
57K views • 7 years ago
15:14Velocity 2011: Jon Jenkins, "Velocity Culture"
O'Reilly
52K views • 15 years ago
53:43AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Amazon Web Services
112K views • 7 years ago
53:14Mastering Chaos - A Netflix Guide to Microservices
InfoQ
2.3M views • 9 years ago
42:15"Performance Matters" by Emery Berger
Strange Loop Conference
502K views • 7 years ago
59:13AWS re:Invent 2018: [REPEAT 1] A Serverless Journey: AWS Lambda Under the Hood (SRV409-R1)
Amazon Web Services
72K views • 7 years ago
47:51AWS re:Invent 2014: AWS Innovation at Scale with James Hamilton (SPOT301)
Amazon Web Services
70K views • 11 years ago
45:49Breaking the 1000ms Time to Glass Mobile Barrier
InfoQ
104K views • 13 years ago
25:55React.js Conf 2015 - Beyond the DOM: How Netflix plans to enhance your television experience
Meta Developers
26K views • 11 years ago
49:16XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner
Linux.conf.au 2012 -- Ballarat, Australia
29K views • 14 years ago
1:00:34High Performance Web Sites and YSlow
Google TechTalks
90K views • 18 years ago
47:43How Netflix Uses Java - 2025 Edition
Java
300K views • 1 year ago
1:29:54CppCon 2015: Chandler Carruth "Tuning C++: Benchmarks, and CPUs, and Compilers! Oh My!"
CppCon
188K views • 11 years ago
46:15AWS re:Invent 2014 | (SPOT302) Under the Covers of AWS: Its Core Distributed Systems
Amazon Web Services
10K views • 11 years ago
13:39How is this Website so fast!?
Wes Bos
2.4M views • 2 years ago
1:04:48"Performance (Really) Matters" with Emery Berger
Association for Computing Machinery (ACM)
7K views • 6 years ago
1:33:27AWS re:Invent 2016: Tuesday Night Live with James Hamilton
Amazon Web Services
133K views • 9 years ago
3 comments from Hacker News
it was actually 5x, my bad, but here's the references: Original info being mentioned as a rumour (2016): link Slides for confirmation by Greeg (2017): link Talk (2017): ▶ this video More discussion: link Original tweet has been deleted, but I have a screenshot here slide 9: link
Well, most distributions choose saner defaults. For instance, RHEL/CentOS/AmazonLinux use noop io-scheduler by default for SSD based machines. Though, I get your point: for instance, the TCP keep-alive defaults aren't suitable for all kinds of workloads: link I guess, that's why performance tuning is an art form as it is workload dependant: ▶ this video
They use a lot of AWS services - not just virtual machines - First they use Ubuntu Linux - SES (Email) - ElasticSearch (AWS has their own managed version) - SQS (queueing system) - S3 (storage) -auto scaling Most of the optimization's they do are standard things at scale where they are tuning by measuring performance. ▶ this video and the slide deck from the presentation. link But that's even more of a reason to choose AWS, Netflix has open sourced dozens of tools specifically related to AWS. You get to take advantage of their tools and knowledge.