HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

Serving Netflix Video at 400Gbps on FreeBSD by Drew Gallatin

EuroBSDConCited 4× on HN, 2021-2024
YouTube
9K views · 5 years ago · talk · dated

Netflix engineer Drew Gallatin explains how Netflix serves TLS-encrypted video at 400Gb/s from a single FreeBSD server. He covers NUMA, kernel TLS, hardware TLS offload and the memory bandwidth and PCIe bottlenecks they hit.

HN cites it as a prime example of FreeBSD tuned for extreme network performance at massive scale.

Networking & internet infrastructureOperating systems & kernelsSoftware performance & optimization#freebsd#netflix#ktls#numa#400gbps

4 comments from Hacker News

@voytec2024 · in “FreeBSD 13.4-Release”

Your comment suggests that FreeBSD is a thing of a past and no longer capable of "quality networking", due to poor WiFi support. I can only agree with the poor WiFi support part. But WiFi is by no means something you can judge networking stack dedicated for servers. FreeBSD was never designed for consumer hardware networking. There were a few "desktop distros" but all have more or less died, and the few FreeBSD-based "storage distros" moved to Linux after FreeBSD changed its upstream for ZFS. And I'm saying this as someone who made a lot of effort to use FreeBSD on laptop over the years, and a current user of 15.0-CURRENT on ThinkPad. But FreeBSD was and is THE choice for high-bandwidth wired networking. Netflix is both an early adopter and an active contributor to FreeBSD's networking codebase. They hack FreeBSD[0] to achieve cool numbers over and over[1][2]. Intel's device mentioned by you - AX200 - works "fine" on my ThinkPad, for a few months now. The device was on supported hardware list for more than a year prior, but the actual driver wasn't covering all vendor/device id pairs (different flavors of hardware or behavior all known as "the same" chip; this is a major problem with consumer devies since chip outages started). That said, by "fine" I mean that I can use the card and finally can connect to 5GHz networks and avoid disruptions related to 2.4GHz congestion. But FreeBSD is still incapable of utilizing speeds offered by modern WiFi specifications. Even with 5GHz co

CitesView on HN
@qwertox2022 · in “Serving Netflix Video Traffic at 800Gb/s and Beyond [pdf]”

Discussion of the same presentation 11 months ago, when the title was 400GB/s. link This was the video which was posted back then alongside the slides: ▶ this video

CitesView on HN
@breakfastduck2022 · in “From macOS to FreeBSD”

I'd say being actively used to run the largest streaming service on the planet makes you pretty relevant. ▶ this video

CitesView on HN
@drewg1232021 · in “NUMA Siloing in the FreeBSD Network Stack (2019) [pdf]”

This is my EuroBSDcon talk from 2 years ago. The more recent one (about getting to 400G) is up now at ▶ this video

CitesView on HN
FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 202244:05

FreeBSD optimizations used by Netflix serving at 800Gb/s - Drew Gallatin - EuroBSDcon 2022

EuroBSDCon
28K views • 4 years ago
Why We Run FreeBSD current at Netflix – Drew Gallatin40:20

Why We Run FreeBSD current at Netflix – Drew Gallatin

OpenFest Bulgaria
21K views • 2 years ago
NYCBSDCon 2014: Serving one-third of the Internet via FreeBSD1:01:39

NYCBSDCon 2014: Serving one-third of the Internet via FreeBSD

BSDTV
14K views • 12 years ago
Why did Netflix use NGINX and FreeBSD to build their own CDN? by Gleb Smirnoff45:42

Why did Netflix use NGINX and FreeBSD to build their own CDN? by Gleb Smirnoff

NGINX
40K views • 11 years ago
AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)56:55

AWS re:Invent 2017: How Netflix Tunes Amazon EC2 Instances for Performance (CMP325)

Amazon Web Services
18K views • 8 years ago
Breaking the 1000ms Time to Glass Mobile Barrier45:49

Breaking the 1000ms Time to Glass Mobile Barrier

InfoQ
104K views • 13 years ago
Scaling ZFS for NVMe - Allan Jude - EuroBSDcon 202246:00

Scaling ZFS for NVMe - Allan Jude - EuroBSDcon 2022

EuroBSDCon
14K views • 4 years ago
Peter Rizun, Andrew Stone -- 1 GB Block Tests -- Scaling Bitcoin Stanford.27:08

Peter Rizun, Andrew Stone -- 1 GB Block Tests -- Scaling Bitcoin Stanford.

OnChain Scaling
12K views • 8 years ago
"NTFS really isn't that bad" - Robert Collins (LCA 2020)48:04

"NTFS really isn't that bad" - Robert Collins (LCA 2020)

linux.conf.au
161K views • 6 years ago
RIP Windows: Linux GPU Gaming Benchmarks on Bazzite48:13

RIP Windows: Linux GPU Gaming Benchmarks on Bazzite

Gamers Nexus
1.1M views • 11 months ago
Putting Google's Network to work for You7:06

Putting Google's Network to work for You

Google for Developers
23K views • 12 years ago
36C3 -  A systematic evaluation of OpenBSD's mitigations53:02

36C3 - A systematic evaluation of OpenBSD's mitigations

media.ccc.de
18K views • 6 years ago
AWS re:Invent 2015 | (NET403) Another Day, Another Billion Packets42:26

AWS re:Invent 2015 | (NET403) Another Day, Another Billion Packets

Amazon Web Services
55K views • 11 years ago
High Volume, Bandwidth Heavy Infrastructure On The Cheap - Kyle Drake46:23

High Volume, Bandwidth Heavy Infrastructure On The Cheap - Kyle Drake

PDX Node
1K views • 9 years ago
Massscanning the Internet - Defcon 22 (2014)48:47

Massscanning the Internet - Defcon 22 (2014)

vissago
109K views • 12 years ago
8 Frames in 16ms: Rollback Networking in Mortal Kombat and Injustice 259:38

8 Frames in 16ms: Rollback Networking in Mortal Kombat and Injustice 2

GDC Festival of Gaming
94K views • 7 years ago
Flex 170 GPU from Intel - Subscription Free GPU Accelerated VDI on Proxmox 8.119:25

Flex 170 GPU from Intel - Subscription Free GPU Accelerated VDI on Proxmox 8.1

Level1Techs
176K views • 2 years ago
June 2021 FreeBSD Developer Summit: Raid-Z Expansion35:31

June 2021 FreeBSD Developer Summit: Raid-Z Expansion

FreeBSD
4K views • 5 years ago
Rick Reed - WhatsApp: Half a billion unsuspecting FreeBSD users54:14

Rick Reed - WhatsApp: Half a billion unsuspecting FreeBSD users

iX
31K views • 11 years ago
DEF CON 19 - Artem Dinaburg - Bit-squatting: DNS Hijacking Without Exploitation45:14

DEF CON 19 - Artem Dinaburg - Bit-squatting: DNS Hijacking Without Exploitation

DEFCONConference
4K views • 13 years ago