HackerTube
HomeLongsLikedHistoryWatch laterCategoriesPlaylistsSettings

ZFS Native Encryption by Tom Caputi

OpenZFS2 HN recommenders · recommended in 2 months, 2016-2022
YouTube
14K views · 10 years ago · talk · dated

Tom Caputi presents the design of native encryption for ZFS at the OpenZFS Developer Summit, including design decisions and how authentication uses checksum fields.

Recommended whenever ZFS encryption comes up as the authoritative explanation of how it was added and its trade-offs at scale.

Databases & storageCryptography#zfs#encryption#filesystems#openzfs#storage

5 comments from Hacker News

@drbawb2022 · in “Apple advances user security with powerful new data protections”

The problem is that a stream cipher is going to have some per-object uniqueness (a salt, IV, etc.), so by design even if you feed it related input blocks you will get different output blocks. This is, of course, antithetical to deduplication: so you need to check/store the hash of the input before it goes through the cipher. The presentation about ZFS' native encryption[1] covers many of these sorts of trade-offs necessary to do full-disk encryption at scale. [1]: ▶ this video

RecommendsView on HN
@wspeirs2017 · in “Playing with ZFS encryption on Linux”

I work with Tom at Datto. He presented all of his design decisions at the OpenZFS developer conference here: link Slides: link Video: ▶ this video

CitesView on HN
@dchest2017 · in “TFS: A file system built for performance, space efficiency, and scalability”

On the contrary, it makes it suitable for file systems! File systems are not block devices, they are data structures on top of block devices — it's the job of these data structures to keep stuff, such as data, inodes, and... keys, and IVs, and MACs, checksums, etc. TFS uses Speck in XEX mode (edit: I just realized you're the author, so you already know that :). tptacek wrote a nice post about it: link and I quote: "If you’re encrypting a filesystem and not disk blocks, still don’t use XTS! Filesystems have format-awareness and flexibility. Filesystems can do a much better job of encrypting a disk than simulated hardware encryption can." Edit: check out this presentation on how encryption was bolted on ZFS: ▶ this video (slides: link ) It's not perfect, but it provides data authentication by reusing checksum fields for storing MACs. Edit 2: also check out bcachefs encryption design doc: link (also not perfect, but uses proper AEAD — ChaCha20-Poly1305. I sent some questions and suggestions to the author, but received no reply :/)

RecommendsView on HN
@zxv2017 · in “Silent Data Corruption Is Real”

Native ZFS encryption may become available soon. It is pending code review: link There was a presentation of this by Tom Caputi at the most recent OpenZFS Developer Summit. Slides: link Video: ▶ this video Conference: link

CitesView on HN
@RJIb8RBYxzAMX9u2016 · in “FreeBSD 11.0 Now Available”

This is still geli+zfs, and not native zfs encryption that was recently presented in OpenZFS Developer Summit [0]. [0] ▶ this video

CitesView on HN
Behind the Scenes of iOS Security51:32

Behind the Scenes of iOS Security

Black Hat
127K views • 10 years ago
Satoshi Has No Clothes: Failures in On-Chain Privacy by Ian Miers (Devcon4)24:20

Satoshi Has No Clothes: Failures in On-Chain Privacy by Ian Miers (Devcon4)

Ethereum Foundation
5K views • 7 years ago
ZFS: The Last Word in File Systems Part 11:01:27

ZFS: The Last Word in File Systems Part 1

Deirdré Straughan
19K views • 14 years ago
OpenZFS Office Hours with Matt Ahrens1:25:25

OpenZFS Office Hours with Matt Ahrens

OpenZFS
0 views • 13 years ago
June 2021 FreeBSD Developer Summit: Raid-Z Expansion35:31

June 2021 FreeBSD Developer Summit: Raid-Z Expansion

FreeBSD
4K views • 5 years ago
LibreSSL with Bob Beck1:05:45

LibreSSL with Bob Beck

Jason Tubnor
25K views • 12 years ago
XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner49:16

XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner

Linux.conf.au 2012 -- Ballarat, Australia
29K views • 14 years ago
Scaling ZFS for NVMe - Allan Jude - EuroBSDcon 202246:00

Scaling ZFS for NVMe - Allan Jude - EuroBSDcon 2022

EuroBSDCon
14K views • 4 years ago
LibreSSL: The first 30 days, and what the Future Holds1:05:51

LibreSSL: The first 30 days, and what the Future Holds

Andrea Ross
5K views • 12 years ago
Behind the scenes of iOS and Mac Security44:29

Behind the scenes of iOS and Mac Security

Black Hat
36K views • 6 years ago
Lucas Cavalcanti & Edward Wible - Exploring four hidden superpowers of Datomic40:42

Lucas Cavalcanti & Edward Wible - Exploring four hidden superpowers of Datomic

ClojureTV
29K views • 11 years ago
BlackHat USA 2011: SSL And The Future Of Authenticity48:02

BlackHat USA 2011: SSL And The Future Of Authenticity

Christiaan008
95K views • 15 years ago
Theory and Practice of Cryptography1:32:08

Theory and Practice of Cryptography

Google TechTalks
73K views • 18 years ago
seL4 Is Free – What Does This Mean For You?49:45

seL4 Is Free – What Does This Mean For You?

Linux.conf.au 2015 -- Auckland, New Zealand
10K views • 11 years ago
Advanced Topics in Programming Languages: A Lock-Free Hash Table58:36

Advanced Topics in Programming Languages: A Lock-Free Hash Table

GoogleTalksArchive
29K views • 14 years ago
An Introduction to SQLite51:02

An Introduction to SQLite

Google TechTalks
80K views • 19 years ago
DEF CON 19 - Moxie Marlinspike - SSL And The Future Of Authenticity46:22

DEF CON 19 - Moxie Marlinspike - SSL And The Future Of Authenticity

DEFCONConference
11K views • 13 years ago
Rust at speed — building a fast concurrent database52:54

Rust at speed — building a fast concurrent database

Jon Gjengset
225K views • 7 years ago
Filesystem in Rust - Kent Overstreet35:16

Filesystem in Rust - Kent Overstreet

The Linux Foundation
124K views • 2 years ago
Lecture 7: Introduction to Galois Fields for the AES by Christof Paar1:30:50

Lecture 7: Introduction to Galois Fields for the AES by Christof Paar

Introduction to Cryptography by Christof Paar
278K views • 12 years ago