What is in a Lucene index? Adrien Grand, Software Engineer, Elasticsearch
LuceneSolrRevolution3 HN recommenders · recommended in 3 months, 2019-2020
80K views · 12 years ago · talk · evergreen
Elasticsearch engineer and Lucene committer Adrien Grand explains the design decisions inside a Lucene index and what problems it can and cannot solve. The talk goes into how Lucene stores data for fast search and analytics.
HN recommends it as an instructive, easy-to-follow look at Lucene internals from a core committer.
50:31How Modern SQL Databases Come up with Algorithms that You Would Have Never Dreamed Of by Lukas Eder
Devoxx
55K views • 9 years ago
59:56AWS re:Invent 2018: Amazon DynamoDB Deep Dive: Advanced Design Patterns for DynamoDB (DAT401)
Amazon Web Services
468K views • 7 years ago
54:54Breakout Session Presented by Dan Robinson of Heap at PGConf Silicon Valley 2015
Citus Data
14K views • 10 years ago
53:43AWS re:Invent 2018: Amazon DynamoDB Under the Hood: How We Built a Hyper-Scale Database (DAT321)
Amazon Web Services
112K views • 7 years ago
![AWS re:Invent 2019: [REPEAT 1] Amazon DynamoDB deep dive: Advanced design patterns (DAT403-R1)](https://i.ytimg.com/vi/6yqfmXiZTlM/hq2.jpg)
59:13AWS re:Invent 2019: [REPEAT 1] Amazon DynamoDB deep dive: Advanced design patterns (DAT403-R1)
AWS Events
115K views • 6 years ago
54:52Introduction to NoSQL • Martin Fowler • GOTO 2012
GOTO Conferences
1M views • 13 years ago
1:06:24Rich Hickey: Deconstructing the Database
InfoQ
106K views • 14 years ago
31:44The Value of Values with Rich Hickey
InfoQ
145K views • 14 years ago
42:31"Datafun: a functional query language" by Michael Arntzenius
Strange Loop Conference
9K views • 9 years ago
4:57Rich Hickey rants about HttpServletRequest in 1080p: Death By Specificity from Clojure Made Simple
Fred Overflow
43K views • 6 years ago
25:39H3: Tiling the Earth with Hexagons
Uber Engineering
53K views • 8 years ago
1:00:31BetrFS: A Right-Optimized Write-Optimized File System
Microsoft Research
3K views • 10 years ago
51:02An Introduction to SQLite
Google TechTalks
80K views • 19 years ago
49:16XFS: Recent and Future Adventures in Filesystem Scalability - Dave Chinner
Linux.conf.au 2012 -- Ballarat, Australia
29K views • 14 years ago
52:54Rust at speed — building a fast concurrent database
Jon Gjengset
225K views • 7 years ago
58:36Advanced Topics in Programming Languages: A Lock-Free Hash Table
GoogleTalksArchive
29K views • 14 years ago
11:32Depth-first search in APL
Dyalog
11K views • 12 years ago
39:15The Maximal Graph - Wilker Silva
ClojureTV
8K views • 6 years ago
1:07:41Modern Dictionaries by Raymond Hettinger
SF Python
150K views • 9 years ago
30:50Why Google Stores Billions of Lines of Code in a Single Repository
@Scale
317K views • 11 years ago
3 comments from Hacker News
This is excellent. I was recently reviewing Lucene concepts and found this video really good: ▶ this video Also this site has a series of Lucene articles that are pretty nice. The one on Term Vectors in particular: link Based on some quick research it seems like Lucene is already using a sorted skip data structure for the posting list, so I wonder why they had to do a custom implementation? Perhaps it has to do with their custom Document ID scheme and how they want to preserve order in the Posting List being different from the default behavior. It also sounds like searchers are searching on indexes as they're being written, and there is some custom coordination around visibility, which might require diverging from Lucene default behavior. Either way, pretty impressive!
I can super highly recommend talks by Adrien Grand on Lucene and Elasticsearch. They are super instructive yet easy to follow. ▶ this video link
This is extremely high level. A nice view of how lucene internals work by core committer Adrien Grand: link ▶ this video