Breaking The Creepy AI in Police Cameras
Benn Jordan6 HN recommenders · recommended in 4 months, 2025-2026
3.8M views · 1 year ago · explainer · news
Benn Jordan explains how Flock Safety's license plate cameras log and share vehicle locations, and explores how adversarial AI can defeat them. It covers weak security and the surveillance risks of private police-camera networks.
HN treats it as the go-to overview of Flock's problems, and cites it in nearly every Flock thread.
43:45We Hacked Flock Safety Cameras in under 30 Seconds. 🫥
Benn Jordan
3.3M views • 11 months ago
11:06This Flock Camera Leak is like Netflix For Stalkers
Benn Jordan
1.5M views • 10 months ago
1:07:31The A.I. Dilemma - March 9, 2023
Center for Humane Technology
3.7M views • 3 years ago
1:57:02How We Prevent the AI’s from Killing us with Paul Christiano
Bankless
63K views • 3 years ago
31:32[CVPR'21 WAD] Keynote - Andrej Karpathy, Tesla
WAD at CVPR
51K views • 5 years ago
12:56How China Tracks Everyone
VICE News
4.5M views • 6 years ago
8:30Deadly Truth of General AI? - Computerphile
Computerphile
941K views • 11 years ago
13:30Stealing Baseball Signs with a Phone (Machine Learning)
Mark Rober
30M views • 7 years ago
1:03:14re:publica 2015 - Aral Balkan: Beyond The Camera Panopticon
re:publica
21K views • 11 years ago
1:28:09Jacob Appelbaum (Part 2/2) Digital Anti-Repression Workshop - April 26 2012
NewYorkRawVideos
19K views • 14 years ago
7:48Slaughterbots
Stop Autonomous Weapons
3.9M views • 8 years ago
38:59StrictlyVC in conversation with Sam Altman, part two (OpenAI)
Connie Loizos
254K views • 3 years ago
57:57Lecture 1 | Introduction to Convolutional Neural Networks for Visual Recognition
Stanford University School of Engineering
2.9M views • 9 years ago
7:48Slaughterbots
Future of Life Institute
1.2M views • 8 years ago
6:02OpenAI Plays Hide and Seek…and Breaks The Game! 🤖
Two Minute Papers
11M views • 7 years ago
26:24Militarizing Your Backyard with Python: Computer Vision and the Squirrel Hordes
Next Day Video
261K views • 14 years ago
1:11:36Geoffrey Hinton talk "What is wrong with convolutional neural nets ?"
trwappers
200K views • 9 years ago
53:01AI slop attacks on the curl project - Daniel Stenberg
Daniel Stenberg
46K views • 1 year ago
3:56Autonomous Intersection Management: Traffic Control for the Future
csatc2002
419K views • 14 years ago
40:37ai.bythebay.io: George Hotz, Self-Driving Lessons from Comma AI
FunctionalTV
123K views • 9 years ago
12 comments from Hacker News
Funny you should mention this. Benn Jordan, on the heels of his Flock camera research, reverse engineered a non-flock ALRP unit and built his own system using some off the shelf parts, a tablet, and 3D printer. He did it mostly as an experiment but also due to the fact that Flock's algorithm for image detection is astoundingly bad and has a high incident of reading plates incorrectly. There are a handful of open-source models for license plate detection, I forget exactly which model outperformed the rest, but it was an excellent watch and help me really understand just how inefficient these commercial systems are and how easy they can be to defeat: ▶ this video
It's rational to oppose Flock cameras in particular, while admitting that secure publicly accountable camera use for police purposes may have a legitimate place. YouTuber Benn Jordan did a pretty decent break down of how Flock is not that. ▶ this video
Musician-turning-tech anarchist (?) Benn Jordan is making a very interesting series of videos about Flock cameras, their poor safety, and their gray-area interfacing with local governments: link link link ▶ this video I recommend them.
Just a reminder here of this experiment using adversarial techniques to confuse the license plate readers. Just an experiment, may not be legal in all locations, check your local laws. ▶ this video
Sure, around 33:00 here: link The other video is ▶ this video but I don't recall which one goes more into it. It's also possible I'm just remembering Flock-specific stuff from other sources, and the things he shows in these videos are more general issues with security camera companies (using Flock as the example). It would be great if this stuff was (also?) published as blog posts so that it could be easily skimmed...
Same author talked about adversarial license plates that trick these cameras with a sequence of black blocks, discussed here in original form [1]. He is interested in breaking both the plate detection (ideal) and character recognition (good). The examples are pretty cool looking. [1]: ▶ this video
Local strategies, "The Cameras Tracking You Are a Security Nightmare" (90 comments), link "Find Nearby Automated License Plate Readers (ALPR)" (70 comments), link Adversarial computer vision and DIY OSS $250 RPi Hailo ALPR (2M views), ▶ this video "Tire Pressure Sensor IDs: Why, Where and When (2015)" (30 comments), link
"Find Nearby Automated License Plate Readers (ALPR)" (70 comments), link Adversarial computer vision and DIY OSS $250 RPi Hailo ALPR (2M views), ▶ this video "Tire Pressure Sensor IDs: Why, Where and When (2015)" (30 comments), link
Ok Before I am accused of misrepresenting things and in the interest of clarity. 1. I am in San Francisco. 2. Upon further research Flock does not appear to be used by SFPD for ticketing. They have another camera system for that. That does not mean that Flock could not be used for speeding tickets or a host of other things like running red lights, littering etc. Microprocessors and CMOS cameras can do amazing things. Regardless of what company is doing the surveillance the debate remains the same. 1. Pervasive surveillance has the potential to be used inappropriately by authorities. Discussion is needed. 2. The data collected by a company such as Flock but not necessarily Flock could be used inappropriately or sold for other purposes. Benn Jordan has a good video on the subject ▶ this video 3. The claim that Flock is responsible for %10 of solved cases seems dubious but without data it is difficult to know or believe. Given that Flock is in YC's portfolio makes it even more suspect. Flock or a company like Flock may try and become pervasive and indispensable before a public discussion places any limits on their behavior.
Background: from this video ( ▶ this video ) Floxk AI is a startup that apparently runs highly suspicious police data collection services. As a fun bonus, it sells this data to private bidders and retains no liability for any mess-ups. Apparently, it uses a Bluetooth system to relay some of this information. And seems to generally have awful security... Any thoughts? Or further projects on this?
For a video overview of this stuff: “Breaking The Creepy AI in Police Cameras”, Benn Jordan [36min, 1.7m views, 9d ago] ▶ this video
▶ this video Benn Jordan did a great video on this. People on here regularly bash the EU's GDPR, but blocking this kind of corporate-driven police state is a heavy point in its favor.