Autonomous Testing and the Future of Software Development - Will Wilson

Antithesis | Software Engineers (Kernel / Systems / Infra / Fullstack) | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. See Will's talk ( ▶ this video ) for the ideas that underpin our approach or read the Simulation Testing section of link . We have a growing base of customers and great community buy-in. Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Check out our blog for an examples of what we recently launched, e.g.: link Apply at link . We're also hiring for professional services roles. Feel free to ask about those, too.

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Really unique product with a super-strong founding team! I’m not a working with them, but am cheering from the sidelines. One of the founders gives a great talk here: ▶ this video

Congratulations to the Antithesis team! I actually interviewed with them when they were just starting, and outside of being very technically proficient, they are also a great group of folks. They flew my wife and I out to DC on what happened to be the coldest day of the year that year (we are from California) so we didn’t end up following through but I’d like to think there is an alternative me out there in the multiverse hacking away on this stuff. I highly recommend Will’s talks (which I believe he links in the blog post): link ▶ this video

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We work together onsite in a highly collaborative environment. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. (But if you love Nix...we should talk.) What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

FoundationDB is a truly one-of-a-kind bit of technology. Others have already linked to the testing methodology that allows them to run orders of magnitude more database hours in test than have run in production: link A less known but also great talk is the follow which talked about what the a few of the team worked on next, effectively trying to generalize the methodology to any computer program: ▶ this video I liken the approach to being able to fuzz the execution space of the program, not just the inputs.

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We work together onsite in a highly collaborative environment. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. (But if you love Nix...we should talk.) What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Antithesis | Software Engineers, ML Research Scientists | Northern VA | ONSITE | link Antithesis is using deterministic simulation, fuzzing, and novel ML techniques to improve software testing and increase developer velocity. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Antithesis | DC / Northern Virginia | onsite | link Antithesis is using deterministic simulation, fuzzing, and ML to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. Incredible, cohesive team with the hardest and most interesting problems to solve. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Antithesis | Senior Software Engineers | DC / Northern Virginia | ONSITE | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and ML to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. Apply at link (Don't worry too much about which role you choose. We're looking for engineers who are ready to learn, not those that know everything already!) We're also hiring for professional services roles. Feel free to ask about those.

Antithesis | DC / Northern Virginia | Software Engineers | ONSITE | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. Apply at link (but don't worry too much about which role you choose). We're also hiring for professional services roles. Feel free to ask about those!

Antithesis | DC / Northern Virginia | ONSITE | Software Engineers | FULL-TIME Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. jobs@antithesis.com We're also hiring for professional services roles. Feel free to ask about those!

Antithesis | DC / Northern Virginia | Onsite | Software Engineers | FULL-TIME | $100k-$150k + equity Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders and VP Eng are FoundationDB veterans. For an idea of what we're doing, see Will's talk here: ▶ this video or read the Simulation Testing section of link . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, get things done, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. jobs@antithesis.com We're also hiring for professional services roles. Feel free to ask about those!

I very much agree with this sentiment, but it is difficult to endorse this line of reasoning without offering a better alternative. As folks have pointed out in other comments, there are other values to tests in the broad sense that the author doesn’t address. That said, if you are interested in improving the state of testing, I would encourage you to listen to Will Wilson’s excellent talk on the subject of Autonomous Testing: ▶ this video Indeed, FoundationDB (which Wilson worked on) has a very unique and sophisticated approach to testing that seems to have served them very well.

Antithesis | DC / Northern Virginia | Onsite | Software Engineers | FULL-TIME | $100k-$150k + equity Antithesis is using deterministic simulation, fuzzing, and AI to improve software testing. The founders are two FoundationDB veterans; for an idea of what we're doing, see my talk here: ▶ this video . Fully funded medical, dental, and vision insurance. Unlimited vacation (with mandatory MINIMUM vacation time). Flexible hours. We're doing things nobody has done before, so we don't need familiarity with any particular language, framework, domain, or anything like that. Don't care. What we do care about: you're smart, a joy to work with, and are comfortable dealing with open-ended/poorly-defined problems. If that sounds like you, send us a brief (one to two paragraph) explanation of an interesting technical challenge you've faced. Feel free to send a resume too. jobs@antithesis.com We're also hiring for professional services roles and an operations manager. Feel free to ask about those!

FWIW I think that DOES happen, but it happens on the "wrong" computers! Google has at least tens of thousands of cores running builds and tests 24/7. And they're utilized to the hilt. Travis and other continuous build services do essentially the same thing, although I don't know how many cores they have running. From a larger perspective, Github does significant things "in the background" to make me more productive, like producing statistics about all the projects and making them searchable. (Admittedly, it could do MUCH more.) I think part of the problem is that it's cheaper to use "the cloud" than to figure out how to use the developer's own machine! There is a lot of heterogeneity in developer machines, and all the system administration overhead isn't worth it. And there's also networking latency. So it's easiest to just use a homogeneous cloud like Google's data centers or AWS. There's also stuff like link which improves productivity. I do think that most software will be tested 24/7 by computers in the future. Foundation DB already does this: "Testing Distributed Systems w/ Deterministic Simulation" by Will Wilson link Autonomous Testing and the Future of Software Development - Will Wilson ▶ this video They have sort of an "adversarial" development model where the tests are "expected" to find bugs that programmers introduce. So it's basically like having an oracle you can consult for correctness, which is a productivity aid. Not exactly, but that would be the ideal.