superintelligence

A panel from the Beneficial AI 2017 conference moderated by Max Tegmark, with Elon Musk, Stuart Russell, Kurzweil, Hassabis, Harris, Bostrom, Chalmers and others. They discuss likely outcomes of human-level AGI and what outcomes are desirable.

Robert Miles asks whether corporations can be thought of as artificial general superintelligences and how far the analogy holds. He argues the differences, such as being limited by employees' capabilities, matter for AI safety.

Isaac Arthur explains the Matrioshka Brain, a hypothetical computer or artificial mind powered by an entire star using nested shells. It covers how such megastructures relate to Dyson spheres and superintelligence.

A Computerphile video in which Rob Miles warns against assuming a general AI will think like a human. He uses the thought experiment of a stamp-collecting AI to show how a goal-driven system could pursue its aim with dangerous results.

Sam Harris argues in a TED talk that we will build superhuman AI and have not grappled with the risk of creating something that may treat us the way we treat ants. He makes a logical case for taking AI risk seriously.