The changes are coming in three phases: The current “AI Economy” is rapidly automating economic activities to increase productivity. The emergent “AI Military” is automating warfare and creating arms races to develop military drones, robot soldiers, swarm boats, and autonomous military vehicles. The future “AI Society” will expand legal and political institutions to regulate autonomous systems. Each phase introduces its own challenges.

Popular shows like “2001“, “Terminator”, “Her”, “Person of Interest”, “Transcendence”, “Ex Machina”, “Humans”, and “Extant” portray dystopian futures in which machines turn on us in various ways. Humanity has long been fascinated by the idea of breathing life into inanimate objects, but petrified of the consequences. The ancient myths of golems, tulpas, and genies explore this theme. In the last few years, rapid advances in AI and robotics are being met with increasing popular uneasiness. In response, researchers and technology CEOs are writing defensive articles that argue that nothing they are working on is dangerous.

But are there reasons to proceed cautiously? Of course there are! This is likely to be the largest technological transformation in human history. We must approach it carefully and deliberately and make choices with great care. Are fear and “doomsaying” useful responses? Of course not! We are building these systems. We can build them however we want as long as we have the scientific understanding and the will to do so. This is a time for resolve, not for fear. What we really should be railing against is bad and sloppy design.

A system’s goals may be chosen independently from its intelligence and can lead to either harm or good. Simplistic goals give rise to unintended drives that can be anti-social. But even “superintelligences” are limited by the laws of mathematics, physics, and cryptography. Mathematical proof can be used to constrain systems with a high confidence of safety. New cryptographic techniques can be used to create a trusted computation and communication infrastructure. Cryptocurrency technology can enable decentralized systems to cooperate without prior trust. The “Safe-AI Scaffolding Strategy” can leverage this infrastructure to create a path to human thriving.

Humanity’s greatest achievement has been a series of mechanisms that enable us to cooperate on an unprecedented scale. Our moral emotions, language, and cooperative social structures enabled us to work together in groups of about 150. Those mechanisms stopped being sufficient when agriculture allowed us to form much larger groups about 10,000 years ago. Humans then created money, free markets, laws, and governments that enabled us to expand cooperation to the scale of cities and countries. The internet, social media, and decentralized technologies are currently expanding cooperation to the whole of humanity. Our next challenge is to also extend it to our emerging autonomous technologies.