Futurists warning about the threats of AI are looking in the wrong place. Humanity is already facing an existential threat from an artificial intelligence we created hundreds of years ago. It’s called the Corporation.
Some of the leading thinkers of our time are unleashing a stream of warnings about the threat of artificial intelligence taking over from humans. Earlier this month, Stephen Hawking predicted it could be “the worst event in the history of our civilization” unless we find a way to control its development. Billionaire Elon Musk has formed a company to try to keep humans one step ahead of what he sees as an existential AI threat.
The scenario that terrifies them is that, in spite of the best intentions, we might create a force more powerful than all of humanity with a value system that doesn’t necessarily incorporate human welfare. Once it reaches a critical mass, this force could take over the world, control human activity, and essentially suck all life out of the earth while it optimizes for its own ends. Prominent futurist Nick Bostrom gives an example of a superintelligence designed with the goal of manufacturing paperclips that transforms the entire earth into one gigantic paperclip manufacturing facility.
These futurists are right to voice their concerns, but they’re missing the fact that humans have already created a force that is well on its way to devouring both humanity and the earth in just the way they fear. It’s called the Corporation.
When corporations were first formed back in the seventeenth century, their inventors—just like modern software engineers—acted with what they believed were good intentions. The first corporate charters were simply designed to limit an investor’s liability to the amount of their investment, thus encouraging them to finance risky expeditions to India and Southeast Asia. However, an unintended consequence soon emerged, known as moral hazard: with the potential upside greater than the downside, reckless behavior ensued, leading to a series of spectacular frauds and a market crash that resulted in corporations being temporarily banned in England in 1720.
Thomas Jefferson and other leaders of the United States, aware of the English experience, were deeply suspicious of corporations, giving them limited charters with tightly constrained powers. However, during the turmoil of the Civil War, industrialists took advantage of the disarray, leveraging widespread political corruption to expand their influence.