BOSTON — Artificial intelligence (AI) is reshaping how we communicate, access information, and work, how income and status are distributed, and even how we wage war. Yet the public conversation remains narrowly focused on the competition between AI labs or on abstract debates about the technology’s capabilities. Almost no one is asking what purpose AI ought to serve, or whether our current mindset, institutions, and control mechanisms are capable of steering the technology toward broad-based improvements in human welfare.
It was therefore refreshing to see Pope Leo XIV weigh in on the issue with his first encyclical, which describes AI’s current trajectory as a profound threat to human dignity. As an economist who has long argued that technologically driven outcomes are matters of choice, not fate, I welcome his intervention.
Leo is ahead of most commentators in pointing out that “technology is never neutral, because it takes on the characteristics of those who devise, finance, regulate, and use it.” And yet, I worry that even he has not gone far enough on the most consequential question: What should AI be designed to do?
As Simon Johnson and I stress in our book "Power and Progress: Our Thousand-Year Struggle over Technology and Prosperity," there are multiple paths that a technology like AI can take, and each has far-reaching implications for society. For example, the Pope is right to question the current trajectory of AI in warfare and law enforcement. What was taboo only a few years ago — AI-driven mass surveillance, algorithms selecting targets for killing—has become routine.
With many in Silicon Valley urging the United States to reinforce its hard power through a new military-algorithmic complex, Leo cautions that “Any technology that facilitates attacks without seeing the face of human beings lowers the moral threshold of conflict.” The Pope then calls for “disarmament of AI” to free “it from the mentality of ‘armed’ competition, which today is not limited simply to the military context, but is also an economic and cognitive phenomenon.”
A more fundamental piece of wisdom underlies these specific concerns: technological progress is not necessarily moral progress. Just because something is technically feasible does not mean that it is good for humanity. Whether a technology is desirable depends on who controls it and on the ideology and interests that guide them.
Leo does hint at what I see as the most immediate risk, namely that “while AI promises to boost productivity by taking over mundane tasks, it frequently forces workers to adapt to the speed and demands of machines, rather than designing machines to work with those who work.” But the Pope stops short of questioning the prevailing AI design philosophy. The entire AI industry’s approach is centered on mimicking human capabilities and automating human tasks, with the goal of creating an “artificial general intelligence” that can do everything a person can.
This philosophy rests on the mistaken assumption that machine intelligence and human intelligence are fundamentally similar. Humans are “one-shot” learners. We form hypotheses from a few examples, simulate possibilities in our minds, and refine our understanding through a social process of trial and error. Hence, children learn language by imitating a few words, generalizing, and adjusting their speech based on how others respond. We are not very good at absorbing massive volumes of information or sifting through unstructured data for relevant patterns.
By contrast, AI models thrive on enormous training sets and excel at pattern recognition at scale, but they have yet to demonstrate genuine creativity. They have no experience of real-world embodiment, nor any capacity for trial-and-error learning through interactions with the physical and social world (except in a limited way when there are clear rewards for reinforcement learning in specific domains).
When two things are different, you should not—and typically cannot—use one to mimic the other. The results would be suboptimal. It would have been a colossal mistake if Phil Jackson, the legendary coach of the Chicago Bulls in the 1990s, had pushed Michael Jordan to mimic everything that Scottie Pippen and Dennis Rodman were doing. The team went from championship to championship precisely because these players worked together and complemented each other’s skills.
Source: Korea Times News
