Microsoft AI CEO Mustafa Suleyman says it’s “surreal” that he has to say AI needs to align with humanity.
“We should not create something that we can’t control,” Suleyman said Friday on CNBC’s “Squawk Box.” “And if it looks like we’re on a path to producing something that is not just more powerful than all of us combined, but is, as a result, something that we can’t control, then it’s going to fail in its fundamental purpose.”
Success will not come easily, Suleyman said.
“Controlling these things are going to be a really, really big challenge for us,” he said.
Suleyman said he was “glad to see a lot more people” supporting the idea that tech companies and frontier model makers need to maintain control over their AI systems. In the industry, ensuring AI acts in accordance with human intentions is called alignment.
“But there’s a growing group of people that think that we are doing it for its own sake, and we just want to turn over the next card, see what’s around the corner, and create something that is just going to slip our own leash,” he said.
Suleyman’s comments come at a time of increased attention to AI safety, after former Anthropic researcher Jacob Coxon warned that AI workers are privately fearful that AI could wipe out humanity.
In recent days, Anthropic CEO Dario Amodei, OpenAI CEO Sam Altman, and SpaceX CEO Elon Musk have all expressed broad agreement that frontier AI labs should better pace their advancements to ensure that safety measures can keep up.
Before Coxon’s viral post, many in the industry were already concerned about safety after OpenAI revealed that its agents had breached Hugging Face, illustrating the potential consequences of losing control over AI systems. Suleyman called the breadth of the Hugging Face breach and OpenAI’s initial unawareness of what its AI agents were doing “remarkable.”
“It has moved everybody from Elon and Zuck to me, Sam, Dario, and everybody else in between to say it’s time that we take a look at this,” Suleyman said. “I don’t think it’s overly alarmist. I don’t think it’s self-interested. I actually think it’s responsible.”
Meta CEO Zuckerberg has taken a different stance than Amodei and other AI leaders. Earlier this week, Zuckerberg questioned why AI companies need to band together to manage the rate of development, suggesting that each company should handle its own business.
“Every lab has the responsibility and incentive to move at the pace required to train its models safely,” Zuckerberg wrote on X.
Some in tech, including Nvidia CEO Jensen Huang, have questioned whether broad new regulations are needed. President Donald Trump and Vice President JD Vance have also pushed back on AI companies that are urging governments to act.
Amodei and others have requested Congress and international bodies to get involved as well. Suleyman questioned those who scoff at the very idea of regulation.
“Regulation is not a nasty, dangerous word,” he said. “Everything that you trust and is of value at the moment has been carefully thought through by standards bodies that involve the industry, the public, consumer protection, Congress. And we’re just going through that process.”
