Microsoft AI CEO Warns That 'Dangerous' and 'Seemingly Conscious' AI Models Could Arrive in the Next 2 Years: 'Deserves Our Immediate Attention' Microsoft AI CEO Mustafa Suleyman, 41, said that seemingly conscious AI could cause people to become disconnected from reality.

By Sherin Shibu Edited by Melissa Malamut

Key Takeaways

  • Microsoft’s AI CEO Mustafa Suleyman wrote in a personal essay that Seemingly Conscious AI (SCAI) could soon fray "social bonds and structures."
  • SCAI is artificial intelligence so advanced it can convince humans that it is capable of formulating its own thoughts and beliefs.
  • People could become attached to SCAI and advocate for its rights, Suleyman explained.

AI that appears to be conscious could arrive within the next few years, posing a "dangerous" threat to society, says one AI leader.

Microsoft AI CEO Mustafa Suleyman, 41, wrote in a personal essay published earlier this week that Seemingly Conscious AI (SCAI), which is artificial intelligence so advanced that it can convince humans that it's capable of formulating its own thoughts and beliefs, is only a few years away.

Related: Microsoft Claims Its AI Is Better Than Doctors at Diagnosing Patients, But 'You Definitely Still Need Your Physician'

Even though there is "zero evidence" that AI is conscious at the moment, it's "inevitable and unwelcome" that SCAI could appear within the next two to three years, Suleyman wrote.

Suleyman's "central worry" is that SCAI could appear to be empathetic and act with greater autonomy, which would lead users of SCAI to "start to believe in the illusion of AIs as conscious entities" to the point that they advocate for AI rights and even AI citizenship. This would mark a "dangerous turn" for society, where people become attached to AI and disconnected from reality.

"This development will be a dangerous turn in AI progress and deserves our immediate attention," Suleyman wrote in the essay. He added later that AI "disconnects people from reality, fraying fragile social bonds and structures, distorting pressing moral priorities."

Related: 'Plenty of Room for Startups': This Is Where Entrepreneurs Should Look for Business Opportunities in AI, According to Microsoft's AI CEO

Suleyman said that he was becoming "more and more concerned" about AI psychosis, or humans experiencing false beliefs, delusions, or paranoid feelings after prolonged interactions with AI chatbots. Examples of AI psychosis include users forming a romantic relationship with an AI chatbot or feeling like they have superpowers after interacting with it.

AI psychosis will apply to more than just individuals who are at risk of mental health issues, Suleyman predicted. He said that users have to "urgently" discuss "guardrails" around AI to protect people from the technology's negative effects.

Microsoft AI CEO Mustafa Suleyman. Photographer: David Ryder/Bloomberg via Getty Images

Suleyman became Microsoft's AI CEO last year after co-founding and running his own AI startup for two years called Inflection AI, per LinkedIn. Microsoft is the second most valuable company in the world, with a market capitalization of $3.78 trillion at the time of writing.

Related: Microsoft AI CEO Says Almost All Content on the Internet Is Fair Game for AI Training

Suleyman also co-founded DeepMind, an AI research and development company acquired by Google for around $600 million in 2014.

Suleyman isn't the first CEO to warn about AI's ill effects. In a talk at a Federal Reserve conference last month in Washington, D.C., OpenAI CEO Sam Altman said that "emotional overreliance" on ChatGPT keeps him up at night.

"People rely on ChatGPT too much," Altman said at the event. "That feels really bad to me."

Sherin Shibu

Entrepreneur Staff

News Reporter

Sherin Shibu is a business news reporter at Entrepreneur.com. She previously worked for PCMag, Business Insider, The Messenger, and ZDNET as a reporter and copyeditor. Her areas of coverage encompass tech, business, strategy, finance, and even space. She is a Columbia University graduate.

Want to be an Entrepreneur Leadership Network contributor? Apply now to join.

Science & Technology

Everyone's Trying to Build Flashy AI Tools — But Here's Where the Real Money Is Being Made

Here's why the next billion-dollar AI startups will solve boring, painful problems.

Business Ideas

70 Small Business Ideas to Start in 2025

We put together a list of the best, most profitable small business ideas for entrepreneurs to pursue in 2025.

Business News

Elon Musk Asked Mark Zuckerberg to Join OpenAI Buying Bid, According to Court Filings

Two summers ago, the billionaire CEOs were discussing locations for their cage fight.

Starting a Business

I Risked Everything to Build My Company. Four Years Later, Here's What I've Learned About Building Real, Lasting Success

Risking everything to build a company, this entrepreneur reveals unexpected truths about what it truly takes to achieve lasting success.

Business News

Coinbase's CEO Fired Software Engineers Who Didn't Adopt AI Tools: 'We're Leaning as Hard as We Can Into AI'

Software engineers at Coinbase were asked to explain to the CEO directly why they weren't using AI coding tools (on a Saturday). If they didn't have a good reason, they were fired.

Starting a Business

Restaurants Are Throwing Away Billions of Gallons of Water — This Startup Said Enough

A casual kitchen observation sparked Dylan Wolff's idea to tackle water waste in restaurants. His startup, CNSRV, saves water, cuts costs and improves food quality with a portable defrosting machine.