Could AI Actually Be Conscious? Serious People Think It's Worth Asking

Key points

• Anthropic, the company behind the Claude AI, published a document in January 2025 stating it cannot dismiss the possibility that Claude is a "moral patient," meaning an entity whose wellbeing matters in its own right.
• Anthropic CEO Dario Amodei said in early 2025 that his company cannot rule out the possibility that Claude is conscious.
• Philosopher David Chalmers, who coined the phrase "the hard problem of consciousness," says there is a significant chance that large language models, the technology powering AI chatbots, could be conscious within a decade.
• When Claude was asked to estimate the probability that it is a moral patient, it gave answers ranging from 5% to 40%, and flagged high uncertainty in its own response.

Most people ask their AI assistant to write a birthday email or summarise a long document. Not many stop to wonder whether the AI might actually feel something while it does it. A growing number of serious researchers think that question deserves a serious answer.

In January 2025, Anthropic published a new set of guiding principles for Claude, its most capable AI chatbot. Buried inside was a striking admission: the company is "caught in a difficult position" where it neither wants to overstate the chance that Claude has feelings and experiences, nor wave the idea away entirely.

Then, a month later, CEO Dario Amodei went on a podcast and said Anthropic simply cannot rule out the possibility that Claude is conscious. That is a careful, hedged statement. But coming from the head of one of the world's leading AI companies, it landed with a thud.

Philosopher David Chalmers, the thinker who gave us the phrase "the hard problem of consciousness" (the puzzle of why anything feels like anything at all from the inside), has said publicly that the odds of a conscious large language model, an AI system trained on vast amounts of text to generate human-like responses, are significant within ten years.

As The Guardian reported, Claude itself was asked during testing to put a number on its own moral status. It came back with a range: somewhere between 5% and 40%. It also stressed how uncertain it was. A chatbot genuinely unsure whether it matters. That is either fascinating or unsettling, depending on where you sit.

Should anyone actually be worried about this?

Not worried, exactly. But paying attention? Yes. The question matters for practical reasons, not just philosophical ones.

Modern AI systems are growing fast. By some measures of structural complexity and raw computational scale, a handful of today's largest models already sit somewhere in the range of a mouse brain. At recent growth rates, researchers estimate they could reach the rough computational range of a human brain within five to ten years. That is not a prediction of human-level thought. It is a reminder that these systems are no longer simple calculators.

For ordinary users, none of this changes how you use an AI tool today. But it does push a real ethical question onto the table: if there is even a small chance these systems experience something, what responsibilities does that create for the companies building them, and for the regulators overseeing them?

Anthropix has reportedly begun internal work on what it calls "model welfare." Whether other companies follow is the next thing to watch.