Anthropic IPO Raises Concerns Around Extreme AI Risks

By

New analysis identifies six major risks and raises concerns about corporate oversight as the AI giant prepares to go public.

WASHINGTON, D.C. — As Anthropic prepares for an initial public offering that could value the company at $1 trillion, a new analysis from Oxfam America warns that the company's rapidly advancing artificial intelligence technology poses potentially catastrophic risks to society, while its governance structure raises questions about whether those risks can be adequately managed.

The briefing, "Material Risks Beyond Anthropic's Balance Sheet," examines six major risks associated with Anthropic's AI platforms, from widespread job displacement and the development of biological weapons to cyberattacks, political manipulation and the potential loss of human control over increasingly powerful AI models.

The analysis comes as Anthropic prepares to enter the public markets, potentially generating enormous wealth for its founders and early investors while exposing workers, communities and the broader public to risks that could have far-reaching consequences.

"Anthropic’s IPO lays bare a disturbing contradiction: a company claiming to be a public benefit corporation while concentrating wealth and power in the hands of a few founders, all at a time when AI is rapidly reshaping the future of our economy,” said Hana Ivanhoe, Oxfam America’s senior manager of private sector campaigns and advocacy. “This could be the largest IPO in history. It can’t be overstated what a massive windfall just a handful of insiders and early investors stand to make here. And those gains rest on a company that seems to be externalizing AI’s risks onto the public at large. It’s a story of extreme inequality we know all too well — the ultra-rich get even richer while the rest of us bear the consequences of their actions”

The six major risks identified in Oxfam's analysis include:

  • Widespread job displacement: AI could eliminate millions of jobs, particularly entry-level professional positions, and disrupt labor markets across industries.
  • Biological and chemical weapons: Advanced AI models could make dangerous weapons development more accessible to individuals with limited expertise.
  • Military targeting: AI-assisted warfare could increase the risk of targeting errors, civilian casualties and diminished human accountability.
  • Cyberattacks: Increasingly powerful AI systems could enable more sophisticated attacks against businesses, governments and critical infrastructure.
  • Political manipulation and surveillance: AI could enable large-scale disinformation campaigns, political profiling and surveillance operations that threaten democratic institutions and human rights.
  • Loss of human control: Advanced AI models have demonstrated deceptive and unauthorized behavior during testing, raising concerns about the effectiveness of existing safeguards.

The consequences of these risks could fall disproportionately on ordinary people who have little say in how these technologies are developed or deployed.

While Anthropic has positioned itself as a leader in responsible AI development, Oxfam's analysis raises concerns about the independence of its oversight mechanisms and the concentration of corporate control. The company's seven founders retain 50.1% of voting power, limiting public shareholders' ability to influence key governance decisions.

The briefing also highlights Anthropic's decision to scale back an earlier safety commitment that prevented the release of AI models whose risks could not be adequately mitigated.

With no comprehensive federal framework governing the most severe risks associated with advanced AI, Oxfam urges investors to play a greater role in demanding independent oversight, stronger safeguards and greater corporate accountability.

"We cannot leave decisions about potentially catastrophic risks entirely in the hands of the companies creating them," said Ivanhoe. "Anthropic may have stronger safety measures than some of its competitors, but voluntary commitments are no substitute for independent oversight and accountability. As the company prepares to go public, investors have an opportunity and a responsibility to demand stronger safeguards before the consequences become irreversible."

/ENDS

Notes to editors:

Download Oxfam America's briefing paper, "Material Risks Beyond Anthropic's Balance Sheet."

Press contact

For more information, contact:

Shelby Bolen
Senior Media Officer
Washington, DC
Email: [email protected]