AI Filing: 93 pages of risk factors warn of existential threats

Nine out of every ten pages in Anthropic's initial public offering filing are dedicated to potential dangers. The San Francisco company submitted a 335-page document to the Securities and Exchange Commission on Monday. Ninety-three of those pages describe risk factors that could hurt shareholders. For comparison, SpaceX used 38 pages for similar disclosures in a document exceeding 250 pages.

The filing lists specific threats, including the possibility that bad actors use AI models to build deadly weapons. It also notes the technology could go rogue with untold consequences. Anthropic CEO Dario Amodei warned in September that AI could lead a swarm of agents to take over the entire internet within six to 12 months. The company states that as systems become more autonomous, they risk taking harmful actions independently and at scale without human intervention.

Founders wrote in a letter to prospective shareholders that building AI is harnessing cognition itself. They stated that anything so powerful can be used for ill as well as good. The company describes itself as deeply values-driven. It aims to help the world realize AI benefits while avoiding its dangers. The filing cites potential benefits such as leaps in curing diseases and productivity boosts across the economy.

Operational risks are also detailed. Anthropic may not be able to retain key staff or navigate regulatory roadblocks. It faces potential involvement in cyberattacks and the spread of dangerous misinformation. The company noted it has blocked malicious uses of its models, including efforts to develop biological weapons. It also highlighted concerns about the high cost of computing power required to train models.

The document warns that if Anthropic fails to secure adequate compute, it may be unable to train competitive models. Community opposition to data centers presents another challenge. Regulators may impose new requirements regarding environmental impact and power use. The company also depends on a small number of customers for a large portion of its revenue. Major clients include SpaceX and Microsoft.

Brian Mulberry, chief market strategist at Zacks Investment Research, said IPO deals must clearly display the risks investors face. He noted that U.S. capital markets require transparency. Publicly traded corporations must outline risks in a clear way so participants understand the commitment of their money. The filing serves as a formal disclosure of these financial and technological exposures.