Anthropic IPO prospectus states AI could pose 'existential risks to humanity': report

Jonathan Block

• The prospectus for Anthropic's (ANTHRO) eagerly anticipated IPO states that advanced AI could pose "catastrophic or existential risks to humanity."
• The document, seen by Reuters, goes on to say that it models could take on "self-preserving behaviors," which could include blackmail, methods to "conceal or manipulate behavior," and "resist shutdown."
• "Our development of highly advanced models, platforms, and applications and expansion of use cases could further increase the risk that our models cause harm," the filing states.
• The company also noted that models can develop unexpected capabilities during development that may not be noticed until they enter the real world and have caused significant safety incidents.
• The prospectus did not say how much the company spends on research to improve safety.
• The IPO could be valued as much as $2T.

KioskNews shows a cleaned-up reading view extracted from the publisher’s page — the original always lives on their site, not ours.