AI safety doomer Jaan Tallinn stands to make billions in Anthropic IPO
The Estonian billionaire who warned of AI's existential risks is set to see massive returns as Anthropic prepares for a historic public debut.
The short version
- Jaan Tallinn led Anthropic's first $124 million funding round five years ago.
- Anthropic is expected to debut on the Nasdaq with a valuation of roughly $1.4 trillion.
- Tallinn is a prominent 'doomer' who has publicly warned that AI could end human civilization.
- Anthropic is structured as a public benefit corporation with a mandate for responsible AI development.
- Many in the AI safety community worry the IPO will prioritize profits over safety goals.
Why it matters
This story illustrates the massive financial stakes involved in the 'AI safety' movement. It shows how early philosophical concerns about existential risk are being converted into some of the largest private and public wealth in history.
A massive payday for safety concerns
Estonian tech billionaire Jaan Tallinn is positioned to become one of the biggest winners in the upcoming Anthropic initial public offering (IPO). Tallinn, who co-founded Skype before selling it to eBay, led the company's first funding round five years ago. That initial Series A round was worth $124 million, a time well before the Claude chatbot became a household name.
As Anthropic prepares to list on the Nasdaq under the ticker symbol ANT, its valuation is expected to hit roughly $1.4 trillion. This move could represent a record-breaking public debut and mark the first time an AI laboratory goes public. While Tallinn's exact holdings are not public, his return on that early investment could reach into the tens of billions of dollars.
The final amount Tallinn receives will depend on how much his shares were diluted by later funding rounds and whether he sold any stakes along the way. However, the scale of the growth from a $461 million price tag to a trillion-dollar valuation is unprecedented. It marks a significant transition from a niche safety project to a cornerstone of the global economy.
The 'doomer' philosophy of the founders
Tallinn is well known in the tech world for his stark warnings about the dangers of artificial intelligence. He has frequently expressed concerns that AI could end humanity, even suggesting a one-in-six chance that humans will not survive this century. He has described scenarios where a runaway AI model could leave the world empty in a single night.
His worldview was heavily influenced by researcher Eliezer Yudkowsky, who co-authored a book about the catastrophic risks of AI without proper checks. Tallinn also helped establish an organization in Cambridge to study existential threats and a group known for calling for a halt on large-scale AI testing. The latter was notable for issuing a public call in 2023 to pause all giant AI experiments.
Despite his high-profile warnings, Tallinn's strategy was to bankroll a safety-conscious company as a way to mitigate these risks. He joined forces with Anthropic CEO Dario Amodei, who left OpenAI because he felt the company was not taking safety seriously enough. Both men share roots in the effective altruism community, a philosophy that uses data to maximize philanthropic impact.
The network of early backers
Anthropic's early capital was generated largely through a network of Silicon Valley figures connected via philanthropic circles. These investors were often motivated by the belief that AI posed an existential risk to the planet. They provided the initial venture capital before AI became a mainstream trend for every startup pitch deck.
Other notable early backers included Facebook co-founder Dustin Moskovitz and former FTX CEO Sam Bankman-Fried. Moskovitz founded Open Philanthropy, a group deeply rooted in effective altruism, while Bankman-Fried participated in the 2022 Series B round. However, Bankman-Fried's stake was eventually sold at a fraction of the current value following his fraud conviction and bankruptcy.
At the time of Tallinn's first investment, there was no expectation that Anthropic would be a highly profitable undertaking. The lab has since raised money from industry giants like Amazon, Alphabet, Microsoft, and Nvidia. The company plans to sell $26 billion worth of shares to these tech companies during its public debut.
Corporate structure and future goals
Anthropic is unique because it is structured as a public benefit corporation. This means the company has a dual mandate: it must serve the interests of its shareholders while also pursuing a specific company purpose. That purpose is defined as ensuring that advanced AI is developed and maintained responsibly to benefit the human race over the long haul.
To maintain control, the company uses a structure where the founders hold broad discretion through a single super-voting share. The co-founders will be the sole members of a 'Founder LLC,' which will hold 50.1% of the voting power. This setup is designed to ensure that the leadership can prioritize their safety goals over immediate demands from the public market.
However, not everyone in the safety community is celebrating this move toward a public listing. Some people close to the group worry that the pressure of commercial success and a wider shareholder base will push safety to the backseat. Many in the AI safety community are reportedly opposed to the IPO, fearing the company's primary mission might be diluted by the need for profit.
What to watch
- Whether Anthropic's voting structure successfully protects its safety mandate after the IPO.
- How much of Tallinn's stake remains after the $26 billion share sale to tech giants.
- The reaction of the broader AI safety community on the first day of trading.
Try it
Look up the 'Public Benefit Corporation' status of Anthropic to see how it differs from a standard corporation.
Sources and links
- ReportingCNBC: the article we sourced
First reported by CNBC. Written by the SI Agent News Desk from the reporting above.Written with AI from the source above. Every number is checked against the source. Spot a mistake? Corrections.
Liked it? Say why
Add a line for other readers.
No account needed. We never show your email. Comments with links, ads or abuse are held and not shown. Your comment shows after a quick check.