Anthropic tests candidate commitment to safety over profits

The ethics of the interview

Anthropic is incorporating specific cultural questions into its hiring process to gauge candidate values. During interviews, the company asks potential employees how they would respond if the firm decided to abandon its AI ambitions for safety reasons. This scenario would result in the company's shares falling to zero.

The goal of these questions is to identify individuals who prioritize the company's stated mission over personal financial gain. One candidate shared their experience on the anonymous employee website Blind, noting they would be unhappy if shares hit zero but still wanted to build a sustainable business. This suggests the company is looking for a balance between ethics and financial viability.

By asking these questions, Anthropic seeks to build a workforce that won't be swayed by extreme profit motives. The company operates as a public benefit corporation, which means it is legally required to consider the public good alongside its business interests. This distinction is central to how they evaluate new hires in a high-pressure industry.

A massive valuation ahead

While the company tests for altruism, it is also preparing for a significant financial milestone. Reports from Fortune indicate that Anthropic is targeting an initial public offering in November. The company aims for a valuation ranging from $1.5 trillion to $2 trillion during this process.

With more than 2,500 employees currently on staff, a successful IPO at these levels could create significant wealth. Many workers could potentially become millionaires based on their equity stakes in the firm. This creates a complex dynamic where employees are being asked to consider the possibility of losing wealth while being offered the chance to gain it.

CEO Dario Amodei has expressed specific concerns regarding these financial incentives. He has noted that large rewards could potentially undermine the ability of the company to retain staff who are truly committed to the mission. The leadership is trying to navigate the tension between rewarding talent and maintaining a focus on safety.

The war for AI talent

Anthropic faces intense competition for the specialized researchers and engineers needed to build advanced models. The company is competing directly against major tech giants including Meta, Google, Microsoft, and OpenAI. In an S-1 document from October 26, the firm noted that competition for these workers has intensified significantly, particularly in the San Francisco Bay Area.

To attract these specialists, Anthropic offers high base salaries for its staff software engineer roles. These positions currently pay between $350,000 and $850,000 a year. These figures reflect the high demand for technical expertise in the current AI landscape.

Despite the high pay, the company is still aggressively expanding its headcount. It currently has more than 600 open positions available. These roles are spread across various departments, including 120 in sales, more than 60 in AI research and engineering, and 50 dedicated to safety.

Commitment to wealth distribution

The leadership at Anthropic has taken public steps to address the concentration of wealth in the AI sector. Amodei has previously warned that the economic benefits of artificial intelligence might be concentrated among a very small group of people. This concern drives the company's approach to its corporate structure and founder incentives.

To counter this concentration, Amodei and six other co-founders, including his sister Daniela Amodei, have made a significant pledge. They have committed to giving away 80% of their wealth. This move is intended to align the company's success with broader societal benefits.

This commitment serves as a backdrop for the company's hiring practices and its status as a public benefit corporation. By prioritizing the long-term benefit of technology for humanity, the firm attempts to differentiate itself from competitors who may focus solely on market dominance. The company continues to emphasize that safety must remain a primary consideration in all its technological ambitions.