Anthropic recognises the risks to humanity – but is its governance really up to the job?

  
  


Boardroom governance matters, even in the world of big tech, it turns out. The business of how companies are run, investors are discovering, can be more complicated than handing the founder or superstar chief executive as much control as he wants (it’s usually a he) and waiting for brilliant returns to appear. Sometimes a few checks on power are useful, especially when a crisis strikes.

This revelation is no revelation at all, of course. For about 30 years until the first generation of big US tech companies came along, the thrust of corporate governance thinking was to insist on the basic fairness of the principle of “one share, one vote”. The owners should be able to chuck out misbehaving or underperforming managers by a simple majority, in other words.

It was only when the likes of Google (now Alphabet) and Facebook (now Meta) appeared with their “mission” statements that dual class structures – and unequal voting rights – got a fresh lease of life. The corporate missions, went the argument, were so important that the founding geniuses needed to be able to pursue them in free-wheeling, risk-taking style without distraction from the tiresome short-term demands of ordinary shareholders.

In an extreme example, Snap, the Snapchat company, was even able to pitch its overblown ambition of “reinventing the camera” as so vital that shares could be issued with zero voting rights, as opposed to merely weakened rights.

Now we come to Anthropic, the Claude AI developer whose $1.4tn blockbuster listing happens this week. The governance setup here is, to put it mildly, different. In essence, there are two centres of power and neither is the ordinary shareholders.

One is the seven founders, who collectively have one vote that commands 50.1% of the ultimate voting power – the collective aspect is designed to force them to come to a consensus. The other is a financially disinterested trust, the Long-Term Benefit Trust, which nominates four of the seven directors and looks out for the balance between making money and benefiting humanity. The trustees are a cast of the great and the good, including Ben Bernanke, former chair of the US Federal Reserve. And the whole structure is given an overlay as “public benefit corporation”, nodding to Anthropic’s commitment to develop AI responsibly and safely.

There are two positive things to say about this setup. First, the motivation is plainly more complicated than a simple power-grab by the founders, led by Dario Amodei. Rather, Anthropic’s backing for the Long-Term Benefit Trust seems to be designed to create some form of constitutional balance of power.

Second, Anthropic probably has a stronger justification than most to divert from the norm of equal rights for equal economic risk. If the development of AI could pose “catastrophic or existential risks to humanity”, as the listing document puts it, a few unconventional governance structures are probably in order. We’re not talking about Snap’s fluffy videos for social media.

All the same, Anthropic is offering an untested experiment. For all the fine words, the company may simply have recreated an inward-looking “trust us” setup, just with more elaborate clothing.

Here’s a nuanced point from Stuart Riddick, sustainable investment manager at fund manager Aberdeen. “Agreement with a mission in principle does not equate to agreement over how it is interpreted and implemented by the directors.”

Riddick notes that Mustafa Suleyman, the chief executive of Microsoft’s AI division, even as he acknowledged Anthropic’s seriousness about AI safety, has made strong and detailed criticisms of the company’s thinking on so-called “model welfare”, arguing that AI models must not be trained to act as if they have rights or consciousness.

How, in practice, are such challenges handled within Anthropic’s supposedly responsible governance arrangements? It’s hard to tell unless the Long-Term Benefit Trust starts to throw its independence around, or not.

What happens if the trustees are at loggerheads with the founders on a basic safety question? Will they tell the outside world? Or will they reflect that ultimate voting still sits with the founders, so best not to rock the boat? If the shareholders are denied any role in holding the executives to account, what is the true level of challenge?

It is surprising after events at Nvidia that Anthropic’s governance has received so little attention. Yes, the setup is supposed to be high-minded and responsible. But it still represents an extraordinary concentration of power in the hands of a few individuals.

 

Leave a Comment

Required fields are marked *

*

*