582

LESSWRONG
LW

581
AI GovernanceChinaAI
Personal Blog

84

China proposes new global AI cooperation organisation

by Matrice Jacobine
30th Jul 2025
1 min read
8

84

This is a linkpost for https://www.reuters.com/world/china/china-proposes-new-global-ai-cooperation-organisation-2025-07-26/

84

China proposes new global AI cooperation organisation
16GeneSmith
20Mitchell_Porter
14Jonas Hallgren
7Jonas Hallgren
3Kabir Kumar
15Sean_o_h
8sanyer
7Mateusz Bagiński
New Comment
8 comments, sorted by
top scoring
Click to highlight new comments since: Today at 2:58 PM
[-]GeneSmith2mo16-3

Anyone have insights into whether this is a genuine offer that could be taken up by members of the administration if they have the right attitude vs a simple power play by China to try to get more support from potential allies?

Trying to gauge how cynical to be here.

Reply
[-]Mitchell_Porter2mo201

The first step is to understand what is being proposed. There's nothing about existential risk or AI takeover here. The talking points are (1) the world should coordinate on all aspects of AI governance (2) countries who aren't AI powers need a seat at the table (3) the headquarters of this new organization will be in China. Point 1 is addressed to everyone including America. Point 2 is arguably addressed to everyone but America. Perhaps we could say that, since Chinese AI doesn't have the same brand recognition as American AI, they are sweetening the deal for potential sovereign customers, by offering to give them a say in the politics of AI. 

Reply1
[-]Jonas Hallgren2mo1411

https://www.lesswrong.com/posts/PfyTyZKASezFynYmv/?commentId=ay33KErjBsCLDqfZa

Xi Jinping seems kind of safety pilled or like he's going that way as far as I've seen. I've had around 5-7 people that are goverannce related and knowledgable about the China situation that are datapoints towards that being the case? Maybe 1-2 people against it?

Not on the average likelihood of the deal but it seems to me that china is somewhat safety aligned

Reply
[-]Jonas Hallgren1mo7-2

I want to update this comment with the following that I saw Dan Fagella share on facebook. I trust Dan's take here more than I do my own since he was there and so I want to revise the above and say that this seems like a more plausible potential take? (It is still somewhat coherent with the information above just update with the opinion of the people in the middle who often have a better idea of what is going on):

people are like 'see this reuters article, china is proposing an international ai gov agency!'

after 5 days in shanghai for their world ai conference (waic), i now think china won't lead on agi safety / the usa has to take the lead on this...

i talked to a bunch of people in the shanghai government and the technical communities. Summary / recs below:

high level review of the event:

- the theme of the event was "global solidarity in the age of ai"

- major western speakers included stuart russell, helen toner, dan hendrycks, and others

- chinese companies showcased ai tools and platforms

- governance and safety were mentioned often in panels

- much talk of transparency, controllability, agent interactions

off-mic conversations told a different story;

- multiple chinese researchers and local officials said: "we’re only talking about ai safety because trump isn’t"

- it’s posturing, not principle. its knowing that trump is not focused on safety, and it leaves a gap for china to look virtuous and to jockey for a perceived position of tech leadership

- it is reactive to the USA, not proactive in terms of prioritizing agi safety for its own sake (geopolitical optics move, not a values shift)

technical culture in china:

- in sf or boston, you can find meetups on alignment

- you can talk about failure modes, governance, strategy

- in china, those conversations don’t really exist

- there's no "internal discourse" about alignment or agi risk at leading labs like deepseek, they don't talk about it publicly and they don't seem to discuss it much in-house

- people want to beat the benchmarks (i.e. "show me what makes the models look safe so i can score high"), not reflect on long-term risks

- its top-down "make the boss happy" / "don't rock the boat" when it comes to lab employees (discussing agi's dangers is rocking the boat - not a good thing to do in chinese culture generally)

- no philanthropic funding, no grassroots agi safety orgs (no equivalents of farAI, METR, redwood research, ARIA, etc)

what surprised me:

- i assumed china’s leadership could act top-down to prevent agi loss of control (because Xi is very smart and understands ai's importance, and because china is very sensative to anything that would shake up the ruling party's grip on power)

- but it seems xi’s government isn’t philosophically moved by runaway ai, many people i spoke with think that Xi and his top leaders won't really act on agi safety until the usa does

- there is remarkably little by way of discussion or think tanks / non-profits around agi safety in china, outlandishly less than the anglosphere

what i think needs to happen if international agi coordination is ever going to happen:

- even if the chinese effort to have "solidarity in the ai age" is posturing, it creates an opening for track 2 dialogue with china, and we should do as much of that (among technical leaders, safety thinkers, academics, etc) as we can

2- we need WAY, WAY more funding going to starting agi safety orgs / events / discourse in china - the few peopel who care cannot find funding for 'safety' like people do in the usa / uk

3- the usa needs to wake up its citizens to care about agi risk, otherwise the president / mainstream media will never care. theory of change:

- the bottom of our power pyramid (citizens) needs to flip in order for the top of our pyramid (president) to ACT on agi risk

- only when the top of america's pyramid (president) acts on agi risk with china seriously act on agi risk

- only then to we have a serious window for coordination

that is all. if you know more about china's agi safety / technical ecosystem that adds luster to this picture let me know

Reply
[-]Kabir Kumar2mo31

China/the CCP have had to actually try to align social media algorithms, for better/worse and several members have a phd in computer science. 

I think they're generally better informed on this than every government I've seen

Reply
[-]Sean_o_h2mo152

The text of the plan is here:
http://hk.ocmfa.gov.cn/eng/xjpzxzywshd/202507/t20250729_11679232.htm

Features a section on AI safety:
"Advancing the governance of AI safety. We need to conduct timely risk assessment of AI and propose targeted prevention and response measures to establish a widely recognized safety governance framework. We need to explore categorized and tiered management approaches, build a risk testing and evaluation system for AI, and promote the sharing of information as well as the development of emergency response of AI safety risks and threats. We need to improve data security and personal information protection standards, and strengthen the management of data security in processes such as the collection of training data and model generation. We need to increase investment in technological research and development, implement secure development standards, and enhance the interpretability, transparency, and safety of AI. We need to explore traceability management systems for AI services to prevent the misuse and abuse of AI technologies. We need to advocate for the establishment of open platforms to share best practices and promote international cooperation on AI safety governance worldwide."

Reply
[-]sanyer2mo81

A link to the original article would be appreciated

Reply
[-]Mateusz Bagiński2mo71

https://www.reuters.com/world/china/china-proposes-new-global-ai-cooperation-organisation-2025-07-26/ 

Reply
Moderation Log
More from Matrice Jacobine
View more
Curated and popular this week
8Comments
AI GovernanceChinaAI
Personal Blog

SHANGHAI, July 26 (Reuters) - China said on Saturday it wanted to create an organisation to foster global cooperation on artificial intelligence, positioning itself as an alternative to the U.S. as the two vie for influence over the transformative technology.

China wants to help coordinate global efforts to regulate fast-evolving AI technology and share the country's advances, Premier Li Qiang told the annual World Artificial Intelligence Conference in Shanghai.

President Donald Trump's administration on Wednesday released an AI blueprint aiming to vastly expand U.S. AI exports to allies in a bid to maintain the American edge over China in the critical technology.

Li did not name the United States but appeared to refer to Washington's efforts to stymie China's advances in AI, warning that the technology risked becoming the "exclusive game" of a few countries and companies.

China wants AI to be openly shared and for all countries and companies to have equal rights to use it, Li said, adding that Beijing was willing to share its development experience and products with other countries, particularly the "Global South". The Global South refers to developing, emerging or lower-income countries, mostly in the southern hemisphere.

How to regulate AI's growing risks was another concern, Li said, adding that bottlenecks included an insufficient supply of AI chips and restrictions on talent exchange.

"Overall global AI governance is still fragmented. Countries have great differences particularly in terms of areas such as regulatory concepts, institutional rules," he said. "We should strengthen coordination to form a global AI governance framework that has broad consensus as soon as possible."