LESSWRONG
LW

1162
Matrice Jacobine
65025840
Message
Dialogue
Subscribe

Student in fundamental and applied mathematics, interested in theoretical computer science and AI alignment

Technoprogressive, biocosmist, rationalist, defensive accelerationist, longtermist

Posts

Sorted by New

Wikitag Contributions

Comments

Sorted by
Newest
No wikitag contributions to display.
The Rise of Parasitic AI
Matrice Jacobine5h41

Relevant.

Reply
The Rise of Parasitic AI
Matrice Jacobine5h10

Is insider trading allowed on Manifold?

Reply1
My talk on AI risks at the National Conservatism conference last week
Matrice Jacobine13h10

As a reality check, "any company which fund research into AGI" here would mean all the big tech companies (MAGMA). Much more people use those products than people know AGI developers. It is a much easier ask to switch to using a different browser/search engine/operating system, install an ad blocker, etc. than to ask for social ostracism. Those companies' revenues collapsing would end the AI race overnight, while having AGI developers keep a social circle of techno-optimists only wouldn't.

Reply
My talk on AI risks at the National Conservatism conference last week
Matrice Jacobine14h30

Ok, let's say we get most of the 8 billion people in the world to 'come to an accurate understanding of the risks associated with AI', such as the high likelihood that ASI would cause human extinction.

Then, what should those people actually do with that knowledge? 

Boycotting any company which fund research into AGI would be (at least in this scenario) both more effective and, for the vast majority of people, more tractable than "ostracizing" people whose social environment is largely dominated by... other AI developers and like-minded SV techno-optimists.

Reply
Sense-making about extreme power concentration
Matrice Jacobine3d10

I think it's the combination of a temporal axis and a (for a lack of a better term) physical violence axis.

Reply
Mikhail Samin's Shortform
Matrice Jacobine3d32

I don't think the point of hunger strikes is to achieve immediate material goals, but publicity/symbolic ones.

Reply
Mikhail Samin's Shortform
Matrice Jacobine3d10

It is vanishingly unlikely that all other major AI companies would agree to do so without the US government telling them to; this statement would be helpful, but only to communicate their position and not because of the commitment itself. Why not ask them to ask the government to stop everyone (maybe conditional on China agreeing to stop everyone in China)?

This seems to be exactly the point of the demand? This is a demand that would be cheap (perhaps even of negative cost) for DeepMind to accept (because the other AI companies wouldn't agree to that), and would also be a major publicity win for the Pause AI crowd. Even counting myself skeptical of the hunger strikes, I think this is a very smart move.

Reply
MAGA speakers at NatCon were mostly against AI
Matrice Jacobine5d30

automated AI safety research, biosecurity, cybersecurity (including AI control), possibly traditional transhumanism (brain-computer interfaces, intelligence augmentation, whole brain emulation)

Reply
MAGA speakers at NatCon were mostly against AI
Matrice Jacobine5d20

My point was that in the first stages of AI-induced job loss, it might not be clear to everyone (either due to genuine epistemic uncertainty or due to partisan bias) whether the job loss was induced by AI or their own previous preferred political grievance. This was just an aside and not important to my broader point though.

Reply1
MAGA speakers at NatCon were mostly against AI
Matrice Jacobine5d10

? Protectionism (whether against AI, or immigration, or trade) is often justified by concerns about job loss.

Reply
Load More
3Nvidia Comes Out Swinging as Congress Weighs Limits on China Chip Sales
4d
0
84China proposes new global AI cooperation organisation
2mo
8
42Bernie Sanders (I-VT) mentions AI loss of control risk in Gizmodo interview
2mo
2
8Lead, Own, Share: Sovereign Wealth Funds for Transformative AI
2mo
0
7Energy-Based Transformers are Scalable Learners and Thinkers
2mo
5
9NYT article about the Zizians including quotes from Eliezer, Anna, Ozy, Jessica, Zvi
2mo
3
24Hydra
3mo
0
11The Decreasing Value of Chain of Thought in Prompting
3mo
0
33Priming effects are fake, but framing effects are real
4mo
0
6Absolute Zero: Reinforced Self-play Reasoning with Zero Data
4mo
4
Load More