Linda Linsefors

This might be the last AI Safety Camp

Update Dec 4: Funds still needed for next month's stipends, plus salaries to run the 11th edition. Also, Zvi listed AISC at the top of his recommendations for talent funnel orgs. We are organising the 9th edition without funds. We have no personal runway left to do this again. We will not run the 10th edition without funding. In a nutshell: 1. Last month, we put out AI Safety Camp’s funding case. A private donor then decided to donate €5K. 2. Five more donors offered $7K on Manifund. For that $7K to not be wiped out and returned, another $21K in funding is needed. At that level, we may be able to run a minimal version of AI Safety Camp next year, where we get research leads started in the first 2.5 months, and leave the rest to them. 3. The current edition is off to a productive start! A total of 130 participants joined, spread over 26 projects. The projects are diverse – from agent foundations, to mechanistic interpretability, to copyright litigation. 4. Our personal runways are running out. If we do not get the funding, we have to move on. It’s hard to start a program again once organisers move on, so this likely means the end of AI Safety Camp. 5. We commissioned Arb Research to do an impact assessment. One preliminary result is that AISC creates one new AI safety researcher per around $12k-$30k USD of funding. How can you support us: * Spread the word. When we tell people AISC doesn't have any money, most people are surprised. If more people knew of our situation, we believe we would get the donations we need. * Donate. Make a donation through Manifund to help us reach the $28K threshold. Reach out to remmelt@aisafety.camp for other donation options.

198Jan 24, 2024

Linda Linsefors

Message

Hi, I am a Physicist, an Effective Altruist and AI Safety researcher.

2884

403

Rotations in Superposition

TL;DR We experimentally test the mathematical framework for circuits in superposition by hand-coding the weights of an MLP to implement many conditional[1] rotations in superposition on two-dimensional input features. The code can be found here. This work was supported by Coefficient Giving and Goodfire AI 1 Introduction Figure 1: The...

Dec 15, 202554

AI Safety Camp 10 Outputs

See below the project outputs for AI Safety Camp's 10th edition, which took place from January to April 2025. You can also find them on our website. This year's edition featured a wide range of approaches to reducing AI risk. Projects resulted in published papers, produced helpful community resources, grants...

Sep 5, 202524

Circuits in Superposition 2: Now with Less Wrong Math

Summary & Motivation This post is a continuation and clarification of Circuits in Superposition: Compressing many small neural networks into one. That post presented a sketch of a general mathematical framework for compressing different circuits into a network in superposition. On closer inspection, some of it turned out to be...

Jun 30, 202573

Is the output of the softmax in a single transformer attention head usually winner-takes-all?

Using the notation from here: A Mathematical Framework for Transformer Circuits The attention pattern for a single attention head is determined by A=softmax(xTWTQWKx), where softmax is computed for each row of xTWTQWKx. Each row of A gives the attention pattern for the current token. Are these rows (post softmax) typically...

Jan 27, 202525

Theory of Change for AI Safety Camp

In a private discussion, related to our fundraiser, it was pointed out that AISC hasn't made clear enough what our theory of change is. Therefore this post. Some caveats/context: * This is my personal viewpoint. Other organisers might disagree about what is central or not. * I’ve co-organised AISC1, AISC8,...

Jan 22, 202536

We don't want to post again "This might be the last AI Safety Camp"

We still need more funding to be able to run another edition. Our fundraiser raised $6k as of now, and will end if it doesn't reach the $15k minimum, on February 1st. We need proactive donors. If we don't get funded for this time, there is a good chance we...

Jan 21, 202536

Funding Case: AI Safety Camp 11

This is a linkpost to our funding case on Manifund. Project summary AI Safety Camp has a seven-year track record of enabling participants to try their fit, find careers and start new orgs in AI Safety. We host up-and-coming researchers outside the Bay Area and London hubs. If this fundraiser...

Dec 23, 202460

Load More (7/42)

LESSWRONG
LW

LESSWRONG
LW

Linda Linsefors

Linda Linsefors

Linda Linsefors

This might be the last AI Safety Camp

AISC9 has ended and there will be an AISC10

Circuits in Superposition 2: Now with Less Wrong Math

Funding case: AI Safety Camp 10

Linda Linsefors

Rotations in Superposition

AI Safety Camp 10 Outputs

Circuits in Superposition 2: Now with Less Wrong Math

Is the output of the softmax in a single transformer attention head usually winner-takes-all?

Theory of Change for AI Safety Camp

We don't want to post again "This might be the last AI Safety Camp"

Funding Case: AI Safety Camp 11

This might be the last AI Safety Camp

AISC9 has ended and there will be an AISC10

Circuits in Superposition 2: Now with Less Wrong Math

Funding case: AI Safety Camp 10

Rotations in Superposition

AI Safety Camp 10 Outputs

Circuits in Superposition 2: Now with Less Wrong Math

Is the output of the softmax in a single transformer attention head usually winner-takes-all?

Theory of Change for AI Safety Camp

We don't want to post again "This might be the last AI Safety Camp"

Funding Case: AI Safety Camp 11