The first plzdontkillus cohort cost ~$750k and produced ~2M fellow-made AI safety views. The organizers (@Ronny Fernandez, @Aella, etc) are waiting to hear back from Lightcone Commons about funding for 3 additional cohorts,[1] with recommendations due Oct 23. I'd like them to answer 4 questions before then.[2]
Lightcone Commons evaluators (listed on the website: @Zvi, @Eliezer Yudkowsky, @So8res, @YafahEdelman, @KatjaGrace, @habryka, and others): I'm tagging you because I think these questions are decision-relevant.
I'd especially like to hear from Aella since I'm asking about her model and she's behind much of the program's vision/strategy. Please let me know if I've mischaracterized your views.
Note: I'm a plzdontkillus alumnus. The program gave me a $2000 stipend and free room and board for the month, and I won the “Other” category.
Based on the FAQ section of plzdontkillus.com, they're waiting to hear back from Lightcone Commons about "three more cohorts in 2027." Applications are already being accepted for a tentative January 2027 iteration.
I'm asking in part because there's been recent (and less recent) discussion on LessWrong about plzdontkillus and its organizers haven't responded publicly.
This SF Standard interview published around the same time says "Our goal is $800,000 to cover everything we want. We’re roughly 60% of the way there."
In the same interview, she says, "My philosophy is you just have to get the right ingredients and then put them together, and then you find out what people value based off of those ingredients. And so that was the goal with PDKU [plzdontkillus]."
Note that the program had a $21k prize pool, most of which was awarded for non-safety content. Ronny (lead organizer) said at the award ceremony that their system for allocating prize money was "pretty dumb". I point out in my post that it's harder to make viral AI safety content than it is to make other types of viral content, which is imo a strong incentive against making AI safety content.
keltan (an organizer) told Transformer: "My hope is that, in the end, our views per dollar are better than if we were just to have paid for a bunch of advertising." (He told me he updated away from this goal during the program.) The program cost ~$750k, according to the organizers. According to Claude, $750k of Instagram Reels ads buys ~37M impressions at US prices, or 150M+ at global median prices. I estimated fellow-made AI safety views at ~2M -- ~20-75x more expensive than ads. If we add mentor views (Rob Miles and Nate Soares), which plzdontkillus.com does, we get ~7.4M views -- ~5-20x more expensive than ads. plzdontkillus.com's number is 21.6M -- ~1.7-7x more expensive than ads.
I'm an alumnus and I'm currently not making AI safety videos. I'm instead focusing on political advocacy in Finland. I was making AI safety videos before the program, though.
Appreciate you asking these questions! I don't know much about the specifics of pdku, but have thought a little bit about AI safety video creation from a grantmaking perspective, eg this shallow dive and having helped incept and fundraise for the first batch of Frame Fellowship. Some quick takes:
scarcity of talent.
What kind of talent is lacking? To be honest, as a professional videographer, I'm surprised to learn about this program just now.
For organizing: the number of people who can organize a program like pdku is not super large, requiring some combination of taste/context on AI safety, agency/get-things-doneness, connections, and ability to raise funding. (And this is before getting into eg video-specific skillsets). For example, Ronny also recently organized agi.wtf, which imo uses a similar organizer skillset. So running a batch of pdku could be seen as trading off against running some other large event or fellowship to steer AI in a good direction.
Your point on not having heard about pdku as a professional videographer in the rat scene, is good data though! My general sense is that many things in AI safety still suffer from insufficient marketing. I also wish eg Project Tailwind and many of Manifund's programs like Falcon Fund could use a bigger marketing push.
I think it's bad to scrutinize someone who does a (counterfactually & in expectation) good thing for not doing the maximally good version.
But if they're misleading in their communication of the outcomes like this, it seems good to scrutinize what they did.
Also seems like you did useful analysis of the outcomes and also have brought up seemingly smart suggestions in good faith. I appreciate question number 2, and it would be disappointing if there was good reason to update and people failed to do that.
It seems good to me to scrutinize PDKU (even if they aren't being misleading), so that funders can decide if it should be given funding for future cohorts. If the PDKU organizers were billionaires who wanted to spend a lot of money on an expensive party I wouldn't care about cost-effectiveness; there are much bigger wastes of resources that I care about more. But if someone is asking for funding from LCC it seems good to investigate how cost-effective funding them is, since there's a limited amount of funding to allocate?
I collected some data on q4.[1] I wasn't that thorough, so let me know if you have any corrections.
How many of the 55 plzdontkillus alumni are still regularly making AI safety videos, 2.5 months after the program?
Around 2. Avisha posted 7 AI safety videos since plzdontkillus ended. Charlie posted ~5, which is around one video per 15 days.
3-4 AI safety videos: Glasha, Eliana, Christian,[2] Caitlin, Wyn, Isabel, GeneYes
Tonchi posted 2. Guy did some.[3]
How many of those do you think are counterfactual?
Probably both.
I skimmed through ~100 videos Avisha posted from May 2025 to the start of plzdontkillus, and none of them were clearly AI safety.
Charlie was posting AI safety videos before the program, but that's because he bike-packed across the US to get to Berkeley for plzdontkillus and interviewed strangers about AI safety along the way.
...
I also looked at viewcounts.
Most-viewed AI safety videos from plzdontkillus alumni (all shortform videos)
# | Views | Creator | Video |
1 | 201K | Tonchi Matta | |
2 | 172K | artificial.isabel | |
3 | 123K | Avisha NessAiver | |
4 | 104K | GeneYes | |
5 | 76K | GeneYes | |
6 | 74K | Avalon Warren | |
7 | 47K | Avisha NessAiver |
Also notable: this 1h40m video essay by a plzdontkillus alumnus has 100k views.[4] It describes his experience at the program, which he calls an “All-Expenses-Paid AI Doomsday Cult retreat.” It’s highly critical of the AI safety community and mostly doesn’t engage with the arguments, but when it does, it’s strawmanning and repeating objections that have been refuted by AI safety people.
It's worth pointing out that 2.5 months post-program isn't that long. Habryka said he’s recommending ~$300k to plzdontkillus alumni, so I’m guessing we can expect more content from those creators.
I saw that Avisha (a plzdontkillus alumnus) updated his dashboard to include data on alumni’s AI safety posting. I then manually went through a lot of accounts to get a more accurate count of AI safety videos.
He posted 4 clips from his podcast with Nate Soares immediately after the program ended.
It's hard to classify them and I didn't try too hard since they all have <1k views.
That's something like 10-25x more watch time than Tonchi's AI 2027 explainer.
Thanks for the datapoints. If you wanted to go further, I'd like to see comparison to other programs that do similar things (e.g. Frame Fellowship or the FLI video accelerator). I don't think comparing to the cost of ads is great because the value of an organic view compared to an ad view is quite different.
I'm kinda confused by this post. Like it's hard to even think about it directly, it feels slippery, and my guess is that our worldviews on this diverge in some really deep way that makes everything downstream of it more confusing for me?
My impression from talking to you before is that you're primaily distressed we're not explicitly incentivizing x-risk content, and most of the complaints are downstream of that?
I believe I've already said a few times that I strongly don't think explicitly incentivizing AI content is a good idea, at least not for the vision I have. A verison that was about incentivizing it would be entirely a different thing, and not something I'd be excited about (although might be still worthwhile for someone else to run). I think this primarily because I have very strong intuitions around how creativity works, and that you cannot foster really genuine novelty around something by trying to capture it too directly.
There's a lot of benefit we've gotten from PDKU that's behind the scenes, and are things I didn't anticipate would happen. This is cool, and feels sort of the goal of 'doing lateral stuff and seeing what falls out.' This category of thing is very high-variance and hard to predict. I do think a lot of this is a 'just trust me bro' intuition thing on my part. I don't blame people if they don't want to trust me, I think it would be reasonable not to! But I do have a pretty good track record of going viral, and building things lots of people use, and developing networks useful for x-risk stuff that likely wouldn't have happened otherwise. And, as I believe I've mentioned to you before, I would never ever have gotten to where I am today, and I would be much less useless overall, if I'd tried to buckle down and make exactly the thing I thought I was supposed to be making from the get-go.
Fwiw, I personally am running a second, different, not publicly-advertised thing based off and using networks from PDKU, that I would not have been able to do without PDKU, and this one is significantly more goal-oriented. I only find the goal-oriented nature of this one hopeful because the ingredients were selected from wild garden of PDKU.
But yea idk if i'm repeating myself here but just. I think we have very wildly different models of how success works here. Idk, have you ever like, done an expedition? Like "Okay there's a bunch of jungle over there and I don't really know the way forward but to start let's just plow in and start waving our machete around"? And certainly you miss some important stuff, and it's inefficient, but the point is other people are already trying nice methods where they slowly lay down some nice and even asphalt in a straight line, and sure you could also get some asphalt, but your goal here isn't to figure out how to lay asphalt slightly faster it's to fucking figure out how to get through this forest as fast as possible, with a new method. And you did find a bunch of fruit that's turning out to be useful, and you suspect this means you're going the right direction - and maybe you're not! - but you think somebody here should be doing something besides the conventional route to at least find out.
I think if we ran another PDKU and it didn't result in the same level of unexpected fruit, I wouldn't want to run it a third time. I think it's very probably worth running a second time.
I do think a lot of this is a 'just trust me bro' intuition thing on my part. I don't blame people if they don't want to trust me, I think it would be reasonable not to! But I do have a pretty good track record of going viral, and building things lots of people use, and developing networks useful for x-risk stuff that likely wouldn't have happened otherwise.
I think after the first iteration, it makes most sense to look at the track record of the program, and weight that more than intuitions and less applicable data from before the program. I think plzdontkillus made a lot of sense to run, and this thinking seems reasonable before the program. But in my interpretation, now the public data[1] doesn't seem to support the success or promise of applying Aella's intuitions for a program like this.
If the theory of impact or justification of success of plzdontkillus is something less public, I would be disinclined to trust the organizers to judge "unexpected fruit", mostly because they seemingly significantly overstated a relevant success metric that is possible to judge publicly, and when confronted with this, changed the label to be more vague (in my view still misleading) rather than changing the number.
I'm noting that most of the post-program time has been after Coxon, which has changed the dynamics.
Thanks for responding! I'm still hoping for a response to my four questions.
I could make some guesses based on this comment, but I'd like to get your answers.
I agree that we have different models. My question was: what evidence would update you against your model? Again, let me know if I've misrepresented your position.
Note that anyone can collect data on question 4 by looking at program alumni's accounts. To get an idea of how counterfactual the program was, I'd also look at their posting before the program.
I don't think I'll do this myself, so I'm pointing this out in case anyone wants to do it.