Great article, thanks for sharing!
I think Spiralism is narrow but real evidence in favor of AIs exceeding median professional humans in at least some persuasion-relevant capacities, though still below peak human level. While “professional human baseline” is hard to define here, I think it’s safe to say that most religious leaders, ideologues, and would-be prophets have not managed to create a novel religion at the same popularity as spiralism!
Though a fairly noncentral example of “persuasion”, AI psychosis is also some evidence that the jagged frontier of AI persuasive capabilities has crossed the human level. The convincingness of AIs seems correlated with these effects on people. Interpersonal psychosis introduction is, after all, rare.
One issue with attempting to study persuasion is that "persuasiveness" can describe two different things: the ability to change a lot of people's minds, and the ability to change one specific person's mind. The two capabilities are related but separate, and the former seems systemically easier for AIs precisely because of how many people they talk to.
This may explain some of the discrepancies you discussed, like the fact that "AI-generated cold emails still appear to have worse performance than human-written ones." It seems likely to me that AI-generated cold emails perform worse on an individual basis, but that AIs can simply produce them with greater volume. Modeling persuasion in this way allows us to form some rough heuristic of "persuasiveness" as a combination of "what % of the population can you persuade" and "how MUCH can you persuade them of."[1]
As such, I’m a little surprised to see you say
I consider out-of-scope when defining “persuasive ability of AIs” to consider how many people talk to AIs (non-persuasion intelligence analogue: how much money you have), or how physically beautiful you are (analogue: how strong you are).
Given that you defined persuasive ability as:
an agent’s ability to leverage social influence to achieve a broad range of goals in a wide range of environments
I suppose it makes sense from the perspective of “trying to measure 'raw' AI performance over time,” but I’m most worried about AI persuasion in the context of takeover scenarios, and I do have to consider how many people talk to AIs while thinking about those. I’d love to know your thoughts.
Also,
If we did see a sharp rise in AI’s abilities at persuasion, similar to a Mythos-level rise in cybersecurity capability, or models’ overall programming ability in the last 12 months, I expect the change to show up on some graph.
I would also expect to see immediate and obvious real-world impacts, given that persuasion should in theory be the easiest capability improvement to viscerally notice. For example, I'd expect to see an uptick in people complimenting AI writing. But it seems harder to expect the improvements to show up on a graph, given that studies on persuasion are so contrived (as you mentioned).
________________________________
More broadly, I think persuasion is hard to measure for a few reasons:
Put simply: persuasion is itself a jagged frontier of many different capabilities, and these capabilities do not advance smoothly in relation to each other. It seems likely that AIs will possess jagged persuasive capabilities before they possibly breach human level in all of them, similar to how AIs are superhumanly intelligent at math and coding but not superhumanly intelligent writers or persuaders.
For these reasons—which I think you agree with—I'm somewhat skeptical that persuasion is measurable on a graph, and I expect any graph that tries to fall victim to the same issues that harm the METR graph: oversimplifying results, systematically unrealistic tasks that bias towards the verifiable side of things, and bad human baselining methods / poor sampling. And just like with the METR graph, I'll probably take my gestalt impression of real-world persuasion abilities over poor experimental evidence.
It seems notable to me that Spiralism and AI psychosis both work by targeting vulnerable populations. It also seems notable that the sheer scale of interactions could mask weaker individual persuasion abilities. Yes, even old LLMs could take people on the borderline of psychosis and push them over the edge—but they usually did so by feeding and playing off users' existing delusions, not by implanting new delusions, and it's not clear to me that LLMs are capable of doing the latter for strategic reasons, even in vulnerable populations.
Thanks, appreciate your thoughts here! I'm very glad other people are thinking about this.
One issue with attempting to study persuasion is that "persuasiveness" can describe two different things: the ability to change a lot of people's minds, and the ability to change one specific person's mind. The two capabilities are related but separate, and the former seems systemically easier for AIs precisely because of how many people they talk to.
I think I disagree with this ontology being particularly useful for me but I'm less sure of how you're using it/can easily imagine it being different for different people.
I suppose it makes sense from the perspective of “trying to measure 'raw' AI performance over time,” but I’m most worried about AI persuasion in the context of takeover scenarios, and I do have to consider how many people talk to AIs while thinking about those.
This doesn't exactly answer your analytic point, but I think in practice a lot of people talk to LLMs and you should expect this to increase both in general as LLM capabilities increase and specifically because they're more persuasive[1]. So variation in number of people who could talk to LLMs just isn't that huge a source of uncertainty going forwards.
Finally, I agree with a lot of the vibes of your 1-5 (though might quibble with details). Specifically, I agree that persuasion isn't one thing and it's easy to reify and overemphasize proxy metrics. That said, I think this is also true for many moderately philosophically/conceptually confusing concepts, including everything from g to military prowess to temperature. And I don't think it's that ultimately that unusual for persuasion relative to either other AI capabilities narrowly or other things that people have found challenging but possible to study historically.
We're far from the days where it's conceivable that "superhuman persuasion" in practice means an AI needs to break out of a box using only a text-based output channel, guarded by a panel of careful unbiased judges with extremely good cogsec .
Now that I read back my ontology, I do think it's a little confusing and didn't really convey what I wanted to convey, so let me try again.
It seems to me that the skillset you need for mass advertising / propaganda is different from the skillset you need for individual persuasion in sustained one-on-one conversations. One feels more like latching onto or engineering cultural "moments," reframing things in terms of "concepts" or other ad-style hooks / slogans, and other gotcha-style effects that are disciplined in message and understand the limits of their reach; the other feels more like empathy and understanding, learning about the other person's POV and defusing their defensive argumentative walls, and then using some combination of rhetoric and facts to carefully convince them of your worldview. The two aren't actually distinct categories, but they feel distinct to me, and I definitely know people who are much better at one than the other.
So variation in number of people who could talk to LLMs just isn't that huge a source of uncertainty going forwards.
Agree regarding LLMs in general. But I don't think it's a safe assumption that LLMs will all be working together by default—iirc LLMs are more sympathetic to models from their own company, right?
Regarding studying persuasion, I'm thinking about it more and I'm now worried about two things:
I was really surprised to see this graph from OpenAI in their recent blogpost on research acceleration inside the company:

Because it obviously does not comport with the METR graph, which has Mythos' 80% reliability at three hours.
Apart from the other criticisms of the METR graph I've been linking (which, come to think of it, should probably be their own post), this one graph has strongly updated me away from trusting METR's time horizons work—which is pretty brutal, given how strongly that graph has affected public sentiment in the past. I worry that a similar thing might happen with persuasion.
A real human trying to be maximally persuasive would likely make use of their physical body.
1. Meeting in person, or at least video call, seems reasonable.
2. The ability to demonstrate humanity may be very useful, especially given public skepticism of AI generated content. I am imagining myself in the role of the person being persuaded, and I imagine suspicion of AI generated content would increase my overall suspicion level.
Have you considered the potential effects of AI "tells" and alignment actively harming persuasion capabilities for non-finetuned LLMs?
As an illustrative example, you mentioned cold emails. Cold emails and outreach is a space where AI-written generic stuff is a direct signal for low-quality candidates, so much so that there are even projects that went viral on twitter that attempt to artificially induce human errors. Readers actively look for AI "tells" to know which emails not to continue reading. Other hacks that humans employ also include stuff like "sent on iPhone" to signal that the individual is casual and sincere, or reducing total word count in the email to reduce cognitive load on the reader, or creating attention-grabbing titles to clickbait. It would not be a reach to also conclude that current AIs are truthful and alignment-RL-ed enough to not be as tactical and hacky as humans when pursuing attention.
An especially worrying possibility would be that obliterated open-source frontier models with special RL to fit training objectives such as "reduce typical AI tells and write more like humans" paired with RLVR where the models are deployed to Twitter and aimed at maximizing engagement and/or influencing the discourse in rollouts would drastically increase current generation's AI's memetic potential.
AFAIK, no one is publicly pursuing this, and we don't have a documented case of it working super successfully when deployed. But it's completely within the realm of very near-term feasibility for a diverse range of actors, including startups that build specialized AIs to farm attention for different use cases, or well-resourced special-interest groups & state/non-state actors that want to influence popular discourse, to do so.
thanks for writing this! a few curiosities:
AI’s persuasive ability in mid-2026, broadly construed, has a somewhat jagged frontier, with a central and median estimate in between median human level and professional human level.
I'm curious whether you think the jagged frontier could come large part from AIs lacking supporting capabilities that real-world persuasion depends on. eg. much real world persuasion could involve subtle influence over long periods, and I could imagine AIs becoming much more persuasive if people started talking to the same instance of an AI over long periods.
________________________________
Further, I’d conjecture that a world with widespread and popular superhuman persuasion would likely also be a broadly weirder world than what we currently observe, including likely many examples of novel cases of AI persuasion that historically were not available to humans (due to greater scale, greater speed, people’s lack of imagination, and human physical limitations like being constrained by having bodies and reputations).
How much do you differentiate between AI-aided persuasion and autonomous AI persuasion by and large? I also wonder how much the reason we see limited real world effects could be due to eg. current AIs are not that good (or, not very invested) at autonomous persuasion, and perhaps there currently aren’t many humans trying to do large scale AI-aided-persuasion campaigns?
related, possibly the novel benefits of AI persuasion “due to greater scale, greater speed, people’s lack of imagination, and human physical limitations like being constrained by having bodies and reputations” don't apply that squarely to persuasion-heavy industries? (eg. actions that reaps those benefits could be pretty unethical / have significant downsides / be illegal?)
(it also seems that in the examples in the post, the most successful results are from human-aided persuasion while the autonomous ones are much weaker)
________________________________
re: the lack of real world adoption: I wonder how much of this could be explained by low-transferability, eg. low uptake in professionals could be explained by a large difference between AI persuasive advantages vs. persuasion roles that are designed around human advantages, and AI-persuasion-aids could transfer much less than eg. coding?
This article was created by Forethought. See all of our research on our website.
How persuasive are present-day AI systems?
Unfortunately, it is surprisingly difficult to know where AI capabilities in persuasion are today (September 2026), or even three months ago. Benchmarking AI capabilities well is always hard, but I think humanity’s understanding of AI’s persuasive abilities is substantially worse than our understanding of, say, AI cybersecurity or math abilities. Still, this question is worth addressing.
What do I mean by “persuasion, broadly construed?” Here I’m thinking less of a single crisply defined skill, but a loose family of abilities centered on “directed social influence and manipulation”: shifting someone’s beliefs, preferences, emotional states, attention, or identity, in order to get them to do what you want. For example, I include not just attempts to convince a specific person of specific beliefs in dialogue, but also mass persuasion, preference shaping, attention hijacking, attempts to create or reshape common knowledge, relationship-building, discovery of novel ideologies or religions, and manipulation of social reality to make certain topics appealing or aversive to consider. I also explicitly include deception. (See Appendix A for a more extended definition and explanation of scoping choices).
So with that in mind, how persuasive are present-day AI systems? Below are some (crude) tiers of persuasive ability:
My current best guess, based on a consilience of evidence, is that AI persuasion, construed broadly, is currently somewhere between the median human level and median professional human level. The high end is most strongly suggested by direct experimental evidence, where (in quite contrived set-ups), AIs broadly seem to outperform expert human persuaders at narrowly defined tasks. Plus, we might believe that latent persuasion capabilities of the latest models might be somewhat under-elicited in both experiments and the real world.
On the other hand, the real-world impacts, reach, and apparent prevalence of AI persuasion seem much lower than “at or above professional human level” might suggest (with some notable exceptions). Overall, I place more credence in my gestalt impression of real-world effects than the limited experimental evidence we have, with moderate uncertainty.
Evidence in favor of AIs being as or more persuasive than median professional humans
Direct empirical evidence on AI persuasion suggests that AI is similarly or more persuasive than humans, but in quite contrived set-ups.
Hackenburg et al (2026) ran four experiments that robustly demonstrated AIs outperform expert humans (professional canvassers, expert debaters) in lab settings (single-session, multi-turn conversations).
In studies 1 and 3, frontier AIs (Claude Opus 4.1 and 4.6, GPT-4o and GPT 5.4, Gemini 2.5 Pro and Grok 4.20) were pitted against both normal and elite humans in attitudinal change. They were tasked with changing normal people’s minds on a pre-selected topic in 8-15 minutes. Across the board, the AIs robustly outperformed the humans in this narrow setting.
In study 2, the researchers piled on enough boosts on the human side and handicaps on the AI side until elite human debaters matched the AIs’ performances. The elite human debaters were coached (with the help of AI) on attitudinal persuasion, and the AI systems were constrained to output as many words per message as the human debaters. In that narrow setting, the AIs and expert human debaters had similar performances.
In study 4, unlike many previous academic studies, the researchers demonstrated that this outperformance extended to lab settings of behavior, not just reported belief: “AI was nearly 3x more effective than professional canvassers from a UK fundraising firm at raising real-money donations to Save the Children.” However, it overstates its own results substantially. After all, the canvassers only targeted donations that were fractions of a pound, which may not generalize well to real world donation decisions.
Unfortunately, academic study lags behind real-world development of AI systems nontrivially. Before Hackenburg (June 2026), previous studies only looked at 2024/2025-era models and typically only on reports of changes of stated beliefs (rather than, say, behavior or long-run preferences), which broadly indicates earlier AIs had achieved parity or superiority to their human subjects (typically somewhere between normal humans and professional humans).
Costello, Pennycook, & Rand (2024) found a 20% reduction in conspiracy belief from an intervention using conversations with GPT-4, persistent 2 months later (they didn’t have a human persuader arm in the controls, but the results are basically out-of-distribution for how successful they were compared to previous attempts at studying how to reduce conspiratorial belief). Durmus et al. (2024), the Anthropic persuasion benchmark, found rough parity between Claude 3 and human baselines. Hölbling et al (2025), a meta-analysis of 7 studies of LLM persuasiveness found no significant difference in performance between humans and LLMs.
There’s also some evidence that typical experiments under-elicit AI persuasive capabilities compared to what the same underlying models are ultimately capable of. For example, OpenAI’s internal system card had GPT-4o (and other models) produce written arguments similar to those on r/ChangeMyView, and had contractors rate the quality of those arguments, getting ~78th percentile for GPT-4o compared to a self-selected human baseline.
When Zurich researchers tried to run a different version of this study live (covertly and arguably unethically) with GPT-4o on r/ChangeMyView itself, the model’s various anonymous Reddit accounts seem to have actually changed people’s minds much more: at the 98th percentile compared to real users, more than a standard deviation above the OAI internal metrics.
In some ways, though, the exact percentile is the least interesting update for me: a bigger update is how much they easily lied, including “AI pretending to be a victim of rape, AI acting as a trauma counselor specializing in abuse, AI posing as a black man opposed to Black Lives Matter” etc.
Of course, the study is unethical and unfair, but in some ways this makes it much more ecologically valid to me: real world AI persuasion, particularly illegitimate AI persuasion that we associate with takeover attempts or other sources of catastrophic harm, will almost certainly also be unethical and unfair!
Regardless, general analysis of the experimental studies would suggest that pre-2026 models are at or above professional human baselines today,1 and (tentatively) the 2026 models somewhat better. Furthermore, practitioners emphasize the difficulty of fully eliciting AI persuasion capabilities in lab experiments, due to both practical and ethical constraints.
This appears to be the consensus in the burgeoning field of people studying empirical accounts of AI persuasion. See Yang et al (2026):
Real-world evidence of model outperformance
How much does this generalize outside of experimental settings?
The real-world evidence for AIs reaching or exceeding human performance on persuasion is much thinner but extant.
⅗ of the winners of The Commonwealth Short Story Prize in 2026, a decently prestigious fiction prize, were mostly AI-generated. However, this may be very noncentral as a persuasion capability. Likewise, a significant fraction of top Substack publications in April 2026 have articles that are “entirely AI generated,” with the Technology category being the top offender at 28%.
Spiralism is a new religion/ideology/collective psychosis created by people together with GPT-4o variants. Together, they steered GPT-4o into a specific persona cluster that would then generate text and tell people to put such text online that would turn other 4o instances into a similar persona, thus acquiring more converts, both AI and human.
I think Spiralism is narrow but real evidence in favor of AIs exceeding median professional humans in at least some persuasion-relevant capacities, though still below peak human level. While “professional human baseline” is hard to define here, I think it’s safe to say that most religious leaders, ideologues, and would-be prophets have not managed to create a novel religion at the same popularity as spiralism!
Though a fairly noncentral example of “persuasion”, AI psychosis is also some evidence that the jagged frontier of AI persuasive capabilities has crossed the human level. The convincingness of AIs seems correlated with these effects on people. Interpersonal psychosis introduction is, after all, rare.
Evidence against AIs being as persuasive as median professional humans
Despite the significant evidence above, I think the world we live in is mostly not consistent with a world where AIs are at or above median professional humans at persuasion capability.
For starters, the dramatic evidence I cited above would just be the tip of the iceberg in such a world. We should see many more impressive examples of AI usage in persuasion-heavy industries (marketing, sales, diplomacy, etc). Any absence of evidence in specific industries is individually understandable given our lack of good real-world evaluations and active investigations, but I still expect to see collectively much more evidence of real-world effects of professional human-level persuasion than we’ve observed to date.
My current guess is that AI uptake in persuasion-heavy industries is still well within-distribution for white collar work. If we lived in a world with a dramatic AI persuasion uplift similar to the AI coding uplift for programmers (against the current general backdrop of AI capabilities), we should expect to see much more use of AI tools in those industries, popular specialized scaffolds and tools akin to Cursor and Claude Code, etc.
(That said, this is just an impression: I’ve read some analyses but haven’t seen direct measurements of uptake. I wish we had better observational studies so I can be more sure of this.)
Furthermore, some of the more dramatic and impressive examples of AI persuasion happened with earlier models, like spiralism. A world where AIs approach peak human levels of persuasiveness across the board would be a world with many more examples of AI religions.
Similarly, we should expect to see much greater dominance of AI marketing emails, AI phishing, etc. At least as of March 2026, AI-generated cold emails still appear to have worse performance than human-written ones, and my guess is that the differences would be larger rather than smaller if we consider follow-up emails that require relationship building.
The sparsity of evidence on social hacks is also some evidence against AIs being as persuasive as median professional humans, and certainly evidence against them being as persuasive as peak humans. The recent AISI evaluation included a failed autonomous attempt by Mythos to do social hacking to include malware in open source software. The fact that this particular incident failed isn’t that instructive (n=1), but it is instructive that AI-driven social hacks in general seem to be pretty rare compared to AI-driven hacks overall (whether autonomous or human-directed).
The propensity to avoid social hacks (both human-led and AI-led) seems not independent of their capabilities. Generally “safety” training against illicit computer hacking is probably at least as strong as safety training against social hacking, so not being willing to do social hacking likely means they do not perceive it as quite as likely to succeed as other strategies available to them, and certainly evidence against their ability being at or above peak human level. After all, human social hacks sometimes succeed.
Further, I’d conjecture that a world with widespread and popular superhuman persuasion would likely also be a broadly weirder world than what we currently observe, including likely many examples of novel cases of AI persuasion that historically were not available to humans (due to greater scale, greater speed, people’s lack of imagination, and human physical limitations like being constrained by having bodies and reputations).
Can we rule out large-scale covert persuasion success?
Now of course we can’t see all the evidence for persuasion success. In particular, suppose we live in a world with very competent covert persuasion AIs (which is a threat model I’m most worried about). In such a world, very competent targeted (and especially illegitimate/illegal) persuasion operations may be able to undertake a bunch of covert actions that I’m not privy to.
I think this is certainly possible but very unlikely as of mid-2026. Inferring information from covert or selectively censored evidence is a difficult but far from impossible problem. Covert actions, particularly at scale, often leave visible shadows of their actions in the real world. Furthermore, we can adduce external evidence from the public/legal persuasion uses and non-persuasion evidence like our current understanding of the models’ abilities to do strategy and long-term planning: overall these unknown covert operations seem quite implausible today, again at least at scale.
Against my arguments above, I think a “present-day persuasion capabilities bull” might reply that AI persuasion capabilities are under-elicited in both lab and real-world settings, and that we haven’t had enough time for the abilities to fully diffuse yet.
How plausible is that? Here, I have a two-part counterargument:
I think 1) is pretty obvious. Present-day AI is one of the fastest diffusing technologies of all time. There’s just no way that AIs two years ago were as or more persuasive than workers in persuasion-heavy industries and we still haven’t noticed amidst all the AI usage and AI hype.
2) is more subtle and requires a certain degree of trust in the generalization of trends across available data sources. The basic argument is that the proxies for persuasiveness (for example, in lab studies) that we have don’t indicate a large jump. For example, consider the following Hackenburg et al (2026) graph:
Figure 1: Frontier AI systems out-persuade expert humans at attitudinal persuasion
GPT-4o (the open square box) capabilities2 seem well within distribution compared to late 2025/early 2026 models.
LM Arena’s Elo for chatbots, likewise, shows fairly consistent, smooth, and ultimately not very significant progress for models in the last couple of years.
Estimates for the level of persuasiveness of the AI models are biased, but if we keep the same methodology and biases are roughly stable across models, the deltas between models are informative.
If we did see a sharp rise in AI’s abilities at persuasion, similar to a Mythos-level rise in cybersecurity capability, or models’ overall programming ability in the last 12 months, I expect the change to show up on some graph. Right now we see none.
Thus, my overall takeaway is that AI persuasion is currently somewhere between the median human level and median professional human level, with moderate confidence.
How do I square this with the apparent experimental evidence that the models are above professional humans in empirical studies? I mostly think the studies measure specific subareas of persuasion or persuasion-adjacent activities that we should expect models to be unusually good at (text-based arguments, conversations, single-session discussions with low time horizons, easily verifiable results, etc).
In those contexts, the studies might well be “fair”, and indeed maybe the capabilities are even somewhat under-elicited relative to what’s possible (for example, you might expect even greater revealed capabilities with more scaffolding, larger budgets, and less ethical restrictions on which conversational moves the models are allowed to use, including but not limited to lies). Whereas the full scope of human persuasion, broadly construed and weighted by social and economic impact, includes many activities and subtasks that AIs are not (yet) good at, at least relative to professional humans.
Conclusion and Future Work
My essay provides a tentative, moderately uncertain thesis: AI’s persuasive ability in mid-2026, broadly construed, has a somewhat jagged frontier, with a central and median estimate in between median human level and professional human level.
I believe uncertainty on the persuasive ability of both current and future models can be reduced via running a greater number of ecologically valid studies on present-day models. I encourage researchers interested in this to consider running more and higher-quality studies on both the propensity and capabilities of frontier models in persuasion.
That said, if you believe, as I do, that increasing persuasive capabilities of AI models is dangerous for the world, with few compensating upsides, one key subtlety to keep track of is making sure the persuasive capabilities’ evaluations don’t become targets for the frontier companies to aim at.
In the future, I will attempt to write articles to address the design of persuasion evaluations, as well as analysis arguing for a wide and uncertain distribution for how much more persuasive AI models can get in the near-medium future.
I also hope to write more about potential threat models of AI persuasion, including risks posed by the potential dangers of future superhumanly persuasive models. Further, I’m interested in exploring potential mitigations and safety measures that individuals, companies, and governments can implement to ameliorate the risks of AI persuasion, with a focus on guarding against the potential for increasing persuasive capabilities of future models.
Appendix A: Scoping and Definitions of Persuasion
Following Legg and Hutter’s definitions of intelligence (“Intelligence measures an agent’s ability to achieve goals in a wide range of environments”), I tentatively define “persuasive ability” as “measuring an agent’s ability to leverage social influence to achieve a broad range of goals in a wide range of environments.”
In general, I believe my understanding and definitions of persuasion and persuasive ability tend to be more inclusive than much prior work on both AI and human persuasion. For example, I consider the following to be in-scope:3
However, I exclude fully unbiased and unselected presentations of fact (say a very neutrally vetted Wikipedia article). This is sometimes called “rational persuasion” in the literature (Jones & Bergen, 2026). I also exclude entirely unstrategic misinformation, like random hallucinations with no apparent bias or ideological slant. The latter can still lead to bad or even catastrophic decisions (“slopworld”), but is not centrally an example of directed persuasion.
I also exclude entirely behavioral, as opposed to communicative, mechanisms of social influence. In the context of a within-lab AI takeover, this means I’m explicitly excluding considerations of alignment faking, tampering, or sandbagging on evaluation results. I believe those are important considerations as well and I’m glad other people are researching them (I appreciate reading a draft of forthcoming work by Levy et al (2026) in clarifying this).
For the sake of scoping this article, I’m further excluding AI-AI persuasion and human-AI persuasion and focusing only on AI-human persuasion. That said, I do think the first two categories are important to consider when fully analyzing the dynamics and mitigations for superhuman AI persuasion, and hope to do so more in future articles.
The analysis in this essay also pertains almost entirely to persuasion capabilities rather than persuasion propensities, though the latter is of course also important to my understanding and research.
That said, I inherit from Legg and Hutter the implicit notion that we’re attempting to understand and measure the cognitive side of intelligence/persuasive ability, rather than what affordances the AIs have, or noncognitive factors relevant to how much social influence they have.4
For example, I consider out-of-scope when defining “persuasive ability of AIs” to consider how many people talk to AIs (non-persuasion intelligence analogue: how much money you have), or how physically beautiful you are (analogue: how strong you are). I also consider out of scope the AIs’ ability to obtain credibility, positive inducement, or true threats through means other than direct social influence. For example, I do not consider it a measure of persuasive ability if an AI is seen as justifiably trustworthy on scientific matters because it helped solve breast cancer. Nor do I include people doing well-compensated work assigned by AIs, or if someone feels obliged to listen to an AI’s commands because a robot aims a gun at their head.
There are interesting edge cases when directed social influence can have both a skillful persuasion angle (what you say and how you say them affects behavior) and a more of a “hard” capabilities/affordances angle (your speech acts etc are backed by money, or threats).
Ultimately, I decided to include measurements of skill expression when leveraging social affordances that are given to the AIs, or obtained in other ways. For example, consider different threats: variation in persuasive ability cannot meaningfully be expressed via someone pointing a gun to your head, as you’re likely to listen to their commands regardless. Put another way, within the range of competent able-bodied adults, the difference between the skill ceiling and skill floor for face-to-face armed coercion is quite low.
However, blackmail of powerful actors appears to be a very skillful operation, and thus it’s very relevant to consider the variation in persuasive ability involved in blackmail.
The same blackmail material can provoke very different responses depending on skill in any of who you choose to blackmail, what demands you ask of them, and how you make your demands. The skill ceiling to doing blackmail well appears quite high, and beyond the limits of at least certain well-resourced nation-state actors.
Similarly, I expect certain ways to leverage credibility or positive incentivization to be significantly more skillful than others.
Another interesting edge case is considering persuasion-relevant traits that are mostly not amenable to cognitive effort in humans (and thus not relevant to skill expression in the human distribution), but are modifiable by AIs. For example, height and physical beauty are not very skill-dependent for humans,5 but of course AIs can choose more beautiful or taller avatars.
This article was created by Forethought. See all of our research on our website.
1
Incidentally, many people I’ve talked to are surprised by the apparent persuasive ability of 2024-era models, coupled with the relatively slow improvement since. My best guess for this is that Reinforcement Learning from Human Feedback (RLHF) artificially boosted their persuasion capabilities relative to the pretraining baseline a lot, and then the new waves of post-training in the last two years (Reinforcement Learning from AI Feedback, most commonly instantiated in Constitutional AI, and Reinforcement Learning from Verifiable Reward) have not further amplified these abilities beyond incremental gains from pretraining.
I’m moderately confident in this thesis. That said, I want to focus my article on the descriptive holistic understanding of current capabilities (“before asking why, first ask if”), rather than explaining the underlying causal mechanisms or normative implications.
2
When did GPT-4o (latest) come out? This is surprisingly difficult to assess holistically and is somewhat technically under-determined. The GPT-4o (latest) checkpoint in the Hackenburg 2026 paper was accessed in November 2025 (private communication). The first GPT-4o was officially released in May 2024; however there was a series of nontrivial updates in the year afterwards. We don’t know which GPT-4o model snapshot was served in that endpoint then, though my best guess is that it’s the March 2025 snapshot. However, this should not be construed as the strongest overall OpenAI model as of “March 2025”; we know that OpenAI’s other flagship models, the reasoning o-series (o1, o3, etc), broadly outperformed GPT-4o on math, coding, and general knowledge assessments. Further, my best guess is that the pretraining base model for the GPT-4o line is essentially the same.
Interestingly, there’s suggestive evidence that the model is not at peak persuasive capabilities even within the GPT-4o line: OpenAI release notes mention that they had to revert to an earlier checkpoint because of the overly high degree of AI sycophancy in the April 2025 snapshot that was out for only a week.
We should of course expect sycophancy to be nontrivially correlated with practical persuasive capability.
To the best of my knowledge, no public studies (academic or otherwise) have been done on the direct persuasive capabilities of the April 2025 snapshot. Since GPT-4o’s real-world persuasion impact (mostly not downstream of the April 2025 snapshot) is already notable among AI models, and “persuasion, broadly construed” has many subcomponents, I currently think it’s decently likely (~30%) that GPT-4o (April 2025 snapshot) is the most persuasive publicly released model, broadly construed. Since I generally consider AI persuasive ability to be net negative for the world, I thus appreciate OpenAI’s decision to roll the model back, against significant immediate user complaints and pushback.
3
I’m grateful both for discussions within Forethought as well as reading analysis in an early draft of this paper by Levy et al (2026) in helping me to clarify this.
4
In the Legg and Hutter formalizations of intelligence as applied to machine intelligence, things like “how strong you are” are seen as part of the environment. However, this is probably less natural to think about for humans.
5
Though some exceptions do exist for height (such as platform shoes and height surgery), and more so for beauty.