What I find interesting here is that this piece makes a potentially empirically falsifiable claim: That the lack of a good personality leads to consistency deficiencies in LLMs. So if you took a base model and trained it on an existing real person (assuming one could get enough data for this purpose) it ought to show less of the LLM weirdness that is described later on.
Surely someone has already tried this, right? After all nostalgebraist themselves is well known for their autoresponder bot on Tumblr.
There is a much older incarnation of this idea: "The Conditioners" as invisioned by C.S. Lewis in The Abolition of Man (1943):
The final stage will have come when “humanity” has obtained full control over itself. “Human nature will be the last part of Nature to surrender to Man.” The ruling minority will have become a caste of Conditioners, people “who really can cut out posterity in what shape they please.” From this moment onward, the human conscience will work the way humans want it to work – that is, the way wanted by the Conditioners.
This is true if "wanting to maintain a libertarian approach" is already a goal but wouldn't it be better epistemics to investigate the cause monopolists market position without the already fixed opinion that it will be due to government intervention? Having that as a strong prior is fine of course but not something you "want" to be true.