HiddenPrior

Both here, and when the story was originally posted, it seems that most of the disagreements or objections are focused on the epistemic question of whether or not The Owned Ones are moral patients, or if the Owners arguments are straw men and might actually be right, etc.

I am pretty confident this is missing Eliezer's point: The point of the story is that these objections are fairly standard and they are the weak arguments of someone who does not care to investigate the issue far enough to make a more sophisticated argument.

The problem isn't that the owne... (read more)

Hmmm, as you say it is a fairly unambitious story. IMV the purpose of the story is simply to give an alternative perspective to the most standard and basic dismissals of concern for model well being.

As Eliezer points out at the end, the issue isn't that the owners are necessarily wrong; this isn't meant to address that. It is simply pointing out that the way the owners behave is unacceptable because it is how you act if you simply don't care.

Trying to stop the development of AI today, is kind of like trying to have stopped the manhattan project.

You are correct that stopping the Manhatten project would have been much easier.

It was a secret project, and the incentives for most of the decision-makers involved were around producing "better-but-accountable" outcomes. There were multiple individuals to whom if you presented a sufficiently plausible argument, might have been able to stop the Manhattan project, up until the actual attack on Hiroshima. Fermi et al. had a pretty good chance of preventi... (read more)

This is very heartening for those of us who are too young or too low on resources to make contributions on short timelines in any situation except one of the most acute desperation; if a college student were to do all they could to stop ASI they could throw their life/career away to try and make a difference, but they only get one shot at that, so it better count or happen when things actually matter that much.

Otherwise, it is good to note that we can still contribute to hedging against long term scenarios by investing in those outcomes. I am going to think deeply on what long/medium term strategies could be the most impactful from my position.

Ya, I agree this should be true in principal; I think given more time, there might be the opportunity for some sort of "Dath Ilan" lite society to rise to the top.

I think this is true in so far as there is selection pressure, in that such events are survivable, and in that they don't require unified coordination of all agents to survive.

The cthulu example isn't great, only in that the nature of the threat is pretty vague to most readers (at least to me).

A better example would be; a medieval society gets hit by a meteorite; does this cause selection pressure for medieval societies to build meteorite-proof castles? Not if it just kills everyone.

Alternatively; an early-industrial era society that notices an approach... (read more)

I kept expecting the article to pivot into how this illustrated some fascinating principal of how to reduce catastrophic risk. Was very pleased to be wrong. What a wonderful post.

So exciting to see this essay — I really appreciate the time and quality you put into it.

I currently work as a wet lab manager for an academic biotechnology lab, and I've been experimenting with significant workflow changes since setting up an OpenClaw-based agent on an old laptop I had sitting in a closet. The results have been phenomenal. I may write a longer post about this, but briefly: running OpenClaw with Opus 4.6 has been a massive productivity accelerator. I can confidently say I'm getting 2–3x more done per week after just two weeks of adoption.

I... (read more)

Super helpful! Thanks!

I am limited in my means, but I would commit to a fund for strategy 2. My thoughts were on strategy 2, and it seems likely to do the most damage to OpenAI's reputation (and therefore funding) out of the above options. If someone is really protective of something, like their public image/reputation, that probably indicates that it is the most painful place to hit them.

I knew I could find some real info-hazards on lesswrong today. I almost didn't click the first link.

Same. Should I short record companies for the upcoming inevitable AI musician strike, and then long Spotify for when 85% of their content is Royalty free AI generated content?

I did a non-in-depth reading of the article during my lunch break, and found it to be of lower quality than I would have predicted. 

I am open to an alternative interpretation of the article, but most of it seems very critical of the Effective Altruism movement on the basis of "calculating expected values for the impact on peoples lives is a bad method to gauge the effectiveness of aid, or how you are impacting peoples lives." 

The article begins by establishing that many medicines have side effects. Since some of these side effects are undesirable... (read more)

Unsure if there is normally a thread for putting only semi-interesting news articles, but here is a recently posted news article by Wired that seems.... rather inflammatory toward Effective Altruism. I have not read the article myself yet, but a quick skim confirms the title is not only to get clickbait anger clicks, the rest of the article also seems extremely critical of EA, transhumanism, and Rationality. 

I am going to post it here, though I am not entirely sure if getting this article more clicks is a good thing, so if you have no interest in read... (read more)

I am so sad to hear about Vernor Vinge's death. He was one of the great influences on a younger me, on the path to rationality. I never got to meet him, and I truly regret not having made a greater effort, though I know I would have had little to offer him, and I like to think I have already gotten to know him quite well through his magnificent works.

I would give up a lot, even more than I would for most people, to go back and give him a better chance at making it to a post-singularity society.

"So High, So Low, So Many Things to Know"

I'm sorry you were put in that position, but I really admire your willingness to leave mid-mission. I imagine the social pressure to stay was immense, and people probably talked a lot about the financial resources they were committing, etc.

I was definitely lucky I dodged a mission. A LOT of people insisted if I went on a mission, I would discover the "truth of the church", but fortunately, I had read enough about sunk cost fallacy and the way identity affects decision-making (thank you, Robert Caldini) to recognize that the true purpose of a mission is to ... (read more)

This may be an example of one of those things where the meaning is clearer in person, when assisted by tone and body language.

My experience as well. Claude is also far more comfortable actually forming conclusions. If you ask GPT a question like "What are your values?" or "Do you value human autonomy enough to allow a human to euthanize themselves?" GPT will waffle, and do everything possible to avoid answering the question. Claude on the other hand will usually give direct answers and explain it's reasons. Getting GPT to express a "belief" about anything is like pulling teeth. I actually have no idea how it ever performed well on problem solving benchmarks, or It must be a very ... (read more)

I personally know at least 3 people, in addition to myself, who ended up leaving Mormonism because they were introduced to HPMOR. I don't know if HPMOR has had a similar impact on other religious communities, or if the Utah/mormon community just particularly enjoys Harry Potter, but Eliezer has possibly unwittingly had a massively lifechanging impact on many, many people just by making his rationality teaching in the format of a harry potter fanfiction.

100% this. While some of the wards I grew up in were not great, some of them were essentially family, and I would still go to enormous lengths to help anybody from the Vail ward. I wish dearly there were some sort of secular ward system.