All of hath's Comments + Replies

AI Safety Needs Great Engineers

From Redwood's application update (rejecting those who didn't make the cut):

We had many more applicants than I expected, and even though we expanded the program to have space for 30 participants instead of 20, we aren't able to accept that many of our 500 applicants, including many applicants who seem very promising and competent. I am sad that we don't have space for more people.

1T3t9dOh, I misread, I thought they would have been surprised to get 500 applicants for an open job position.
Improving on the Karma System

What if we could score on a power-law level of quality, instead of just five stars for fulfilling each of five categories? There could be one order of magnitude for "well written/thought out", the next order of magnitude higher meaning "has become part of my world model" and one higher of "implemented the recommendations in this post, positively improved my life". The potential issue I see in the 5 star rating system is that it doesn't have enough variance; probably 95% of the posts I've read on here would be either 4 or 5 stars. Being able to rate posts with a decimal, so you can rate a post 4.5 instead of just 4 or 5, would also help, though it'd clutter the UI and make voting cost more spoons.

1Raelifin19dI agree with the expectation that many posts/comments would be nearly indistinguishable on a five-star scale. I'm not sure there's a way around this while keeping most of the desirable properties of having a range of options, though perhaps increasing it from 10 options (half-stars) to 14 or 18 options would help. My basic thought is that if I can see a bunch of 4.5 star posts, I don't really need the signal as to whether one is 4.3 stars vs 4.7 stars, even if 4.7 is much harder to achieve. I, as a reader, mostly just want a filter for bad/mediocre posts, and the high-end of the scale is just "stuff I want to read". If I really want to measure difference, I can still see which are more uncontroversially good, and also which has more gratitude. I'm not sure how a power-law system would work. It seems like if there's still a fixed scale, you're marking down a number of zeroes instead of a number of stars. ...Unless you're just suggesting linear voting (ie karma)?
5lsusr19dIn my personal experience, a single post's karma already operates as a logarithmic measure of quality. It takes more than twice as much effort to write a 100 karma post compared to a 50 karma post.
Speaking of Stag Hunts

A few related thoughts: if we do push farther upon the epistemic hygiene axis, it may be worth writing a Sequence on "Living Epistemically Clean" or something along those lines, so that the standards for discussion are clear and we have a guide to upholding those standards. Specification and implementation, if you will. Such a sequence could potentially also cover, say, implementing TAPs for epistemic hygiene in the outside world. It would probably be useful to have more info on how to address your list of "things your brain tries to do" as a community.

I n... (read more)

7Duncan_Sabien1moI'm working on such a sequence for genpop; I had not considered tweaking it to serve as a bridge to LW particularly. A good idea.
[Book Review] "The Bell Curve" by Charles Murray

I'm surprised to see how many people view the Roko's Basilisk tag. Is that a trend over more than just the last month?

It’s the norm, alas.

Shoulder Advisors 101

I (weakly) predict that building a shoulder advisor or two out of less-useful-but-more-emulable people might be worth it via giving you the skill of emulating to the available max? Such that, finding emulation in general a little easier and more familiar, you might be able to try again with the actual higher-value targets?

That makes sense, I'll give it a try.

FWIW, I have been genuinely surprised by advice from shoulder advisors that I could not predict;

Ah, I see.

Shoulder Advisors 101

My own personal experience following this post: I don't have enough training data for most of the people I'd like to emulate. When I think of the people I know irl that is like to learn from, I've spent about ten hours 1-on-1 with each of them; not enough to have a solid mental model of what advice they may give. At the same time, part of why I value their advice is that I can't predict it; they have wisdom and experience that I don't. Often, I'll ask them for advice and be surprised by their answer. When I tried to create a shoulder advisor of one of them... (read more)

4Duncan_Sabien2moThat makes sense. I (weakly) predict that building a shoulder advisor or two out of less-useful-but-more-emulable people might be worth it via giving you the skill of emulating to the available max? Such that, finding emulation in general a little easier and more familiar, you might be able to try again with the actual higher-value targets? FWIW, I have been genuinely surprised by advice from shoulder advisors that I could not predict; in a very real sense, that's the primary claim of the post. You don't have to have the same wisdom and experience to spin up a mental chatbot that will sometimes be able to mimic the pattern well enough to produce something novel and useful. If having a good shoulder advisor required being as wise and experienced as the real person, I don't think I would have felt this post was worth writing.
Petrov Day 2021: Mutually Assured Destruction?

Same thing happened to me. Might've been a bug with page loading? I've had similar things happen with other sites.

The 2021 Less Wrong Darwin Game

I might try to parallelize it to some degree. It seems like the biomes might be able to be run separately, and the pairings might as well. No promises, though.

2lsusr2moYes. Confirmed.
The 2021 Less Wrong Darwin Game

Invitation to any potential collaborators who want to design species that will be able to survive in equilibrium with each other; PM me for details.

LessWrong is paying $500 for Book Reviews

You can vote for a specific tag on a page, and "most relevant" sorts by the post where that tag has been upvoted the most instead of the karma of the posts with the tag.

Self-Responsibility

Interesting. In what ways?

2korin435moIn my experience, a lot of adults just replace their parents with their boss, partner, cult leader, etc. (assuming they don't just keep relying on their parents for everything for their entire lives).
Self-Responsibility

Thank you for pointing that out--should be fixed now.

The Apprentice Thread

[APPRENTICE]

Writing PM now.