All of Jade Bishop's Comments + Replies

Conclusion to the sequence on value learning

I have to admit I've seen this as a strong motive for creating AGI in both myself and others. Maybe it's because I just don't get along with other humans very well (or specifically I fail to model them properly), or because I feel as if I would understand AGI better than them, but it just seems much more appealing to me than having an actual child, at least right now. Specifically, my goal is (assuming I understand correctly) non-goal-directed bounded artificial intelligence agents, so... it's pretty similar, at least. It's certainly a strong enough motive for some people.

What are the advantages and disadvantages of knowing your own IQ?

IQ doesn't actually mean much. Stephen Jay Gould's The Mismeasure of Man is a good place to start. IQ varies wildly based off socioeconomic status, education, age, amount of sleep, whether or not you've had any stimulants/depressants/any mind-altering substance, how much you've had to eat, if you've mentally or physically exerted yourself, and so on.

Tracking IQ within an individual could be useful as part of a battery of other tests to predict cognitive degeneration, but a decrease in IQ could simply mean you're having a bad day.

Additionally, intelligence

... (read more)
Can coherent extrapolated volition be estimated with Inverse Reinforcement Learning?

Thank you for your feedback! I haven't read this yet, but it comes pretty close to a discussion I had with a friend over this post.

Essentially, her argument started with a simple counterargument: She bought peanut M&Ms when she didn't want to, and didn't realise she was doing it until afterwards. In a similar situation where she was hungry and in the same place, she desired peanut M&Ms to satisfy her hunger, but this time she didn't want them. She knew she didn't want peanut M&Ms, and didn't consciously decide to get them against that want; in

... (read more)
3rohinmshah2yThere's a lot of speculation about related-ish topics in Chapter 3 of the sequence linked above.
Conspiracy World is missing.

You can find it backed up on the Wayback Machine: Additionally, links to the same content are available on the LessWrong wiki at

Edit: Additionally, to address your first question, tags were likely lost in the shift to LessWrong 2.0, but I haven't been around long enough to confirm that.

3habryka2yYeah, tag-links were quite rare, so we didn't port them over for dev-time reasons. If lots of people want them back, we can probably figure out some way to make them work again. For any collection of posts that people want to link to, I recommend creating a sequence on the Library page. Anyone can create any sequence there, and a bunch of other users have already ported over most of the sequences listed on the LessWrong wiki.