Posts
Wiki Contributions
Comments
In the case of the lawyers, this is actually not an example of non-niceness being good for society. The defense attorney who defends a guilty party, their job is not to be a jerk to the prosecutor or to the judge. It is to, as you say, provide the judge with information (including counter-arguments to the other side's arguments). While his job involves working in an opposite direction from his counterpart, it does not involve being non-nice to his counterpart (and it is indeed most pro-society if the two sides treat eachother well / nicely outside of their equal-and-opposite professional duties), and it does not involve being non-nice to the judge, whose job the attorney (as you point is) is actually assisting with. Again, society expects maximum niceness from both attorneys towards the judge outside of ⌞their professional duty to imperfectly represent the truth⌝.
Society expects niceness to be provided from each of these parties to each of the others: {the judge, the defense attorney, the prosecution attorney}
This is important news. I personally desire to be kept updated on this, and LW is a convenient (and appropriate) place to get this information. And I expect other users feel similarly.
What's different between this and e.g. the developments with Nonlinear, is that the developments here will have a big impact on how the AI field (and by one layer of indirection, the fate of the world) develops.
I am curious to hear people's opinions, for my reference:
Is epistemic rationality or instrumental rationality more important?
Do you believe epistemic rationality is a requirement for instrumental rationality?
Not directly tied to the core of what you're saying, but I will note that I am example of someone who doesn't strongly prefer such foods warm. I do weakly prefer it being warm, as long as it's not too hot (that's worse than it being cold, because it hurts / causes minor injury), but I'm happy eating it room temperature or a bit cold (not necessarily cold steak though)
My model says that a lot of the changing occurs by gradient descent, which can be interrupted randomly without causing problems. And there's enough redundancy that the reorganization part can be interrupted without the core information being removed completely from the brain, and the redundancy will be replenished (one of copies I imagine is "locked" while the reorganization happens, and is later reorganized later with another copy "locked"). I also expect this replenishing can happen during awakeness, though not as ideally as when asleep.
But I will also note that forgetting is a thing that happens, which is indistinguishable from "data corruption". We're actually quite good at forgetting things.
I had previously posted thoughts that suggested that the main psychoactive effect of chocolate is due to theobromine (which is chemically similar to caffeine). In the interests of publicly saying "oops":
Chocolate also contains substantial amounts of caffeine, and caffeine has a stronger effect per gram, so most of the caffeine-adjacent effect of chocolate comes from caffeine rather than theobromine.
Theobromine may still contribute to chocolate hitting differently than other caffeinated substances, though I expect there are also other chemicals that also contribute to the effect of chocolate. I assign less than 50% probablity to ⌞theobromine being the cause of the bulk of the difference between chocolate's psychoactive effects vs. pure caffeine⌝
I strong-downvoted this post because sentences like
use these insights to derive two methods for provably avoiding Goodharting
Tend to be misleading, pretending that mathematical precision describes the complex and chaotic nature of the real world, where it shouldn't be assumed to (see John Wentworth's comment), and in this case it could potentially lead to very bad consequences if misunderstood.
1
The board's statement doesn't mention them having made such a request to Altman which was denied, that's a strong signal against things having played out that way.