[Unnecessary explanation: Some people asked me why I thought the world of Friendship is optimal is dystopic… During the discussion, I inferred that what they saw as a “happy story” in AI safety is something like this: we’ll first solve something like a technical engineering problem, so ensuring that the...
in a nutshell (I don't have the time to write a treatise on this, every word I write is 20w i could have read instead): I'm pretty confident (status: ~ .6) that if SVB had 90bi in gov bonds HTM instead of MBS and the like, it wouldn't have failed. You can say it would have had losses (especially in 2022), it would likely have been bought, but not failed. I know of no bank that has suffered a run because they had too much gov long term bonds (from the corresponding government, and unless the gov defaulted, ofc) in the last century (if you have an example, please enlighten me); not only... (read more)
Because I work for a regulator and am not allowed to do that? Also, many investors won't have enough incentives to read beyond what other investors are reading... except if, as you mentioned, u work w shortselling And shortsellers did make money in this case. So in this sense, the system works... but when it happens to a bank, that's not so cool
and the whole world will care a lot more about this term in bank reports, basically forever.
I'm usually astonished w how seldom investors and supervisors read the fine print in annual reports. I don't think "this time will be different". Unless GPT-like automated report-readers step in (or maybe precisely because humans will leave this boring details to machines), we'll see it happen again.
Btw, I just noticed that $9.3bi of these $15.2 are MBS - yeah, the same type of security associated w the great crisis of 2007-2008. And the HTM total more than U$90 bi, $72bi of which are MBS and CMBS - so dwarfing their investments in bonds, and their $17.6bi... (read more)
Well, I'm kinda sure climbers wouldn't like to brain-upload to a utopia simulation, so maybe there's some connection between this and AI alignment.
(Curiously, just read today Will MacAskill's WWOTF mentioning he used to climb buildings in Glasgow in his teens, until he was almost cut open by glass...)
Thanks, I believe you are right. I really regret how much time and resources are wasted arguing over the extension / reference of a word.
I'd like to remark though that I was just trying to explain what I see as problematic in FiO. I wouldn't only say that its conclusion is suboptimal (and I believe it is bad, and many people would agree); I also think that, given what Celestia can do, they got lucky (though lucky is not the adequate word when it comes to narratives) it didn't end up in worse ways.
As I point out in a reply to shminux, I think it's hard to see how an AI can maximize B's preferences in an aligned way if B's preferences and beliefs are inconsistent (temporally or modally). If B actually regards sim-B as another self, then its sacrifice is required; I believe that people who bite this bullet will tend to agree that FiO ends in a good way, even though they dislike "the process".
Possibly. I said this AGI is “safer and more aligned”, implying that it is a matter of degree – while I think most people would regard these properties as discrete: either you are aligned or unaligned. But then I can just replace it with “more likely to be regarded as safe, friendly and aligned”, and the argument remains the same. Moreover, my standard of comparison was Celest-IA, who convinces people to do brain uploading by creating a “race to the bottom” scenario (i.e., as more and more people go to the simulation, human extinction becomes more likely – until there’s nobody to object turning the Solar System into computronium), and adapts their... (read 412 more words →)
[Unnecessary explanation: Some people asked me why I thought the world of Friendship is optimal is dystopic… During the discussion, I inferred that what they saw as a “happy story” in AI safety is something like this: we’ll first solve something like a technical engineering problem, so ensuring that the AGI can reliably find out what we *really* want, and then satisfy it without destroying the world… In that world, “value” is not a hard problem (we can leave its solution to the AI), so that if we prove that an AI is aligned, we should just outsource everything relevant to it.
As I found out I still had some troubles expressing my objections... (read 915 more words →)
My concern, which I interpret as being TAG's point (but with different words), is that your example of water vs. XYZ is immediately traceable (at least for anyone who knows the philosophical discussion) to Putnam's Twin Earth experiment. The way you express your point suggests you disregard this thought experiment - which is surprising for someone acquainted with it, because Putnam (at least when he wrote the paper) would likely agree that a substance with the same basic chemical properties of water would be water. He actually aims to provide an argument for semantic externalism - i.e., the idea that the meaning of "water" (or of other natural species) is H20, its chemical nature, and not the apparent properties commonly used as criteria to discriminate it (that it's a tasteless liquid...). He's so pushing against a conventionalist view about semantics (and philosophy of language), thus it's not about physics or ontology.
LW is quoted (in a kind of flattering way) in Simon Dedeo's awesome piece on the last Nautil.us issue. For spoiler lovers:
... (read more)[...] Rationality is my ticket out. The only reason I can trust you is that you seem rational enough to talk to. But now you’re telling me that rationality is just a layer on top of the System—it’s just as irrational as the people I’m trying to escape. I don’t know which is worse: being duped by someone else’s priors, or being a biological machine.
Teacher: Don’t go too far. You’re a smart kid—you can iterate faster than most. You can match patterns better. Evolution set you up well. You’ll get better
Strict liability in tort law seems to be a pretty obvious example, doesn't it? I mean, I guess a lot of corporate law can be seen as "vicariously holding a group accountable"
It turns that the truth is more bizarre. From Matt Levine's Money Stuff:
The point I stressed before on government bonds was right: SVB could have borrowed against them. But it seems like I was wrong: it could have borrowed against Agency MBS, too.