119

LESSWRONG
LW

118

Joel Burget's Shortform

by Joel Burget
11th Jun 2022
1 min read
5

2

This is a special post for quick takes by Joel Burget. Only they can create top-level comments. Comments here also appear on the Quick Takes page and All Posts page.
Joel Burget's Shortform
5Joel Burget
3Joel Burget
1Joel Burget
0Joel Burget
2ChristianKl
5 comments, sorted by
top scoring
Click to highlight new comments since: Today at 2:13 AM
[-]Joel Burget1y*50

From the latest Conversations with Tyler interview of Peter Thiel

I feel like Thiel misrepresents Bostrom here. He doesn’t really want a centralized world government or think that’s "a set of things that make sense and that are good". He’s forced into world surveillance not because it’s good but because it’s the only alternative he sees to dangerous ASI being deployed.

I wouldn’t say he’s optimistic about human nature. In fact it’s almost the very opposite. He thinks that we’re doomed by our nature to create that which will destroy us.

Reply
[-]Joel Burget3y30

The Soviet nail factory always used to illustrate Goodhart's law... did it actually exist? Some good answers on the skeptics StackExchange https://skeptics.stackexchange.com/questions/22375/did-a-soviet-nail-factory-produce-useless-nails-to-improve-metrics

Reply
[-]Joel Burget1y10

Why does Golden Gate Claude act confused? My guess is that activating the Golden Gate Bridge feature so strongly is OOD. (This feature, by the way, is not exactly aligned with your conception of the Golden Gate Bridge or mine, so it might emphasize fog more or less than you would, but that’s not what I’m focusing on here). Anthropic probably added the bridge feature pretty strongly, so the model ends up in a state with a 10x larger Golden Gate Bridge activation than it’s built for, not to mention in the context of whatever unrelated prompt you’ve fed it, in a space not all that near any datapoints it's been trained on.

Reply
[-]Joel Burget8mo0-1

Pandora's box is a much better analogy for AI risk, nuclear energy / weapons, fossil fuels, and bioengineering than it was for anything in the ancient world. Nobody believes in Greek mythology these days but if anyone still did they'd surely use it as a reason that you should believe their religion.

Reply
[-]ChristianKl8mo20

Egyptians felling all their trees and turning their environment into a desert feels quite similar to fossil fuels. 

Reply
Moderation Log
More from Joel Burget
View more
Curated and popular this week
5Comments