George3d6

Old man 1: Life is one trouble after another. I'd be better off dead, better yet, I wish I was never born

Old man 2: True, true, but who has such luck ?.. maybe one in a thousand.

My blog: https://cerebralab.com

I'm also building an open source generic ML library: https://github.com/mindsdb/mindsdb & https://github.com/mindsdb/lightwood .... which I guess might be of interest to some people here

Wiki Contributions

Comments

Well, I perfectly agree with you then. This is why I've never written anything I'd intend to publish in an academic setting nor anything I'd consider to be pure philosophy.

See what I previously wrote, in my opinion you should make an effort to read rather than pattern match to existing concepts.

Why is a moratorium bad in that case?

For reference, I disagree with the moratorium slightly, but for different reasons.

See reply above, I don't think I'm bringing Moloch up here at all, rather individuals being evil in ways that leads to both self and systemic harm, which is an easier problem to fix, if still unsolvable.

Moloch is not, in my opinion, the correct analogy to use for systemic problems.

Moloch absolves humans of guilt for systemic problems by hand waving them away as self interest.

But systemic problems usually stem from things that are both bad when done in aggregate and bad for us as individuals. Hence why my analogy used a button that would give one nothing of value, just something we from our blind position would think to be of value.


I agree with the rest of your comment but it's trivial to replicate the work by anthropic or openai in a focused direction. It's already been done.

Their main edge is the RLHF datasets they have but those are good for safety (arguably, ad you point out) and for capabilities in-so-far as they are interacting with humans that haven't trained to use such systems.

So we do and likely will live in the hardest of worlds, where it's all open source.

Did you ever write anything on this topic?

I've been considering going phone minimalist, though phone-less wouldn't be an option for me, and I'm actually interested in the outsider view of someone around my age here.

Yes, they can, and quite sophisticatedly too - think examples like vampire bats engaging in long-term reciprocity in food exchanges, while paying attention to who welshes on requests and how much food they have to spare to barf up.

I mean between species, it seems reasonable to assume both we and the bat can't understand each other's values, even if we can understand those of our own species.

I think you're missing the whole point by handwaving the idea that "animals can understand reward and instruction" -- no they can't, and that's why we enslave and genetically engineer, not trade.

Lassy would indeed be getting the big bucks were we able to communicate with her directly (and were she a wolf with desires beyond William-syndrome-induced pro-social obedience)

Ultimately this gets back into a "hard" alignment problem, in so far as a system designed to "trade" with humans, i.e. break the communication barrier to understanding our goals and desires or at least be able to sign contracts upholding those... well, it's 0.0...01 from being aligned 

Would the stakes be high enough to get participants in the market? m&m always seemed fairly unreliable to me, hype is required to generate answers and answers can be extensively biased due to the lack of a real incentive.

Still, if you'd be down for creating the markets yourself or know someone that would, I'm pretty sure the author would be ok sharing more specific predictions around TOGETHER.

Load More