What is the relationship between convergent factorization and natural latent?

this sounds like 3. Context Refresh

60% resolved my social anxiety

I'm honestly curious how you measure that. I've been asking myself "am I progressing with respect to social anxiety" and I don't have a good answer.

To me this reads as a definition of the term "free will" and then arguing against its existence.

If something can predict your action with better than random accuracy no matter how hard you try to prevent them, you don’t have free will over that action

The word "try" here hides lots of complexity and does some heavy lifting. Can you taboo it and rephrase that? Also, are you rejecting the computational theory of mind?

In the case of the brain-scanner, I’d say “the second before” just reflects the fact that taking an action in the physical world takes >0 time, and once you’ve made the decision to start the action you are no longer free to reverse it

If you take an agent embedded in the environment, I don't think there is a clear-cut boundary between "not yet made a decision" and "have made the decision". This abstraction just breaks down.

My fear with the teleporter has always been the engineering details - can it get a consistent snapshot of me? what about the last moments after the snapshot and before the old copy is destroyed? can it reliably reconstruct me? what happens in case of a failure?

Assuming many worlds quantum mechanics, we should have similar anticipations for forking into two and for tossing a quantum coin.

There is no rollback when open-weight models are almost SOTA. Could we convince people like Zuck that open weights are too risky? I seriously doubt it.

There are some differences between what women consider attractive female traits and what men actually find attractive. The example I like to give is how some women enlarge their lips even though men (usually) don't find that attractive.

I think these are the relevant points:

Maybe women's sense of each other's beauty is more discriminating than men's.

Some women probably don't distinguish a sex symbol's actual physical attractiveness from the other characteristics that would make her rarely and especially appealing to women (like fame, wealth, etc.), and they're neglecting to account for these factors being less salient to men.

This:

Might agent $b$ rewrite agent $a$'s brain to make agent $a$ better satisfy agent $b$'s utility function?  Most forms of wire-heading inherently limit the ability of agents to affect the future

and this

We have not proved that agent $b$ does not try to affect agent $a$'s utility function (in fact, I expect in many cases agent $b$ does try to influence agent $a$'s utility function).

appear to be in conflict. Are you trying to say that depending on the circumstances b may try to influence a's utility function or avoid doing so?

How important is it to keep the system prompt short? I guess this would depend on the model, but does anybody have useful tips on that?

well-established

The usage I'm objecting to started, as far as I can tell, about 2 years ago with Llama 2. The term "open weights", which is often used interchangably, is a much better fit.