Yusuke Hayashi — LessWrong

LESSWRONG
LW

Universal AI Maximizes Variational Empowerment: New Insights into AGI Safety

Yusuke Hayashi (ALIGN) and Koichi Takahashi (ALIGN, RIKEN, Keio University) have published a new paper on the controllability and safety of AGI (arXiv:2502.15820). This blog post explains the content of this paper.

From automaton to autodidact: AI's metamorphosis through the acquisition of curiosity

Why is AGI Difficult to Discuss? — Introduction

"AGI" (Artificial General Intelligence) refers to AI possessing intelligence equal to or greater than humans, capable of handling diverse tasks, in contrast to traditional narrow AI that specializes in specific tasks. Considering recent rapid developments, some believe that AI qualifying as AGI could be realized within the next few years.

So what would constitute the achievement of AGI? In fact, there is no established definition... (read 1188 more words →)

Replying toIs "red" for GPT-4 the same as "red" for you?

Yusuke Hayashi3y

Is "red" for GPT-4 the same as "red" for you?

Dear Charlie,

Thank you for sharing your insights on the relationship between consciousness and AI alignment. I appreciate your perspective and find it to be quite thought-provoking.

I agree with you that the challenge of AI alignment applies to both conscious and unconscious AI. The ultimate goal is indeed to ensure AI systems act in a manner that is beneficial, regardless of their conscious state.

However, while consciousness may not directly impact the 'good' or 'bad' actions of an AI, I believe it could potentially influence the nuances of how those actions are performed, especially when it comes to complex, human-like tasks.

Your point about the complexity of modeling a human using "qualia" is well-taken. It's... (read more)

Replying toIs "red" for GPT-4 the same as "red" for you?

Yusuke Hayashi3y

Is "red" for GPT-4 the same as "red" for you?

Dear Portia,

Thank you for your thought-provoking and captivating response. Your expertise in the field of biological consciousness is clear, and I'm grateful for the depth and breadth of your commentary on the potential implications of this paper.

If we accept the assumption that the subjectivity of a specific qualia is defined by its unique and asymmetric relations to other qualia, then this paper indeed offers a method for verifying the possibility that such qualia could be experienced similarly among humans. Your point that the 'hard problem' of consciousness may not be as challenging as we previously thought is profoundly important.

However, I hold a slightly different view about the 'new approach to deciphering neural... (read more)

Is "red" for GPT-4 the same as "red" for you?

Yusuke Hayashi

Penned by Yusuke Hayashi, an independent researcher hailing from Japan, this article bears no affiliation to the authors whose scholarly works are referenced herein. Demonstrating intellectual autonomy, the analysis presented is unequivocally distinct from the cited publications.

Have you ever wondered if the "red" you perceive is the same "red" someone else experiences? A recent study explores this question using a distance measure called the Gromov-Wasserstein distance (GWD).

Is my “red” your “red”?: Unsupervised alignment of qualia structures via optimal transport^[1]
Paper (Preprint by Kawakita et al. published in PsyArXiv): https://psyarxiv.com/h3pqm
Slide (Presentation by Masafumi Oizumi at Optimal Transport Workshop 2023): https://drive.google.com/file/d/1Z5QTxayqJkmYyOgirrbJRRflY8HOy8ox/view?usp=sharing

In the paper "Is my "red" your "red"? : Unsupervised Alignment of Qualia Structures by... (read 502 more words →)