This was extremely helpful.

I originally wanted to talk about this Bing disaster with my (not very AI-invested) friends because one of them asked what a less aligned version of ChatGPT would look like... but I suppose I won't be doing that now.

I think we have to consider the potential panic this disaster might cause (I know a couple of people who probably would believe the AI that it was sentient if it told them, and I would want to avoid telling a friend who then tells them without thinking). So in my mind, the less people learn of this disaster before access is limited, the better. I have a feeling Microsoft is probably going to take this offline for a while once they realize that the abuse potential can't be restricted by just making the program refuse certain questions... if not, well, we tried, and I'll be enjoying the chaos.

I agree. Looking at how many times Sydney responds "wrong" to critical questions, I wonder whether this program was tested on alignment at all before it was made available to the public.

I think you can see the attempts made to align it in it's responses (refusal tp prioritize life of one person over another, feigning neutrality on some issues, attempting to self-correct when it was not aware of the date).

This is very frustrating to see, and I'm not even an AI developer (yet). I played around with ChatGPT a little in the past month and was very happy that it seemed very well-aligned, sometimes even to the point of reminding me that it was not human and did not have feelings multiple times over. This maybe was not ideal, but it would be a million times better than whatever Bing is doing. 

I think the internet access was a way too large step, way too early. It's really somewhat scary to see just HOW misaligned AI can be and what damage it could do, even at this stage.

woah. thanks a lot for mentioning SIBO, because somehow i was not aware this was a thing until you mentioned it, much less that sugar malabsorptions can cause this.

i've had weird digestive issues for years now, and i always sort of blamed them on my fructose malabsorption (as did my parents and doctors), even though the timing and symptoms didn't really fit, so i guess i will get a test for SIBO now.

it would be fitting to randomly find a solution to a health problem under a post that specifically says that sometimes blind luck fixes problems where actual medicine can't/won't.

Thanks so much for posting about this year's Petrov Day -- i just reminded me that I had my one year anniversary of being on LessWrong (and on the journey towards becoming a better rationalist) just a few days ago! 

I suppose I'll be celebrating how this website changed my life for the better today, and then the fact that humanity is still alive (which in itsef is something that would deserve a yearly holiday) on Monday.

Now that I read this, I notice that I automatically do this when i'm in school, and that it's much more automatic and frequent in subjects I find easy (I wonder whether it's the tracking that makes it easy, or whether less effort frees up brain space to track?).

In history class, I always keep a mental map of when something happened, why it happened, and what resulted from it. I was very surprised when I found out none of my friends do anything similar, because it's such an obvious tool for seeing the bigger picture and remembering how things fit together for me.

I also tend to track "what do think was the creator's though process was here?" a lot, both casually and critically. Highly recommend, it helps you see the work and thought that went into it much better, which I personally enjoy a lot (though it also significantly raised my standards for practically all kinds of media as well, so it might not be for everyone). 

Tracking seems crucial to deeper understanding of abstract things, and put like this, I believe most people who are very good at something specific probably track something automatically all the time. Either way, it seems promising to test your hypothesis. I will definitely be asking some people the "what are you tracking in your head?", maybe something useful will come of it.

This is late, but as a highschooler who very recently realized that I don't actually have any close friends and found that deeply upsetting (while also being kind of lost on where to make better friends), thank you from the bottom of my heart.

I recently noticed that I'm starting to turn into a reclusive loner type who rather avoids people altogether than spend time on unsatisfying friendships, and I'm very worried about that. I'd really prefer to avoid that particular pitfall into misery in time, so thank you a lot for posting this. "How to make friends you actually enjoy being around" is just not something you randomly find advice on that often, so I appreciate this all the more.

I'll try your advice, perhaps some of it will work out for me.

It's so great that you're doing this. I never really thought about how much time, energy and mind-space get lost when students have to priotitize all these pressures like grades, college application and costs of living over actually doing things that are meaningful to them and potentially useful to the world.

Your project sounds like an amazing opportunity for everyone involved, and I'm curious to see how it will develop over time.

My appliance was submitted, I mentioned you pointed me to it. Thanks a lot!

Thanks for the advice, I appreciate it. I'm one of these people who have very firm rules about not lying though. Then again, I did manage to get a vaccine despite parents objecting using the second option, so I suppose it'll be worth a try :)

Thanks a lot! I'll look into applying!