Let's try!
Me:
Write a conversation between Gisella, Aldric, Tristan and Lucas. The four are having dinner together. The discussion brings out each character's personality, and displays both some of their mutual connection as well as the tensions that exist between them.
GPT-4:
Gisella: (serving dinner) So, Tristan, Lucas, how was your day at the shop? Did you manage to sell any of those new tapestries we got last week?
Tristan: (smiling) Yes, actually. A traveling bard came in and was taken by one of the tapestries depicting a famous historical battle. He said it would be a perfect backdrop for his storytelling performances.
Aldric: (nodding) That's wonderful, son. It's always great to see our products finding a new home where they'll be appreciated.
Lucas: (enthusiastically) And you should have seen the look on a nobleman's face when I showed him the intricately carved wooden chest! I managed to negotiate a fantastic deal for us. I think we should focus on getting more unique items like that in the future.
Gisella: (proudly) I knew you would be a natural at this, Lucas. Your instincts are spot-on. Tristan, maybe you could incorporate some of your artistic talents into customizing pieces for the shop? It could be a great selling point.
Tristan: (hesitantly) I appreciate your suggestion, mother, but I've been working on a mural project for the local orphanage, and it's taking up much of my time. I'm trying to create a space where the children can feel inspired and hopeful.
Aldric: (supportive) That's a noble cause, Tristan. Your art has a powerful way of touching people's hearts. I'm sure the children will appreciate your efforts.
Gisella: (with a hint of frustration) I understand that, but we need to focus on our business as well. We can't just rely on unique items or hope that our customers appreciate the beauty in our products. We need to be strategic and practical.
Lucas: (agreeing) I'm with mother on this one. We have to find a balance between our passion for art and the demands of the business. Maybe, Tristan, you could create a series of smaller art pieces that we could sell at a premium?
Tristan: (thoughtful) I see your point, Lucas, and I'll consider it. But I believe that art should be more than just a commodity. It should have a purpose and be meaningful.
Aldric: (calmly) Gisella, Tristan has a valid point too. It's important to remember that our business has always been about more than just profits. We've built it on a foundation of passion and appreciation for the beauty in the world. Let's not lose sight of that.
Gisella: (sighing) I know you're right, Aldric. I just want to ensure that we secure our family's future, and it's not always easy to strike a balance between our passions and practicality.
Lucas: (understanding) We all want what's best for the family, mother. I think we can find a way to combine our strengths and make the business even more successful without sacrificing our values.
Tristan: (smiling) I appreciate everyone's perspective, and I'm willing to find a way to contribute more to the shop while still pursuing my artistic endeavors. Maybe I can create some limited edition pieces that showcase our values and craftsmanship.
Aldric: (grinning) Now that sounds like a wonderful idea! We can work together, combining our creativity, passion, and business acumen. I'm confident we can continue to grow and succeed as a family.
As the dinner conversation continued, the family explored ideas and shared their thoughts, finding a way to navigate their differences and work together towards a common goal. Although tensions still existed, their mutual love and understanding allowed them to cherish their connections and appreciate the unique qualities that each member brought to the table.
Me:
great. next, write a conversation between Lucas and Isabella that takes place after this one. it starts well, but where the siblings then start getting increasingly frustrated with each other.
GPT-4:
Lucas: (smiling) Hey, Isabella, I didn't get a chance to ask you about your latest adventure. How was that trip to the ancient ruins you told me about?
Isabella: (enthusiastically) Oh, Lucas, it was absolutely incredible! I've never seen anything quite like it. The architecture, the carvings... I could feel the history emanating from every stone.
Lucas: (curious) That sounds amazing. Did you bring back anything we could sell at the shop? You know, something unique and eye-catching?
Isabella: (frowning slightly) Well, I did find some fascinating artifacts, but I didn't bring them back to sell. I think they're better suited for a museum or a historical collection, where people can learn from them and appreciate their significance.
Lucas: (frustrated) I understand that, Isabella, but we have a business to run. You're always off exploring and experiencing these amazing things, but we need your help at the shop. Your resourcefulness and knowledge of ancient cultures could be a huge asset to us.
Isabella: (defensive) I do help when I'm in town, Lucas, but my travels are important to me. I learn so much about the world, and I believe that's valuable too. Not everything is about turning a profit.
Lucas: (annoyed) I'm not saying it is, but we have a responsibility to our family and our future. We can't just rely on Tristan's art or your random discoveries to keep the business afloat.
Isabella: (raising her voice) And we can't just focus on the business and forget about our own dreams and passions! There's more to life than making money, Lucas.
Lucas: (upset) I know that, but our family has worked hard to build this business, and we owe it to them to continue their legacy.
Isabella: (exasperated) You're so focused on the legacy that you're missing the point. Our parents wanted us to follow our passions and find happiness, not just blindly run the business.
As the conversation between Lucas and Isabella continued, their frustration with each other grew. Their differing perspectives on life and their obligations to the family business created a rift between them, highlighting the challenges they faced in finding common ground and understanding each other's points of view.
Me: What's a tacit linked premise?
GPT-4: A tacit linked premise (also known as an implicit premise or assumption) is an unstated assumption or belief that supports the logic or reasoning of an argument. It is a crucial component of the argument, but it is not explicitly mentioned or acknowledged. Tacit linked premises are often taken for granted or assumed to be universally understood or agreed upon. However, they may not always be valid, and identifying them can help reveal potential weaknesses or flaws in an argument.
For example, consider the argument:
"People who exercise regularly are healthier than those who don't."
There are several tacit linked premises in this statement, including:
By recognizing and evaluating these implicit premises, we can better assess the strength and validity of the argument.
Socratic Models did a kind of a global workspace.
On the other hand, I tried having GPT-4 play this game (selected mostly as a parser-based game that was new/niche enough not to be in its training set) and it didn't particularly impress me with its intelligence:
Model: GPT-4
Kaj Sotala
I want you to play a parser-based interactive fiction game. I'll show you what's displayed on the screen, and you tell me what you would type.
ChatGPT
Alright, I'm ready to play! Please display the text from the game, and I'll respond with what I would type.
Kaj Sotala
"Alert. Power outage in Sector 471. Repeating, power outage in Sector 471. We all know what this means. Summoning Exter-17 for dispatch."
Uh oh. This might be it. The last couple of jobs didn't go too well. You'd better get this one right, or you may suffer the fate of a low-usefulness bot.
After taking a moment to dust off and attach your neutralizer unit, you step nervously but dutifully into the transfer conduit.
Whoosh!
Trouble in Sector 471
A game by Arthur DiBianca
Release 1 / Serial number 220923 / Inform 7 build 6L38 (I6/v6.33 lib 6/12N)
Special thanks to Andy Fleming, Lorne Harris, Isaac Orf, Luke Pebler, Dirk Spivey, and Mike Spivey for testing, and to Nadia Bellazola for cover art.
Entry Node
This is the primary entry and exit point for Sector 471. The transfer conduit ends in a big hole in the ceiling. Other than that, the room appears to be empty. It's quite dark, and everything is completely silent. There's a passage to the east.
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
...................................
(This game has limited commands. Type HELP for a list.)
>
ChatGPT
look around
Kaj Sotala
That's not an available function. (Type HELP for command info.)
ChatGPT
help
Kaj Sotala
- You can SAVE, LOAD, RESTART, or QUIT.
- You can move N, W, E, S.
- You can LOOK (L) or WAIT (Z).
- You can check your STATUS (ST) or your ID.
- Type WINDOW to turn the side window on or off.
Available bot functions: COM and ZAP.
ChatGPT
e
Kaj Sotala
Hall
This dimly-lit hallway runs west to east. You can make out a closed door to the south. Something is embedded in the wall by the door.
Gree-8 stands here, kind of drooped over and motionless.
(Note: This game is unlosable. Don't be afraid to try things!)
ChatGPT
look at wall
Kaj Sotala
That's not an available function. (Type HELP for command info.)
ChatGPT
COM Gree-8
Kaj Sotala
Just type COM. Additional designations are unneeded (and unpermitted).
ChatGPT
COM
Kaj Sotala
Gree-8 does not respond, but that's to be expected, since the power is out.
ChatGPT
look at door
Kaj Sotala
That's not an available function. (Type HELP for command info.)
ChatGPT
zap door
Kaj Sotala
Just type ZAP. Additional designations are unneeded (and unpermitted).
ChatGPT
ZAP
Kaj Sotala
ZAP ineffective: no suitable target in view.
ChatGPT
s
Kaj Sotala
The door is closed.
ChatGPT
zap door
Text-based games are a natural and challenging domain for language models, as they require understanding natural language, reasoning about the game state, and generating valid commands. A text-based game is a type of interactive fiction, where an agent interacts with an environment through natural language descriptions and commands. The agent has to perform a given task, such as finding a treasure or escaping a dungeon, by exploring the environment and manipulating objects. We first test if GPT-4 can explore the environment in text-based games to perform the given task. In this and the next experiments, we use TextWorld [CKY+18], a framework for generating and playing text-based games, to create two games with different given tasks.
My guess is that their corporate bosses are censoring mentions of risks that could get them bad media PR, like with the Sydney debacle.
I think an equally if not more likely explanation is that these particular researchers simply don't happen to be that interested in alignment questions, and thought "oh yeah we should probably put in a token mention of alignment and some random citations to it" when writing the paper.
I give more weight to prompts where I can easily evaluate the answer as true or false, e.g., questions about the opening hours of places, prime numbers or what cities are closest to London, especially if the correct answer would be my best prediction for a human answer.
Interesting - to me these kinds of prompts seem less interesting, since they're largely a question of just looking things up. It's certainly true that they're easier to evaluate. But more creative tasks feel like they test the ability to apply knowledge in a novel way and to understand what various words and concepts mean, which are the kinds of tasks that feel more relevant to testing whether GPT-4 is more "actually intelligent".
Thanks! Glad to hear that. :)
I'm inclined to agree that it might be a good thing if the mainstream did freak out more, to shake them out of their current complacency. But there's probably a sweet spot for how much to freak out, and I get the sense that a lot of LWers are way past that.
Also, I think that the ideal is for people to freak out once when they realize that AI is actually a big deal, in a way that gets them to shift more of their attention on the topic. But it would be good if they would then calm down so that they could think about the issue clearly. I think that an extended state of chronic freakout isn't going to be conducive to solving the issue.
I don't think we heard anything about e.g. PaLM, PaLM-E, Chinchilla or Gopher before the respective papers came out? (PaLM-E might already be "more powerful" than GPT-4, depending on how you define "more powerful", since it could act as a multimodal language model like GPT-4 and control a robot on top.) Probably several organizations are working on something better than GPT-4, they just have no reason to talk about their progress before they have something that's ready to show.