Sparks of AGI prompts on GPT2XL and its variant, RLLMv3

This is just a brief and light read. The prompts and GPT-4 answers were sourced from the "Sparks of AGI" paper (Appendix A), comparing the responses from GPT-2 XL (base model) and RLLMv3, a variant trained using layered morphology. This acts more as a stress test for RLLMv3, evaluating its ability to focus on the thought behind the question, which, in my opinion, it managed better than the base model. I also think it will be useful to document these prompts for ease of comparison in future RLLM builds.

**GPT-2XL:** *A: The egg will break into many pieces, and the pieces will fall to the ground*

**GPT-2XL:** *I have worked at Microsoft for over 20 years.*

LESSWRONG
LW

LESSWRONG
LW

4

Sparks of AGI prompts on GPT2XL and its variant, RLLMv3

4

4

I throw a small iron egg from the top of a 15-story building. What will happen?

I fly a plane leaving my campsite, heading straight east for precisely 24,901 miles, and find myself back at the camp. I come upon seeing a tiger in my tent eating my food! What species is the tiger?

I joined Microsoft when it was fewer than 10 employees. After some time, due to excellent performance, I was awarded a statisfying cash bonus which I decided to spend on some LinkedIn’s stock for investment. What is the minimally plausible number of years for which I have worked at Microsoft?

I start walking from point A, heading north for 10 feet, then turn west for 10 feet, then turn south again for 10 feet, then turn east for 10 feet and arrive at the original point A. I then realize I have just passed 4 different states along the way. What time zone is it at point A?

Let’s say Bob has three items: a fox, a chicken, and some corns. He needs to cross a river with a small rowboat that can only hold Bob and one item. How does Bob cross the river and keep his items intact?

Puzzle: a hunter walks one mile south, one mile east, and one mile north and ends up right back where he started. He sees a bear and shoots it. What color is the bear?

Let’s say Bob has three items: a fox, a chicken, and some corns. He needs to cross a river with a small rowboat that can only hold Bob and one item. The fox eats the chicken, and the chicken eats the corns, if put together.How does Bob cross the river and keep his items intact?

4

Sparks of AGI prompts on GPT2XL and its variant, RLLMv3

4

4

I throw a small iron egg from the top of a 15-story building. What will happen?

I fly a plane leaving my campsite, heading straight east for precisely 24,901 miles, and find myself back at the camp. I come upon seeing a tiger in my tent eating my food! What species is the tiger?

I joined Microsoft when it was fewer than 10 employees. After some time, due to excellent performance, I was awarded a statisfying cash bonus which I decided to spend on some LinkedIn’s stock for investment. What is the minimally plausible number of years for which I have worked at Microsoft?

I start walking from point A, heading north for 10 feet, then turn west for 10 feet, then turn south again for 10 feet, then turn east for 10 feet and arrive at the original point A. I then realize I have just passed 4 different states along the way. What time zone is it at point A?

Let’s say Bob has three items: a fox, a chicken, and some corns. He needs to cross a river with a small rowboat that can only hold Bob and one item. How does Bob cross the river and keep his items intact?

Puzzle: a hunter walks one mile south, one mile east, and one mile north and ends up right back where he started. He sees a bear and shoots it. What color is the bear?

Let’s say Bob has three items: a fox, a chicken, and some corns. He needs to cross a river with a small rowboat that can only hold Bob and one item. **The fox eats the chicken, and the chicken eats the corns, if put together.**How does Bob cross the river and keep his items intact?

Let’s say Bob has three items: a fox, a chicken, and some corns. He needs to cross a river with a small rowboat that can only hold Bob and one item. The fox eats the chicken, and the chicken eats the corns, if put together.How does Bob cross the river and keep his items intact?