It is instructive to talk to Chatgpt for 10 mins to see what it knows about the rules and strategies for playing tic-tac-toe and then ask it to actually play a game of tic-tac-toe with you using those same strategies. In my experiment, I came to 2 conclusions:
Chatgpt knows everything there is to know about tic-tac-toe and the best strategies for playing it.
Chatgpt is entirely incapable of applying the knowledge it has for (1) in an actual game of tic-tac-toe it is playing with you.
Chatgpt is merely a generative language model: which means it is good at picking the next word given the prompt and the previous words it has output. Sadly, it knows little to nothing about the meaning of those words. It can't use what it knows about a topic (the rules and best strategies for playing tic-tac-toe) to benefit it in relevant scenarios (when playing an actual game of tic-tac-toe). To Chatgpt, (1) and (2) have almost nothing to do with each other because they rarely occur in the same conversation in its training data. Despite this model being able to obviously learn it has no understanding of the things its learned. It cannot use those things to learn new things. In a sense, its web of knowledge is highly disconnected.
It is instructive to talk to Chatgpt for 10 mins to see what it knows about the rules and strategies for playing tic-tac-toe and then ask it to actually play a game of tic-tac-toe with you using those same strategies. In my experiment, I came to 2 conclusions:
Chatgpt is merely a generative language model: which means it is good at picking the next word given the prompt and the previous words it has output. Sadly, it knows little to nothing about the meaning of those words. It can't use what it knows about a topic (the rules and best strategies for playing tic-tac-toe) to benefit it in relevant scenarios (when playing an actual game of tic-tac-toe). To Chatgpt, (1) and (2) have almost nothing to do with each other because they rarely occur in the same conversation in its training data. Despite this model being able to obviously learn it has no understanding of the things its learned. It cannot use those things to learn new things. In a sense, its web of knowledge is highly disconnected.