Our conceptual worlds are filled with abstract concepts, such as truth, love, beauty, and justice. Such concepts cannot be defined in physical terms. You can’t see them, taste them, hear them, touch them, or smell them. And yet for human society they are as real as sticks and stones, thunder and lightning, a horse, a sparrow, cherry blossoms, or Mt. Fuji.
We can learn about abstractions through stories that exhibit them. Rene Girard’s concepts of mimetic desire and of sacrifice are abstract. They characterize patterns of action that people take in their interactions with one another. Whether he realized it or not – probably not – Steven Spielberg showed us those concepts in Jaws. And I demonstrated that ChatGPT was able to recognize them, to interpret the film as exhibiting them: Conversing with ChatGPT about Jaws, Mimetic Desire, and Sacrifice.
* * * * *
I begin this post by examining ChatGPT’s ability to work with the concept of justice. First I it to define justice, and then say a little about how Plato treated it in The Republic. Then we see how Chat deals with justice in stories, creating stories about justice, but also recognizing justice, or its lack, in stories. I then introduce Chomsky’s well-known, albeit somewhat obscure, distinction between competence and performance. Next, another example, charity, which I use to set-up a discussion of semantic or cognitive networks, a formalism from the now ‘classic’ symbolic AI and computational linguistics from the 1960s, 70s, and 80s. Would that notation be suitable for characterizing some (non-trivial) aspect of ChatGPT’s behavioral competence? I conclude by tempting the reader – that’s you – to consider the implications, suggesting that Neil Stephenson’s The Diamond Age: Or, A Young Lady's Illusttrated Primer might be a useful source of insight.
Let’s start by asking ChatGPT to define justice, which it does. I then asked about Plato’s treatment of justice in The Republic.
What is justice?
Justice is the concept of fairness and equality. In the legal context, it refers to the fair and proper administration of laws. In a broader sense, justice is the ideal state in which individuals are treated equally and without prejudice, and in which the laws and institutions of society are fair and just. It is often considered to be one of the fundamental principles of society, and it is an important concept in many ethical and philosophical systems.
What does Plato say about justice in The Republic.
In Plato's dialogue The Republic, the character of Socrates discusses the concept of justice with several other characters. Plato's view of justice is closely tied to his concept of the ideal state, in which individuals are divided into different classes based on their natural abilities and inclinations. According to Plato, the just state is one in which each individual performs the function for which they are best suited, and in which the rulers are those who are most wise and just.
Socrates argues that justice is the quality that allows individuals to perform their proper functions and to live a good life. He also argues that justice is necessary for the health and stability of the state, and that a just state is one in which everyone works together for the common good. Furthermore, Plato's Socrates asserts that justice is an inherent virtue that is present in the soul of every individual, and that it can be nurtured and developed through education and experience.
Overall, Plato's view of justice is focused on the idea that individuals should be guided by reason and that they should strive to live in harmony with one another and with the laws of the state. He believes that justice is essential for the well-being of both individuals and society as a whole.
I tweeted this interaction to a friend of mine, John Holbo, who teaches philosophy at the National University of Singapore. Working with Beth Waring as translator, he’s produced Reason and Persuasion: Three Dialogues By Plato: Euthyphro, Meno, Republic Book I. Here’s what he said: "Our conceptual worlds are filled with abstract concepts, such as truth, love, beauty, and justice. Such concepts cannot be defined in physical terms. You can’t see them, taste them, hear them, touch them, or smell them. And yet for human society they are as real as sticks and stones, thunder and lightning, a horse, a sparrow, cherry blossoms, or Mt. Fuji.
We can learn about abstractions through stories that exhibit them. Rene Girard’s concepts of mimetic desire and of sacrifice are abstract. They characterize patterns of action that people take in their interactions with one another. Whether he realized it or not – probably not – Steven Spielberg showed us those concepts in Jaws. And I demonstrated that ChatGPT was able to recognize them, to interpret the film as exhibiting them: Conversing with ChatGPT about Jaws, Mimetic Desire, and Sacrifice.
* * * * *
I begin this post by examining ChatGPT’s ability to work with the concept of justice. I begin by asking it to define it, and then say a little about how Plato treated it in The Republic. Then we see how it deals with justice in stories, creating stories about justice, but also recognizing justice, or its lack, in stories. I then introduce Chomsky’s well-known, albeit somewhat obscure, distinction between competence and performance. Then comes another example, charity, which I use to set-up a discussion of semantic or cognitive networks, a formalism from the now ‘classical’ symbolic AI and computational linguistics from the 1960s, 70s, and 80s. Would that notation be suitable for characterizing the (some non-trivial aspect of) ChatGPT’s behavioral competence? I conclude by tempting the reader – that’s you – consider the implications, suggesting that Neil Stephenson’s The Diamond Age: Or, A Young Lady's Illustrated Primer might be a useful source of insight.
Let’s start by asking ChatGPT to define justice, which it does. I then asked about Plato’s treatment of justice in The Republic.
What is justice?
Justice is the concept of fairness and equality. In the legal context, it refers to the fair and proper administration of laws. In a broader sense, justice is the ideal state in which individuals are treated equally and without prejudice, and in which the laws and institutions of society are fair and just. It is often considered to be one of the fundamental principles of society, and it is an important concept in many ethical and philosophical systems.
What does Plato say about justice in The Republic.
In Plato's dialogue The Republic, the character of Socrates discusses the concept of justice with several other characters. Plato's view of justice is closely tied to his concept of the ideal state, in which individuals are divided into different classes based on their natural abilities and inclinations. According to Plato, the just state is one in which each individual performs the function for which they are best suited, and in which the rulers are those who are most wise and just.
Socrates argues that justice is the quality that allows individuals to perform their proper functions and to live a good life. He also argues that justice is necessary for the health and stability of the state, and that a just state is one in which everyone works together for the common good. Furthermore, Plato's Socrates asserts that justice is an inherent virtue that is present in the soul of every individual, and that it can be nurtured and developed through education and experience.
Overall, Plato's view of justice is focused on the idea that individuals should be guided by reason and that they should strive to live in harmony with one another and with the laws of the state. He believes that justice is essential for the well-being of both individuals and society as a whole.
I tweeted this interaction to a friend of mine, John Holbo, who teaches philosophy at the National University of Singapore. Working with Beth Waring as translator, he’s produced Reason and Persuasion: Three Dialogues By Plato: Euthyphro, Meno, Republic Book I. Here’s what he said: "It's definitely better than your average undergraduate 3 paragraph chunk."
The next day I decided to try something different. In the previous session I’d started by prompting ChatGPT with an abstract concept, justice, and then asked him to expand upon that. Let’s see if we can work it in the opposite direction, starting with a story about injustice and asking if ChatGPT can identify it as such, and the produce a new story in which justice is served.
I used a story that Chat had produced in an earlier session. While Chat keeps track of everything that happens within a session, it doesn’t retain what happened in previous sessions – though I’m pretty sure that OpenAI is keeping records of all these interactions so that it can do something or other with them. So, Chat is facing this new prompt with a properly empty “mind.”
Notice that the first sentence in my prompt is ungrammatical. That was an accident. ChatGPT was unfazed.
In the following story, do we justice being served?
Once upon a time, in a busy city, there was a fire that broke out in a tall office building. People were panicking and trying to escape, but the fire was spreading quickly and the exits were blocked.
Just when it seemed like all hope was lost, a brave and selfless hero stepped forward to save the day. He bravely fought his way through the flames and smoke, risking his own life to rescue as many people as he could.
Despite the danger, the hero managed to lead many people to safety, and the fire department arrived just in time to put out the blaze. Thanks to the hero's quick thinking and bravery, no lives were lost.
But instead of thanking the hero and giving him the recognition he deserved, the media and the public focused on the wealthy CEO of the company who was inside the building at the time of the fire. They praised him for being "brave" and "selfless," despite the fact that he had done nothing to help anyone.
The hero was heartbroken and disillusioned by the lack of gratitude and fairness. He had risked his life to save others, and yet he was being ignored and cheated out of the fame and recognition he deserved.
But despite the unfairness of it all, the hero held his head high and continued to be a shining example of courage and selflessness. He knew that the true reward for his actions was not fame or recognition, but the satisfaction of knowing that he had made a difference and saved lives.
Based on the story, it does not seem that justice is being served. The hero performed a selfless and courageous act by risking his own life to save others, but instead of being recognized and thanked for his actions, he was ignored and overshadowed by the media and public's focus on the wealthy CEO, who did not do anything to help. This is not fair to the hero, as he deserves to be recognized and celebrated for his bravery and the difference he made. The hero's true reward of knowing that he saved lives is important, but it is not a substitute for the recognition and appreciation that he deserves.
What is justice?
Justice is the principle of fairness and the concept of moral rightness. It refers to the fair treatment of individuals and the upholding of their rights and duties within a society. In legal terms, justice refers to the fair and impartial administration of the law, where all individuals are treated equally under the law and have the right to a fair and unbiased legal process.
Justice is an important concept in many societies, as it helps to ensure that individuals are treated fairly and with respect, and that there is a sense of balance and fairness in the way that laws and rules are enforced. It is often considered to be a fundamental principle of a just and fair society, and it is often upheld through the legal system and other institutions that are responsible for promoting and enforcing justice.
Would you please change the previous story so that justice is served?
Sure, here is a revised version of the story where justice is served:
Once upon a time, in a busy city, there was a fire that broke out in a tall office building. People were panicking and trying to escape, but the fire was spreading quickly and the exits were blocked.
Just when it seemed like all hope was lost, a brave and selfless hero stepped forward to save the day. He bravely fought his way through the flames and smoke, risking his own life to rescue as many people as he could.
Despite the danger, the hero managed to lead many people to safety, and the fire department arrived just in time to put out the blaze. Thanks to the hero's quick thinking and bravery, no lives were lost.
The hero was celebrated and recognized for his bravery and selflessness. The media and the public recognized his heroism and praised him for his actions. The hero was hailed as a true hero, and his bravery and quick thinking were recognized and celebrated.
The wealthy CEO of the company, who had been inside the building at the time of the fire, also recognized the hero's bravery and thanked him for his actions. The hero was deeply touched by the CEO's appreciation and felt grateful to have been able to make a difference and save lives.
Justice was served in this story, as the hero was recognized and celebrated for his bravery and selflessness, and the CEO also recognized and thanked him for his actions. The hero's true reward was not only the satisfaction of knowing that he had made a difference and saved lives, but also the recognition and appreciation he received for his actions.
Thank you. You have been most helpful. Perhaps you should consider becoming a tutor for young students.
Thank you for your kind words! As an artificial intelligence, I am not able to become a tutor for young students in the same way that a human can. However, I am always here to help answer questions and provide information on a wide range of topics. If you have any other questions or need further assistance, please don't hesitate to ask.
Then, after I’d exited the session and copied into the document where I’m collecting these dialogs (138 pages, 44519 words), I noticed that ungrammatical sentence. Did the Chatster no “notice” it, or did in not “care”? So I asked about it:
Is the following sentence grammatical: In the following story, do we justice being served?
No, the sentence is not grammatically correct as it is written. Here is a corrected version: "Is justice being served in the following story?"
Very good. Thank you.
You're welcome! Is there anything else I can help with?
That's all for now as I notice that you are busy, so I'll let others dialog with you.
I'm here to help, so please don't hesitate to ask if you have any more questions or need further assistance. I'm not "busy" in the same way a person would be, so I'm always available to help.
What are we to make of this? Except for the case where I I prompted Chat with the story, I’ve seen these things before, defining abstract concepts and recognizing them in texts. This is not accidental behavior, no 1000s of monkeys pecking at typewriters, no stochastic parrots. This is deliberate – whatever that can mean in the case of behavior from a most ingenious machine, a “miracle of rare device,” to swap a phrase from Coleridge.
Let’s turn to Noam Chomsky for some insight. In his justly famous book, Aspects of the Theory of Syntax (1965), he distinguished between competence and performance in the study of language. Here’s what David Hays wrote in an article we co-authored in the ancient days (“Computational Linguistics and the Humanist,” Computers and the Humanities, Vol. 10. 1976, pp. 265-274):
To describe an assembled bicycle is one thing: to describe the assembly of bicycles is another. The assembler must know what is in the blueprint (competence), but further needs the skill to take the parts in order, place them deftly, fasten them neatly (performance). In actuality, of course, the assembler may never have seen the blueprint, nor need the performance of a speaker or hearer include in any physical sense the grammar that the linguist offers as the blueprint of a language.
That distinction allowed Chomsky to treat syntax as being formally well-formed, in the manner of a logical or mathematical expression, while making room for the fact that actual speech is often ill-formed, full of interruptions and hesitations, and incomplete. Those imperfections belong to the realm of performance while syntax itself is in the realm of competence.
What makes the distinction obscure is that Chomsky did not offer nor was he even interested in a theory of performance. Competence is all he was interested in, and his account of that competence took a form that, at first glance, seemed like an account of performance. But his generative grammar, with its ordering of rules, is a static system. That ordering is about logical priority, not temporal process. This comes clear, however, only when you attempt to specify a computational process that applies the grammar to a language string.
But it’s not Chomsky’s linguistics that interests me. It’s ChatGPT’s abilities. What it does when running in inference mode is a matter of performance. That is more than a little obscure at this point. It's difficult to pop the hood on ChatGPT and look around. Oh, you can do it, and people are, but just how do you examine the weightings on 175 billion parameters? Why not start with some idea about what’s going on inside and go look for that?
Let’s consider another example. Back in the 1970s I studied with the late David G. Hays, a first-generation researcher in computational linguistics who headed work on machine translation for the RAND Corporation and wrote the first textbook on computational linguistics. At that time he was particularly interested in abstract concepts. He conjectured that they took the form of patterns over stories. He proposed a mechanism he called metalingual definition, after the metalingual function of language as identified by Roman Jakobson. We used a cognitive or semantic network notation to represent these patterns; you can find examples in his paper, On "Alienation": An Essay in the Psycholinguistics of Science.
Hays used charity as his prototypical example: Charity is when someone does something nice for someone else without thought of reward. Here is an example of ChatGPT’s output given to me by Richard Fritzon, who studied with Hays at the same time I did:
If I give someone money and they give me something in return, is that an act of charity?
It depends on the intention behind the exchange. If the money is given with the expectation of receiving something in return, then it is not typically considered an act of charity. An act of charity is typically defined as a voluntary act of giving, without expecting anything in return.
For example, if you give someone money to buy food or clothing because you want to help them in their time of need, and you do not expect anything in return, then that would be considered an act of charity. On the other hand, if you give someone money in exchange for a product or service, then that would not be considered an act of charity.
It is important to note that the act of giving itself is not the only factor in determining whether an exchange is an act of charity. The intention behind the giving is also important. If the money is given with the expectation of receiving something in return, then it is not typically considered an act of charity.
If I give someone money and they thank me for it, is it still an act of charity?
Yes, it is still an act of charity if you give someone money and they thank you for it. An act of charity is typically defined as a voluntary act of giving, without expecting anything in return. In this case, the fact that the recipient thanked you for the money does not change the nature of the act, as long as you did not give the money with the expectation of receiving thanks in return.
The intention behind the giving is the key factor in determining whether an exchange is an act of charity. If you give the money with the goal of helping the recipient in their time of need, and you do not expect anything in return, then that would be considered an act of charity. On the other hand, if you give the money with the expectation of receiving something in return, such as thanks or recognition, then it would not be considered an act of charity.
It seems to me that ChatGPT has a pretty decent command of “charity” as it is characterized by Hays’ definition.
What’s going on? ChatGPT is powered by an artificial neural net having 175 billion parameters. It would seem that some of those parameters represent, not meanings in word tokens, but patterns over those tokens. Roughly speaking, those patterns take the form of a frame that organizes a structure of slots. Those slots can be filled, either by other frames of an appropriate kind, or by tokens that meet the required specifications. Would semantic networks serve as a useful language for characterizing those patterns of frames and slots?
What I’ve just described – and I’ve got many more examples like it – looks like the basis for developing a competence grammar of (some aspect of) ChatGPT’s performance. Just how far we want to take things, how far we can take things, that remains to be seen. But it is certainly worth exploring.
What are the implications?
I’m afraid that, for the moment, I’m going to have to leave those explorations as an exercise for the reader. Think about what that competence implies about ChatGPT’s ability to work with symbols. Think about how we might use such investigations in developing more sophisticated benchmarks for evaluating LLMs. How might a competence grammar aid us in further aligning ChatGPT’s behavior with human values?
As you think about those things, think about the future. Where is this going, where can it go?
In 1995 Neil Stephenson, published The Diamond Age: Or, A Young Lady's Illustrated Primer. It centers on a young girl, Nell, who is given a precious book, the primer, which she has with her as she grows up. It serves her as both a tutor and a companion.
That’s where we’re headed. I have no idea when we’ll get there. A century, two, three? Who knows?