LESSWRONG
LW

168
Wikitags

Ontology

Edited by Zach Stein-Perlman last updated 14th Aug 2023

Ontology is a branch of philosophy. It is concerned with questions including how can objects be grouped into categories?

An ontology is an answer to that question. An ontology is a collection of sets of objects (or: a collection of sets of points in thingspace).[1] An agent's ontology determines the abstractions it makes.

For example, consider Alice and Bob, two normal English-fluent humans. "Chairs"_Alice is in Alice's ontology; it is (or points to) a set of (possible-)objects (namely what she considers chairs) that she bundles together. "Chairs"_Bob is in Bob's ontology, and it is a very similar set of objects (what he considers chairs). This overlap makes it easy for Alice to communicate with Bob and predict how he will make sense of the world.

(Also necessary for easy-communication-and-prediction is that their ontologies are pretty sparse, rather than full of astronomically many overlapping sets. So if they each saw a few chairs they would make very similar abstractions, namely to "chairs"_Alice and "chairs"_Bob.)

Why care? Most humans seem to have similar ontologies, but AI systems might have very different ontologies, which could cause surprising behavior. E.g. the panda-gibbon thing. Roughly, if the shared-human-ontology isn't natural (i.e. learned by default) and moreover is hard to teach an AI, then that AI won't think in terms of the same concepts as humans, which might be bad. See Ontology identification problem. Also misgeneralization of concepts or goals.

  1. ^

    "Objects" means possible objects, not objects that really exist.

    An ontology can also include an account of other kinds-of-stuff, like properties, relations, events, substances, and states-of-affairs.

Subscribe
Discussion
1
Subscribe
Discussion
1
Posts tagged Ontology
51The Thingness of Things
Ω
TsviBT
3y
Ω
35
28What is ontology?
Q
Adam Zerner, ArtyomKazak
2y
Q
19
213Humans provide an untapped wealth of evidence about alignment
Ω
TurnTrout, Quintin Pope
3y
Ω
94
119In praise of fake frameworks
Valentine
8y
18
111Natural Latents: Latent Variables Stable Across Ontologies
Ω
johnswentworth, David Lorell
14d
Ω
13
813C's: A Recipe For Mathing Concepts
Ω
johnswentworth, David Lorell
1y
Ω
5
75Which values are stable under ontology shifts?
Richard_Ngo
3y
48
72Test Cases for Impact Regularisation Methods
Ω
DanielFilan
7y
Ω
5
69Implications of automated ontology identification
Ω
Alex Flint, adamShimi, Robert Miles
4y
Ω
27
63Simulacra are Things
Ω
janus
3y
Ω
7
53Causal Graphs of GPT-2-Small's Residual Stream
David Udell
1y
7
51General alignment properties
Ω
TurnTrout
3y
Ω
2
42How toy models of ontology changes can be misleading
Ω
Stuart_Armstrong
2y
Ω
0
39Resolving von Neumann-Morgenstern Inconsistent Preferences
niplav
11mo
5
34How are you dealing with ontology identification?
Ω
Erik Jenner
3y
Ω
10
Load More (15/53)
Add Posts