LESSWRONG
LW

Wikitags

Language model cognitive architecture

Edited by Seth Herd, niplav last updated 19th Sep 2024

Language model cognitive architectures (LMCAs) are also called language model agents or scaffold agents. AutoGPT is the best-known example. It and other LMAs use a large language model and other components to create a goal-directed, agentic system. They use a large language model as a sort of "cognitive engine" performing much of the cognitive work, and incorporate other components to make the composite system goal-directed, and to fill in gaps in and extend the LLMs cognitive abilities.

The term language model agent better captures the inherent agency of such a system, while "language model cognitive architecture" better captures the extensive additions to the LLM, and the resulting change in function and capabilities. Episodic memory may be one key cognitive system; vector-based systems in LMCAs to-date are quite limited, and humans with episodic memory problems are limited in the complexity and time-horizon of problems they can solve.

LMCAs are arguably a likely candidate for the first agentic, self-aware and self-improving AGIs.

See Also

  • Chain of Thought Alignment
Subscribe
Subscribe
Discussion0
Discussion0
Posts tagged Language model cognitive architecture
248On AutoGPT
Zvi
2y
47
235A Three-Layer Model of LLM Psychology
Ω
Jan_Kulveit
7mo
Ω
15
153Decomposing Agency — capabilities without desires
Ω
owencb, Raymond Douglas
1y
Ω
32
95Scaffolded LLMs as natural language computers
beren
2y
10
88Capabilities and alignment of LLM cognitive architectures
Ω
Seth Herd
2y
Ω
18
59AI Assistants Should Have a Direct Line to Their Developers
Ω
Jan_Kulveit
8mo
Ω
6
34Scaffolded LLMs: Less Obvious Concerns
Ω
Stephen Fowler
2y
Ω
15
33AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them
Ω
Roman Leventov
2y
Ω
9
31Good Bings copy, great Bings steal
dr_s
1y
6
26What is the best argument that LLMs are shoggoths?
JoshuaFox
1y
22
148On Devin
Zvi
1y
34
14The Functionalist Case for Machine Consciousness: Evidence from Large Language Models
James Diacoumis
7mo
24
12Apply to Aether - Independent LLM Agent Safety Research Group
RohanS
1y
0
2How LLMs Learn: What We Know, What We Don't (Yet) Know, and What Comes Next
Jonasb
1y
0
1Navigating the Attackspace
Jonas Kgomo
2y
0
Load More (15/16)
Add Posts