LESSWRONG
LW

503
Wikitags

Language model cognitive architecture

Edited by Seth Herd, niplav last updated 19th Sep 2024

Language model cognitive architectures (LMCAs) are also called language model agents or scaffold agents. AutoGPT is the best-known example. It and other LMAs use a large language model and other components to create a goal-directed, agentic system. They use a large language model as a sort of "cognitive engine" performing much of the cognitive work, and incorporate other components to make the composite system goal-directed, and to fill in gaps in and extend the LLMs cognitive abilities.

The term language model agent better captures the inherent agency of such a system, while "language model cognitive architecture" better captures the extensive additions to the LLM, and the resulting change in function and capabilities. Episodic memory may be one key cognitive system; vector-based systems in LMCAs to-date are quite limited, and humans with episodic memory problems are limited in the complexity and time-horizon of problems they can solve.

LMCAs are arguably a likely candidate for the first agentic, self-aware and self-improving AGIs.

See Also

  • Chain of Thought Alignment
Subscribe
Discussion
Subscribe
Discussion
Posts tagged Language model cognitive architecture
248On AutoGPT
Zvi
2y
47
240A Three-Layer Model of LLM Psychology
Ω
Jan_Kulveit
9mo
Ω
15
155Decomposing Agency — capabilities without desires
Ω
owencb, Raymond Douglas
1y
Ω
32
97Scaffolded LLMs as natural language computers
beren
3y
10
88Capabilities and alignment of LLM cognitive architectures
Ω
Seth Herd
3y
Ω
18
59AI Assistants Should Have a Direct Line to Their Developers
Ω
Jan_Kulveit
10mo
Ω
6
34Scaffolded LLMs: Less Obvious Concerns
Ω
Stephen Fowler
2y
Ω
15
33AGI will be made of heterogeneous components, Transformer and Selective SSM blocks will be among them
Ω
Roman Leventov
2y
Ω
9
31Good Bings copy, great Bings steal
dr_s
1y
6
26What is the best argument that LLMs are shoggoths?
JoshuaFox
2y
22
148On Devin
Zvi
2y
35
14The Functionalist Case for Machine Consciousness: Evidence from Large Language Models
James Diacoumis
9mo
24
13Apply to Aether - Independent LLM Agent Safety Research Group
RohanS
1y
0
2How LLMs Learn: What We Know, What We Don't (Yet) Know, and What Comes Next
Jonasb
1y
0
1Navigating the Attackspace
Jonas Kgomo
2y
0
Load More (15/16)
Add Posts