LESSWRONG
LW

Wikitags

Modularity

Edited by CallumMcDougall, et al. last updated 4th Apr 2022

Modularity is the extent to which a system can be divided into clusters. It is a very broad concept which can be applied across many different domains, for example:

In graph theory, modularity can be measured in terms of a graph's structure. For instance, there is a common mathematical definition for graphs, which is based on the idea of modules as partitions of the nodes of a graph, with more edges within modules than would be expected by chance.

In evolutionary biology, modularity has been observed at many different levels, from protein structure to organ systems. There is currently no universally accepted explanation for why modularity seems to have been produced by evolution, and less so by genetic algorithms, although there are widely-held theories (most notably the idea of modularly varying goals, as proposed by Kashtan & Alon).

Modularity may be highly relevant for alignment research, because the more modular a system is, the greater the chances that we will be able to understand the cognition it is performing in terms of high-level abstractions.

Subscribe
1
Subscribe
1
Discussion0
Discussion0
Posts tagged Modularity
99LLM Modularity: The Separability of Capabilities in Large Language Models
Ω
NickyP
2y
Ω
3
15Identification of Natural Modularity
Stephen Fowler
3y
3
53Theories of Modularity in the Biological Literature
Ω
CallumMcDougall, Avery, Lucius Bushnaq
3y
Ω
13
39What Is The True Name of Modularity?
Ω
CallumMcDougall, Lucius Bushnaq, Avery
3y
Ω
10
195Evolution of Modularity
Ω
johnswentworth
6y
Ω
13
34Modularity and Buzzy
Kaj_Sotala
14y
27
31Emergent modularity and safety
Ω
Richard_Ngo
4y
Ω
15
29Modularity, signaling, and belief in belief
Kaj_Sotala
14y
14
74Project Intro: Selection Theorems for Modularity
Ω
CallumMcDougall, Avery, Lucius Bushnaq
3y
Ω
20
62Ten experiments in modularity, which we'd like you to run!
Ω
CallumMcDougall, Lucius Bushnaq, Avery
3y
Ω
3
44Searching for Modularity in Large Language Models
NickyP, Stephen Fowler
3y
3
36Basin broadness depends on the size and number of orthogonal features
Ω
CallumMcDougall, Avery, Lucius Bushnaq
3y
Ω
21
36Selection processes for subagents
Ryan Kidd
3y
2
28The economy as an analogy for advanced AI systems
Ω
rosehadshar, particlemania
3y
Ω
0
28Research Adenda: Modelling Trajectories of Language Models
NickyP
2y
0
Load More (15/21)
Add Posts