626

LESSWRONG
LW

625
Boundaries / Membranes [technical]AI
Frontpage

15

[ Question ]

What technical topics could help with boundaries/membranes?

by Chris Lakin
5th Jan 2024
1 min read
A
13
25

15

15

What technical topics could help with boundaries/membranes?
7Chris Lakin
3Chris Lakin
1Chris Lakin
3Chris Lakin
3Chris Lakin
7Roman Leventov
1Chris Lakin
2Alexander Gietelink Oldenziel
1Chris Lakin
2Alexander Gietelink Oldenziel
2Chris Lakin
3Roman Leventov
1Chris Lakin
2Chris Lakin
4Roman Leventov
1Chris Lakin
1Chris Lakin
1Ustice
1Chris Lakin
1Chris Lakin
4Roman Leventov
1Chris Lakin
1Chris Lakin
1Chris Lakin
1Chris Lakin
New Answer
New Comment

13 Answers sorted by
top scoring

Chris Lakin

Jan 05, 2024

70

Scott Garrabrant’s work: Embedded Agency, Cartesian Frames, Finite Factored Sets

Add Comment

Chris Lakin

Jan 05, 2024

30

Cyborgism (for empowering membranes / making them better at defending themselves)

Also Capabilitarianism

Does anyone have good links for these^?

Add Comment
[-]Chris Lakin2y10

thx to friend:

The key scholars are Amartya Sen and Martha Nussbaum. SEP  is a good place to get oriented: https://plato.stanford.edu/entries/capability-approach/ 

Reply

Chris Lakin

Jan 05, 2024

30

Cybernetics

  • Viable system model
  • Management cybernetics
  • Viable systems approach
Add Comment

Chris Lakin

Jan 05, 2024

30

Markov blankets, active inference, the free energy principle

Add Comment
[-]Roman Leventov2y71

Related, quantum information theory:

  • The physical meaning of the Holographic Principle., https://chrisfieldsresearch.com/holo-pub-Quanta-2022.pdf, and many other related papers on Quantum Free Energy Principle at https://chrisfieldsresearch.com/
Reply
1Chris Lakin2y
Oh, yes! I forgot about your original comment about this

Alexander Gietelink Oldenziel

Jan 05, 2024

20

Great initiative !

I've always been intrigued by Andrew Critch's suggestion that the problem of commitment races in game theory and other forms of threats may be 'resolved' by thinking in terms of boundaries as natural BATNA points

https://www.lesswrong.com/tag/commitment-races

Add Comment
[-]Chris Lakin2y10

Any link to Critch suggesting this?

Reply
2Alexander Gietelink Oldenziel2y
Iirc it's in the original boundaries sequence. Sorry I'm too lazy to look it up. It's the part about natural bargaining points and people being able to 'go home'

Chris Lakin

Jan 05, 2024

20

The concept of “separation of tasks” from Adlerian Psychology. This is where many of my intuitions originally came from. This isn't technical though.

Add Comment
[-]Roman Leventov2y30

Psychology may not be "technical enough" because an adequate mathematical science or process theory is not developed for it, yet, but it's ultimately very important, perhaps critically important: see the last paragraph of https://www.lesswrong.com/posts/AKBkDNeFLZxaMqjQG/gaia-network-a-practical-incremental-pathway-to-open-agency. Davidad apparently thinks that it can be captured with an Infra-Bayesian model of a person/human.

Also on psychology: what is the boundary of personality, where just a "role" (spouse, worker, etc) turns into multiple-personality disorder?

Reply
1Chris Lakin2y
oh good, my other project is psychology, so I really hope it circles back. I originally got into the AI safety stuff because I was trying to understand psychological boundaries properly and realized that no one did. Then I realized that many people were maybe doing the same thing when thinking about interactions between AIs and humans.

Chris Lakin

Jan 05, 2024*

20

Biology

  • Michael Levin’s work on cell cooperation
    • eg The Computational Boundary of a “Self”
    • eg Nested Selves: Self-Organization and Shared Markov Blankets in Prenatal Development in Humans
  • cell gap junctions
Add Comment
[-]Roman Leventov2y42

Related, consciousness frame: where is the boundary of it? Is our brain conscious, or the whole nervous system, or the whole human, or the whole human + the entire microbiome populating them, or human + robotic prosthetic limbs, or human + web search + chat AI + personal note taking app, or the whole human group (collective consciousness), etc.

Some computational theories of consciousness attempt to give a specific, mathematically formalised answer to this question.

Reply
1Chris Lakin2y
Hmm I'm confused about why people ask "where is the boundary?" in this situation.  I visualize this situation as more of a topological map, kinda like where the horizontal axes are kinda like physical space (more precisely: such that pieces (e.g.: your arm, your brain, web search, personal note taking app) thar are more closely connected are closer horizontally) and the vertical axis is like "communication bandwidth". For example, the communication bandwidth (ability to sense and control) between your brain/nervous system and your arm is pretty darn high, probably higher than almost anything else in the universe. Yeah, you could try to cut out a particular hill in that topology and say "that hill is Bob" but that's obviously cutting a lot of detail.
1Chris Lakin2y
This is also maybe one of my qualms about anchoring this idea on the words "membranes" and "boundaries"... i think the actual structure is a bit more continuous. "Membranes" are a nice anchor abstraction for other reasons though so I'm sticking with it for now

Ustice

Jan 05, 2024

10

Mathematics

  • Category theory because it will help you spot patterns in your membrane interfaces
  • Graph theory to learn about network effects and simplifications as multiple membranes interact
  • Type theory if you’ll be writing code
  • Set theory maybe?
  • Linear algebra to handle convolutions
Add Comment

Chris Lakin

Jan 05, 2024

10

Non-technical topics thread

  • geopolitics, sovereignty
Add Comment

Chris Lakin

Jan 05, 2024

10

(This all seems very Sante Fe. Anything from the Sante Fe Institute to link?)

Add Comment
[-]Roman Leventov2y40

In the most recent episode of his podcast show, Jim Rutt (former president of SFI) and his guest talk about membranes a lot, the word appears 30 times on a transcript page: https://www.jimruttshow.com/cody-moser/

Reply
1Chris Lakin2y
thanks just listened to it. This reminds me a lot of what Scott Garrabrant has been thinking about. Perhaps intentionally setting up membranes within a society so that failure/infection/etc. in one region doesn't infect every other region. They talk about the same thing but for insight in solving problems

Chris Lakin

Jan 05, 2024

10

Program design

  • separation of concerns
Add Comment

Chris Lakin

Jan 05, 2024

10

The intentional stance

  • Related: Discovering Agents
Add Comment

Chris Lakin

Jan 05, 2024

10

Computer security

  • Boundaries-based security and AI safety approaches 
  • Mark Miller’s Object-capability model
  • Principle of least privilege
Add Comment
Moderation Log
More from Chris Lakin
View more
Curated and popular this week
A
13
0
Boundaries / Membranes [technical]AI
Frontpage

I want to compile a list of topics that could help inspire formal/mathematical abstractions for boundaries/membranes. (See my recent explainer.)

What technical topics are related to boundaries/membranes? 

I've seeded the comments with some ideas. Please keep further comments organized in threads if possible. Also, please add high quality links to existing comments by others.