Disclaimer. This is the first post in a series about my personal research progress as a member of the Interpretable Cognitive Architectures team at AI Safety Camp.
Epistemic status. An educated take on combining existing knowledge into cohesive whole.

TL;DR

Ontogenetic curriculum is a map of developmental threads that describe the formation of a human mind
The most promising research lines are:
- Ontogeny of values and concepts,
- Curriculum learning,
- Distribution of complexity between learning algorithm and training curriculum

What is OC?

Ontogenetic curriculum is a map of developmental threads that describe the formation of a human mind. That includes value learning, concept acquisition, skill building and development of cognitive capacities.

Some examples of relevant fields and research areas include:

Developmental psychology and studies on child development, which spanning from Piaget’s Theory of Cognitive Development to Dynamic Theory of Development of action and thought by Fischer and his work on constructive web.
Developmental robotics and attempts to construct artificial cognitive architectures to test psychological theories with their help.
General ethology research, such as Niche Construction Theory and studies on animal cognition

Why OC? Promising research questions

There are many possible lines of research under this topic, but the most promising questions are:

Ontogeny of values and concepts. Values and preferences in humans are formed gradually during upbringing, which resembles evolutionary dynamics with offspring-values born under the pressure of a new environmental niche. Getting better understanding of the rules governing this dynamics would help us design better value mechanism for artificial agents. Related questions:
- What are the exact conditions leading to the emergence of positive attractors in humans?
- What are the most powerful contributing factors in that dynamics?
- How do values apply to a new situation? Would an agent’s extrapolation of values to a new situation match with humans’?
Curriculum learning. What new opportunities does the transition from batch training to ordered training open up? The main candidate for the answer is fine control over time when agent learns something. Choosing the right points of intervention suitable for specific value is in theory a good strategy for steering behaviour away from undesired territories.
Whe

...

Ontogenetic Curriculum