1124

LESSWRONG
LW

1123
List of LinksAICommunity
Frontpage

32

AI Alignment Writing Day Roundup #1

by Ben Pace
30th Aug 2019
AI Alignment Forum
1 min read
12

32

Ω 11

32

Ω 11

AI Alignment Writing Day Roundup #1
7Wei Dai
4Wei Dai
4Ben Pace
4Raemon
4Ben Pace
3Donald Hobson
2Ben Pace
2johnswentworth
2Raemon
23johnswentworth
8Scott Garrabrant
5Ben Pace
New Comment
12 comments, sorted by
top scoring
Click to highlight new comments since: Today at 8:32 PM
[-]Wei Dai6yΩ470

Another example of Intentional Bucket Error: List of Problems That Motivated UDT.

Reply
[-]Wei Dai6yΩ240

Can someone please edit the original posts to point here, so future readers can find the additional comments?

Reply
[-]Ben Pace6yΩ240

Good point, I’ll do that.

Reply
[-]Raemon6yΩ240

I'd lean towards just encouraging people to comment on the original post (although if there end up being any significant number of comments here I agree with your suggestion)

Reply
[-]Ben Pace6yΩ240

I don't know much about first order logic - can someone who does tell me whether the two intuitive models in the post on Propositional Graphs are standard or not, and if not why one might want to use them?

Reply
[-]Donald Hobson6yΩ230

The proposition graph is non standard as far as I know. The syntax tree is kind of standard, but a bit unusual. You might want to use them if I show how to use them for logical counterfactuals. (Which I haven't finished yet)

Reply
[-]Ben Pace6yΩ120

Thanks!

Reply
[-]johnswentworth6y*Ω120

You know it's "John S. Wentworth", not "Swentworth", right?

Reply
[-]Raemon6yΩ120

I'd bet $5 this was intentional.

Reply
[-]johnswentworth6yΩ7230

Planning of vengeance continues apace, either way.

Reply
[-]Scott Garrabrant6yΩ480

This is my favorite comment. Thank you.

Reply
[-]Ben Pace6yΩ350

Vengeance will be required, as Raemon would’ve had your five dollars Mr. Swentworth.

Reply
Moderation Log
More from Ben Pace
View more
Curated and popular this week
12Comments
List of LinksAICommunity
Frontpage

Here are some of the posts from last week's writing day. Due to the participants writing 34 posts in less than 24 hours (!), I'm re-airing them to let people have a proper chance to read (and comment) on them, in roughly chronological order.

1) Markets are Universal for Logical Induction by John Swentworth

A discussion and proof of the following.

We want to show that any possible logical inductor can be represented by a market of traders - i.e. there is some market of traders which produces exactly the same prices.

2) Intentional Bucket Errors by Scott Garrabrant

Bucket errors are normally thought of as a bad thing. It has "errors" right in the name. However, I want to argue that bucket errors can sometimes be useful, and you might want to consider having some bucket errors on purpose.

3) Logical Counterfactuals and Proposition graphs, Part 1 by Donald Hobson

Within this sequence of posts I will outline a procedure for logical counterfactuals based on something similar to proof length. In this post I present a reimagining of propositional logic in which proving a theorem is taking a walk around a graph of equivalent proposititions.

The post shows two intuitive models of proving propositional logic:

...a directed acyclic graph, as shown above. Under this interpretation, all we have to do is test node identity.

and another graph where:

...all statements that are provably equivalent in propositional logic will be within the same connected component of the graph. All statements that can't be proved equivalent are in different components, with no path between them.
Finding a mathematical proof becomes an exercise in navigating an infinite maze.

4) Why so much variance in human intelligence? by me

In this question I ask a rambling question about why the difference between peak and median human performance is so much larger than for other species, and Vaniver and Carl Shulman give some fascinating answers.