Er, characterising someone who disagrees with you on a technical point as "obnoxious" is not terribly great manners in itself! I never compared destroying the world by accident with terrorism - you appear to be projecting. However, I am not especially interested in the conversation being dragged into the gutter in this way.

If you did have a good argument favouring closed source software and reduced transparency I think there has been a reasonable chance to present it. However, if you can't even be civil, perhaps you should consider waiting until you can.

I gave an argument that open-sourcing AI would increase the risk of the world being destroyed by accident. You said

I note that Anders Sandberg recently included: "Otherwise the terrorists will win!" his list of of signs that you might be looking at a weak moral argument.

I presented the mismatch between this statement and my argument as evidence that you had misunderstood what I was saying. In your reply,

I never compared destroying the world by accident with terrorism - you appear to be projecting.

You are misunderstanding me again. ... (read more)

A Brief Overview of Machine Ethics

by lukeprog 1 min read5th Mar 201191 comments


Earlier, I lamented that even though Eliezer named scholarship as one of the Twelve Virtues of Rationality, there is surprisingly little interest in (or citing of) the academic literature on some of Less Wrong's central discussion topics.

Previously, I provided an overview of formal epistemology, that field of philosophy that deals with (1) mathematically formalizing concepts related to induction, belief, choice, and action, and (2) arguing about the foundations of probability, statistics, game theory, decision theory, and algorithmic learning theory.

Now, I've written Machine Ethics is the Future, an introduction to machine ethics, the academic field that studies the problem of how to design artificial moral agents that act ethically (along with a few related problems). There, you will find PDFs of a dozen papers on the subject.