LESSWRONG
LW

Personal Blog

13

[link] Friendly AI and Utilitarianism

by lukeprog
15th Aug 2011
1 min read
1

13

Personal Blog

13

[link] Friendly AI and Utilitarianism
3Pablo
New Comment
1 comment, sorted by
top scoring
Click to highlight new comments since: Today at 2:26 AM
[-]Pablo14y30

Interesting exchange. It would be great if Luke or someone else at SIAI could address the question raised by Alan towards the end of the discussion:

I'm often puzzled by SIAI's focus on CEV in general. Do they really think it has a chance of being implemented? Only if they design an AGI in the basement does it seem possible. Otherwise, these decisions will be muddied by power politics, as most things are.

Maybe CEV can be a playground for thinking about general AGI goal systems. But talking as though it has much chance of coming to fruition, even if AGI does come about, seems odd to me.

Reply
Moderation Log
More from lukeprog
View more
Curated and popular this week
1Comments

I've begun an online discussion with Alan Dawrst (Brian Tomasik) of utilitarian-essays.com concerning Friendly AI and utilitarianism. Interested parties may wish to follow along or participate.

The forum thread now contains many overlapping discussions. For clarity, here's an index of the narrow, core discussion between Alan and I:

 

  1. Luke #1
  2. Alan #1
  3. Luke #2
  4. Alan #2
  5. Luke #3
  6. Alan #3
  7. Luke #4
  8. Alan #4
  9. Luke #5
  10. Alan #5
  11. Luke #6
  12. Alan #6
  13. Luke #7
  14. Alan #7