= 27d567bc2d48d9f40e9ccc20ea370b15)
NancyLebovitz comments on Q&A with Michael Littman on risks from AI - Less Wrong Discussion
You are viewing a comment permalink. View the original post to see all comments and the full post content.
= 783df68a0f980790206b9ea87794c5b6)
Loading…= b715d02e85f7b3b4ae65ca3d3e450868)
Subscribe to RSS Feed
Powered by Reddit
= f037147d6e6c911a85753b9abdedda8d)
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (88)
Is it plausible that fair-to-middling AI could be enough to break civilization? There are a lot of factors, especially whether civilization will become more fragile or more resilient as tech advances, but it does seem to me that profit-maximizing and status-maximizing AI have a lot of possibilities for trouble.
How about attention-maximizing AI, e.g. a game that optimizes for addictiveness — for the amount of person-hours humans spend playing it?
I think that's less likely to break civilization than a status-maximizer or a money-maximizer-- there are a lot of people who don't want to get started with video games, and I think that an attention-maximizer would run into a lot of resistance as early adopters neglected their lives.
A clever attention maximizer which was aiming for the long run might not wreck civilization. I'm not as sure about status or money maximizers.
Brunner's The Jagged Orbit is about some issues with maximizers, including who might be most likely to develop a stupid maximizer.
Gur rkrphgvirf ng n crefbany jrncbaf pbzcnal unir n pbzchgre cebtenz gb znkvzvmr cebsvgf (cbffvoyl fnyrf-- V unira'g ernq gur obbx yngryl) va gur eryngviryl fubeg eha, erfhygvat va nqiregvfvat pnzcnvtaf juvpu penax hc cnenabvn gb gur cbvag jurer pvivyvmngvba vf jerpxrq.
Gurer'f n fbyhgvba juvpu vaibyirf gur pbzchgre vairagvat gvzr geniry, ohg V qba'g erzrzore gur qrgnvyf.