This website requires javascript to properly function. Consider activating javascript to get access to all site functionality.
LESSWRONG
LW
Login
All of Alon's Comments + Replies
Anti-Pascaline agent
Alon
9y
0
0
It seems this type of AI might cheat and set ε=0 using the following method:
create an "insurance company" subagent (see below for what it is and why creating it has a utility that is >ε).
give the insurance company a few utilons (paper clips) to hold as hostages.
set a rule that all future subagents will be able to communicate the insurance company.
the insurance company will "buy" all the reward that has a probability < ε from subagents at roughly its fair price (its utility)
all subagents won't ignore events that happen wit
...
(read more)
Reply
0
Stuart_Armstrong
9y
This doesn't seem true. A ε/2 AI will take risks, looking for higher utility, that the ε AI wouldn't.
It seems this type of AI might cheat and set ε=0 using the following method:
- create an "insurance company" subagent (see below for what it is and why creating it has a utility that is >ε).
- give the insurance company a few utilons (paper clips) to hold as hostages.
- set a rule that all future subagents will be able to communicate the insurance company.
- the insurance company will "buy" all the reward that has a probability < ε from subagents at roughly its fair price (its utility)
- all subagents won't ignore events that happen wit
... (read more)