LESSWRONG
LW

Carson Ezell

Message

Many AI governance proposals have a tradeoff between usefulness and feasibility

Epistemic status: We think this is a simple and common idea in discussions about AI governance proposals. We don’t expect this to be controversial, but we think it might be useful to put a label on it and think about it explicitly. Suppose an AGI lab could choose between two...

Feb 3, 2023•22

Carson Ezell

Carson Ezell — LessWrong

Carson Ezell

Message

Many AI governance proposals have a tradeoff between usefulness and feasibility

Feb 3, 2023•22

Carson Ezell

Many AI governance proposals have a tradeoff between usefulness and feasibility

Orpheus16

Orpheus16, Carson Ezell+ 0 more

Orpheus16, Carson Ezell

Epistemic status: We think this is a simple and common idea in discussions about AI governance proposals. We don’t expect this to be controversial, but we think it might be useful to put a label on it and think about it explicitly.

Suppose an AGI lab could choose between two safety standards:

Standard 1: A third-party organization will implement intense auditing procedures every quarter. Training runs above a certain size will not be allowed unless the lab can show strong evidence in favor of safety.
Standard 2: Labs must have their own internal auditing procedures. There is a fair amount of flexibility in how the auditing should work. If a lab identifies something dangerous (as defined by

... (read 541 more words →)