MichaelDickens

Which types of AI alignment research are most likely to be good for all sentient beings?

AI alignment is typically defined as the task of aligning artificial superintelligence to human preferences. But non-human animals, future digital minds, and maybe other sorts of beings also have moral worth; ASI ought to care for their interests, too. In broad strokes, if we place all alignment techniques on a...

Mar 239

If AI alignment is only as hard as building the steam engine, then we likely still die

Cross-posted from my website. You may have seen this graph from Chris Olah illustrating a range of views on the difficulty of aligning superintelligent AI: Evan Hubinger, an alignment team lead at Anthropic, says: > If the only thing that we have to do to solve alignment is train away...

Jan 1035

Where I Am Donating in 2025

Last year I gave my reasoning on cause prioritization and did shallow reviews of some relevant orgs. I'm doing it again this year. Cross-posted to my website. Cause prioritization In September, I published a report on the AI safety landscape, specifically focusing on AI x-risk policy/advocacy. The prioritization section of...

Nov 28, 202532

Alignment Bootstrapping Is Dangerous

Cross-posted to my website. AI companies want to bootstrap weakly-superhuman AI to align superintelligent AI. I don't expect them to succeed. I could give various arguments for why alignment bootstrapping is hard and why AI companies are ignoring the hard parts of the problem; but I don't need any specific...

Nov 27, 202518

We won't solve post-alignment problems by doing research

Introduction Even if we solve the AI alignment problem, we still face post-alignment problems, which are all the other existential problems [1] that AI may bring. People have written research agendas on various imposing problems that we are nowhere close to solving, and that we may need to solve before...

Nov 21, 202523

Knowing Whether AI Alignment Is a One-Shot Problem Is a One-Shot Problem

Cross-posted from my website. One day, I was at my grandma's house reading the Sunday funny pages, when I suddenly felt myself getting sucked into a Garfield comic. I looked down at my body and saw that I had become fully cartoonified. My hands had four fingers and I had...

Nov 17, 202532

Epistemic Spot Check: Expected Value of Donating to Alex Bores's Congressional Campaign

Political advocacy is an important lever for reducing existential risk. One way to make political change happen is to support candidates for Congress. In October, Eric Neyman wrote Consider donating to Alex Bores, author of the RAISE Act. He created a cost-effectiveness analysis to estimate how donations to Bores's campaign...

Nov 13, 202566

LESSWRONG
LW

LESSWRONG
LW

MichaelDickens

MichaelDickens

Outlive: A Critical Review

Epistemic Spot Check: Expected Value of Donating to Alex Bores's Congressional Campaign

If AI alignment is only as hard as building the steam engine, then we likely still die

Knowing Whether AI Alignment Is a One-Shot Problem Is a One-Shot Problem

MichaelDickens

Which types of AI alignment research are most likely to be good for all sentient beings?

If AI alignment is only as hard as building the steam engine, then we likely still die

Where I Am Donating in 2025

Alignment Bootstrapping Is Dangerous

We won't solve post-alignment problems by doing research

Knowing Whether AI Alignment Is a One-Shot Problem Is a One-Shot Problem

Epistemic Spot Check: Expected Value of Donating to Alex Bores's Congressional Campaign

Outlive: A Critical Review

Epistemic Spot Check: Expected Value of Donating to Alex Bores's Congressional Campaign

If AI alignment is only as hard as building the steam engine, then we likely still die

Knowing Whether AI Alignment Is a One-Shot Problem Is a One-Shot Problem