Research interests I don't currently have time to develop alone

Stuart_Armstrong

EDIT: added the "rights of parents" and "simulation hypothesis" research interests.

I've started a lot of research projects and have a lot of research interests that I don't currently have time to develop on my own. So I'm putting the research interests together on this page, and anyone can let me know if they're interested in doing any joint projects on these topics. This can range from coauthoring, to simply having a conversation about these and seeing where that goes.

The possible research topics are:

Reduced impact AI (this is one I'm certainly going to be returning to, once I have the time).
The Fermi paradox and universal colonisation.
Anthropic decision theory (extending it to include quantum mechanics).
How to divide the gains from trade/to negotiate/to achieve "fairness"/to avoid blackmail.
Oracle AI and the (non-)differences between tool AIs and agents
General assessments of predictions and experts (including counterfactual resiliency).
The future of surveillance.
The risks of singleton world governments and mass-em worlds.
Anthropic shadows for multiple risks.
The potential limitations of the Turing test as an accurate general intelligence test.
Extending the orthogonality thesis to realistic AI designs.
Infinite ethics.
The cake or death problem for value loading: whether it's fully solved or whether similar problems remain.
The problems with total utilitarianism.
The problems with CEV (and potential solutions).
Whether AIXI would end protecting itself or not.
The rights of parents versus others in determining the genetic modifications of their children (and the efficiency of the markets in these kinds of modifications).
Exploring the consequences of the simulation hypothesis, as Joshua Fox did.

EDIT: added the "rights of parents" and "simulation hypothesis" research interests.

The possible research topics are:

Reduced impact AI (this is one I'm certainly going to be returning to, once I have the time).
The Fermi paradox and universal colonisation.
Anthropic decision theory (extending it to include quantum mechanics).
How to divide the gains from trade/to negotiate/to achieve "fairness"/to avoid blackmail.
Oracle AI and the (non-)differences between tool AIs and agents
General assessments of predictions and experts (including counterfactual resiliency).
The future of surveillance.
The risks of singleton world governments and mass-em worlds.
Anthropic shadows for multiple risks.
The potential limitations of the Turing test as an accurate general intelligence test.
Extending the orthogonality thesis to realistic AI designs.
Infinite ethics.
The cake or death problem for value loading: whether it's fully solved or whether similar problems remain.
The problems with total utilitarianism.
The problems with CEV (and potential solutions).
Whether AIXI would end protecting itself or not.
The rights of parents versus others in determining the genetic modifications of their children (and the efficiency of the markets in these kinds of modifications).
Exploring the consequences of the simulation hypothesis, as Joshua Fox did.

But 1984 was a work of fiction, and as far as predictions go, it was wrong all over the place.

The point of mentioning 1984 isn't to use it as a study or a forecast. The point is reaction to the world depicted in it: most people find totalitarian, total-surveillance societies undesirable, disturbing, and basically evil.

1984 is also useful as a well-known reference. If someone says "I have nothing to hide, I don't need privacy" you can ask him whether he'd be fine with the levels of surveillance depicted in 1984. He might say "yes, I don't care", he might say "no, that's too much", he might say "only in a democratic society", etc.

But would you be fine with Bentham's Panopticon, for example? Are examples of Soviet Russia, Eastern Germany, etc. OK?

27

Research interests I don't currently have time to develop alone

27

27

27

Research interests I don't currently have time to develop alone

27

27