Modest proposal for Friendly AI research:

Create a moral framework that incentivizes assholes to cooperate.

Specifically, create a set of laws for a "community", with the laws applying only to members, that would attract finance guys, successful "unicorn" startup owners, politicians, drug dealers at the "regional manager" level, and other assholes.

Win condition: a "trust app" that everyone uses, that tells users how trustworthy every single person they meet is.

Lose condition: startup fund assholes end up with majority ownership of the first smarter-than-human-level general AI, and no one's given smart people an incentive not to hurt dumb people.

If you can't incentivize smart selfish people to "cooperate" instead of "defect", then why do you think you can incentivize an AI to be friendly? What's to stop a troll from deleting the "Friendly" part the second the AI source code hits the Internet? Keep in mind that the 4chan community has a similar ethos to LW: namely "anything that can be destroyed by a basement dweller should be".