I guess you could call it that, but that doesn't necessarily mean it's a correct question, or that anyone is necessarily thinking about the problem of FAI with that implied conceptual framework.
Mostly unrelated idea: It'd be really cool if someone who'd thought a decent amount about FAI could moderate a single web page where people with some FAI/rationality experience could post (by emailing the moderator or whatever) somewhat cogent advice about how whoever's reading the site could perhaps make a small amount of progress towards FAI conceptual development. Restricting it to advice would keep each contributor's section from bloating to become a jargon-filled description of their personal approach/project. Being somewhat elitist/selective about allowed contributors/contributions would be important. Advice shouldn't just be LW-obvious applause lights. The contributors should assume (because a notice at the top says so) that their audience is, or can easily become without guidance, pretty damn familiar with FAI dreams and their patterns of failure and thus doesn't need those arguments repeated. Basically, the advice should be novel to the easily accessible web, though it's okay to emphasize e.g. specific ways of doing analysis found in LOGI. But basically such restrictions are just hypotheses about optimal tone. If the moderator is selective about contributors then it'd probably naturally self-optimize.
Such a site sounds pretty easy to set up. It's just an HTML document with a description and lots of external links and book suggestions at the top, and neat sections below. Potential hard parts: seducing people (e.g. Mitchell Porter, Wei Dai) to seed it, and choosing a moderator who's willing to be choosy about what gets published, and is willing to implement edits according to some sane policy for editing. (And maybe some other moderators with access too.)
I guess it's possible that LW wiki is sort of almost okay, but really, I don't like it. It's not a url I can just type into my address bar, it requires extra moderation which is socially and technically awkward, LW wiki is not about FAI, and in general it doesn't have the clean simplicity which is both attractive and expandable in many ways.
I'm not sure how to stably point people at it, but it'd be easy to link to when someone professes interested in learning more about FAI stuff. Also it's probable a fair bit of benefit would come from current FAI-interested folk getting a chance to learn from each other, and depending on the site structure (like whether or not a paragraph or another page just about current research interests of all contributors is a good idea) it could easily provide an affordance for people to actually bother constructively criticizing others' approaches and emphases. I suspect that lukeprog's future efforts could be sharpened by Vladimir Nesov's advice, as a completely speculative example. And I'd like to have a better idea of what Mitchell Porter thinks I might be missing, as a non-speculative example.
What do you think, Luke? Worth an experiment?
Do you think a LW subreddit devoted to FAI could work? If not, then we probably aren't ready for the site you suggest, and the default venue for such dialogues should continue to be LW Discussion.
I've been working on metaethics/CEV research for a couple months now (publishing mostly prerequisite material) and figured I'd share some of the sources I've been using.
CEV sources.
Motivation. CEV extrapolates human motivations/desires/values/volition. As such, it will help to understand how human motivation works.
Extrapolation. Is it plausible to think that some kind of extrapolation of human motivations will converge on a single motivational set? How would extrapolation work, exactly?
Metaethics. Should we use CEV, or something else? What does 'should' mean?
Building the utility function. How can a seed AI be built? How can it read what to value?
Preserving the utility function. How can the motivations we put into a superintelligence be preserved over time and self-modifcation?
Reflective decision theory. Current decision theories tell us little about software agents that make decisions to modify their own decision-making mechanisms.
Additional suggestions welcome. I'll try to keep this page up-to-date.