I have a (probably stupid) question. I have been following Less Wrong for a little over a month, and I've learned a great deal about rationality in the meantime. My main interest, however, is not rationality, it is in creating FAI. I see that the SIAI has an outline of a research program, described here: http://www.singinst.org/research/researchareas.
Is there an online community that is dedicated solely to discussing friendly AI research topics? If not, is the creation of one being planned? If not, why not? I realize that the purpose of these SIAI fellowships is to foster such research, but I'd imagine that a discussion community focused on relevant topics in evolutionary psych, cogsci, math, CS, etc. would provide a great deal more stimulation for FAI research than would the likely limited number of fellowships available.
A second benefit would be that it would provide a support group to people (like me) who want to do FAI research but who do not know enough about cogsci, math, CS, etc. to be of much use to SIAI at the moment. I have started combing through SIAI's reading list, which has been invaluable in narrowing down what I need to be reading, but at the end of the day, it's only a reading list. What would be ideal is an active community full of bright and similarly-motivated people who could help to clarify misconceptions and point out novel connections in the material.
I apologize if this comment is off-topic.
This forum is as close as there is to a FAI discussion group. SL4 is very much (brain-)dead at the moment. There aren't even a lot of people who are known to be specifically attacking the FAI problem -- one can name Yudkowsky, Herreshoff, maybe Rayhawk, others keep quiet. Drop me a mail, I may have some suggestions on what to study.
Last summer, 15 Less Wrongers, under the auspices of SIAI, gathered in a big house in Santa Clara (in the SF bay area), with whiteboards, existential risk-reducing projects, and the ambition to learn and do.
Now, the new and better version has arrived. We’re taking folks on a rolling basis to come join in our projects, learn and strategize with us, and consider long term life paths. Working with this crowd transformed my world; it felt like I was learning to think. I wouldn’t be surprised if it can transform yours.
A representative sample of current projects:
Interested, but not sure whether to apply?
Past experience indicates that more than one brilliant, capable person refrained from contacting SIAI, because they weren’t sure they were “good enough”. That kind of timidity destroys the world, by failing to save it. So if that’s your situation, send us an email. Let us be the one to say “no”. Glancing at an extra application is cheap, and losing out on a capable applicant is expensive.
And if you’re seriously interested in risk reduction but at a later time, or in another capacity -- send us an email anyway. Coordinated groups accomplish more than uncoordinated groups; and if you care about risk reduction, we want to know.
What we’re looking for
At bottom, we’re looking for anyone who:
Bonus points for any (you don’t need them all) of the following traits:
If you think this might be you, send a quick email to jasen@intelligence.org. Include:
Our application process is fairly informal, so send us a quick email as initial inquiry and we can decide whether or not to follow up with more application components.
As to logistics: we cover room, board, and, if you need it, airfare, but no other stipend.
Looking forward to hearing from you,
Anna
ETA (as of 3/25/10): We are still accepting applications, for summer and in general. Also, you may wish to check out http://www.singinst.org/grants/challenge#grantproposals for a list of some current projects.