Roko comments on A question of rationality - Less Wrong

4 Post author: mormon2 13 December 2009 02:37AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (93)

You are viewing a single comment's thread.

Comment deleted 17 December 2009 09:42:22AM [-]
Comment author: mormon2 18 December 2009 01:53:01AM 0 points [-]

"How would you act if you were Eliezer?"

If I made claims of having a TDT I would post the math. I would publish papers. I would be sure I had accomplishments to back up the authority with which I speak. I would not spend a single second blogging about rationality. If I used a blog it would be to discuss the current status of my AI work and to have a select group of intelligent people who could read and comment on it. If I thought FAI was that important I would be spending as much time as possible finding the best people possible to work with and would never resort to a blog to try to attract the right sort of people (I cite LW as evidence of the failure of blogging to attract the right people).

Oh and for the record I would never start a non-profit to do FAI research. I also would do away with the Singularity Summit and replace it with more AGI conferences. I would also do away the most of SIAI's programs and replace them, and the money they cost, with researchers and scientists along with some devoted angel funders.

Comment author: Mitchell_Porter 18 December 2009 12:02:07PM 3 points [-]

I can see reasons for proceeding indirectly. Eliezer is 30. He thinks his powers may decline after age 40. It's said that it takes 10 years to become expert in a subject. So if solving the problems of FAI requires modes of thought which do not come naturally, writing his book on rationality now is his one chance to find and train people appropriately.

It is also possible that he makes mistakes. Eliezer and SIAI are inadequately supported and have always been inadequately supported. People do make mistakes under such conditions. If you wish to see how seriously the mainstream of AI takes the problem of Friendliness, just search the recent announcements from MIT, about a renewed AI research effort, for the part where they talk about safety issues.

I have a suggestion: Offer to donate to SIAI if Eliezer can give you a satisfactory answer. (The terms of such a deal may need to be negotiated first.)

Comment author: Nick_Tarleton 19 December 2009 06:38:45PM 0 points [-]

search the recent announcements from MIT, about a renewed AI research effort, for the part where they talk about safety issues.

Do you have a link? I can't find anything seemingly relevant with a little searching.

Comment author: Mitchell_Porter 20 December 2009 03:03:53AM 1 point [-]

I can't find anything seemingly relevant with a little searching.

Neither can I - that's the point.

Comment author: Nick_Tarleton 20 December 2009 03:06:59AM 0 points [-]

No, I mean anything about the renewed AI research effort.

Comment author: Mitchell_Porter 20 December 2009 03:13:20AM 0 points [-]
Comment deleted 19 December 2009 06:37:11AM [-]