You're looking at Less Wrong's discussion board. This includes all posts, including those that haven't been promoted to the front page yet. For more information, see About Less Wrong.

mwengler comments on Tools want to become agents - Less Wrong Discussion

12 Post author: Stuart_Armstrong 04 July 2014 10:12AM

You are viewing a comment permalink. View the original post to see all comments and the full post content.

Comments (81)

You are viewing a single comment's thread.

Comment author: mwengler 04 July 2014 03:43:52PM 1 point [-]

Do we have a clear idea what we mean when I say agent?

Is a Roomba, the robot vacuum cleaner that adapts to walls, furniture, the rate at which the floor gets dirty, and other things, an agent? I don't think so.

Is an air conditioner with a thermostat which tells it to cool the rooms to 22C when people are present or likely to be present, but not to cool it when people are absent or likely to be absent an agent? I think not.

Is a troubleshooting guide with lots of if-then-else branch points an agent? No.

Consider a tool that I write which will write a program to solve a problem I am interested in solving. Let say I want to build a medical robot which will wander the world dispensing medical care to anyone who seeks its help. The code I write to implement this has a lot of recursion in the sense that my code looks at symptoms of the current patient and writes treatment code based on its database and the symptoms it sees, and modified the treatment code based on reactions of the patient.

As long as this robot continues to treat humans medically, it does not seem at all agenty to me. If it started to develop nutrition programs and clean water programs, it would seem somewhat agenty to me. Until it switched professions, decided to be a poet or a hermit or a barista, I would not think of it as an agent.

As long as my tool is doing what I designed it to do, I don't think it shows any signs of wanting anything.

Comment author: [deleted] 05 July 2014 04:57:43AM 4 points [-]

Is a Roomba, the robot vacuum cleaner that adapts to walls, furniture, the rate at which the floor gets dirty, and other things, an agent?

It's a textbook case of an agent in the AI field. (Really! IIRC AI: A Modern Approach uses Roomba in its introductory chapters as an example of an agent.)

We may need to taboo the word agent, since it has technical meanings here.

Comment author: TheAncientGeek 05 July 2014 01:18:52PM 0 points [-]

Hopefully where "taboo" means explain.

Comment author: NancyLebovitz 05 July 2014 01:52:28PM 0 points [-]

What if your robot searched the medical literature for improved treatments? What if it improved its ability to find treatments?