humans will still have a comparative advantage in something
At this moment, I think the greatest advantage of humans with low intelligence is that they are relatively flexible, "easy to program", and come with built-in heuristics for unexpected situations. By which I mean that they can easily walk across your factory or shop; and you don't have to be a computer programmer to explain them you want them to pick boxes from one place and move them to other places sorting them by color. And in case of fire (which you forgot to mention explicitly during their job training), instead of quietly continuing to move the boxes until everything burns, they would call for help.
Give me reasonably cheap robots with these skills, and I think some people will have no economical comparative advantage left. Getting from there to replacing an average programmer would probably be a shorter distance than getting from zero to there.
I agree with you that automated processes will eventually have an absolute advantage in all areas of productivity. However, humans only need a comparative advantage to be employable. The theory of comparative advantage is a "powerful yet counter-intuitive insight in economics" and I recommend checking it out. Ricardo's example is especially instructive, link is below.
http://en.wikipedia.org/wiki/Comparative_advantage#Ricardo.27s_Example
Imagine Portugal is a robot, and England is a human.
I haven't given much thought to the concept of automation and computer induced unemployment. Others at the FHI have been looking into it in more details - see Carl Frey's "The Future of Employment", which did estimates for 70 chosen professions as to their degree of automatability, and extended the results of this using O∗NET, an online service developed for the US Department of Labor, which gave the key features of an occupation as a standardised and measurable set of variables.
The reasons that I haven't been looking at it too much is that AI-unemployment has considerably less impact that AI-superintelligence, and thus is a less important use of time. However, if automation does cause mass unemployment, then advocating for AI safety will happen in a very different context to currently. Much will depend on how that mass unemployment problem is dealt with, what lessons are learnt, and the views of whoever is the most powerful in society. Just off the top of my head, I could think of four scenarios on whether risk goes up or down, depending on whether the unemployment problem was satisfactorily "solved" or not:
with AI problems, people and
organisations are willing and
able to address the big issues.
misery that unrestricted AI
research can cause, and very
wary of future disruptions. Those
at the top want to hang on to
their gains, and they are the one
with the most control over AIs
and automation research.
automation problems in a
particular way (eg taxation),
people underestimate the risk
and expect the same
solutions to work.
conflict between those benefiting
from automation and those
losing out, and superintelligence
is seen through the same prism.
Those who profited from
automation are the most
powerful, and decide to push
ahead.
But of course the situation is far more complicated, with many different possible permutations, and no guarantee that the same approach will be used across the planet. And let the division into four boxes not fool us into thinking that any is of comparable probability to the others - more research is (really) needed.