ChristianKl comments on MIRI strategy - Less Wrong
You are viewing a comment permalink. View the original post to see all comments and the full post content.
You are viewing a comment permalink. View the original post to see all comments and the full post content.
Comments (94)
Because those people do engineer plants to produce pesticides? Bt Potato was the first which was approved by the FDA in 1995.
The commerical incentives that exist encourage the development of such products. A customer in a store doesn't see whether a potato is engineered to have more vitamins. He doesn't see whether it's engineered to produce pesticides.
He buys a potato. It's cheaper to grow potatos that produce their own pesticides than it is to grow potatos that don't.
In the case of potatos it might be harmless. We don't eat the green of the potatos anyway, so why bother if the green has additional poison? But you can slip up. Biology is complicated. You could have changed something that also gets the poison to be produced in the edible parts.
It's not a question of motivation. Politics is the mindkiller. If a topic gets political people on all sides of the debate get stupid.
According to Eliezer it takes strong math skills to see how an AGI can overtake their own utility function and is therefore dangerous. Eliezer made the point that it's very difficult to explain to people who are invested into their AGI design that it's dangerous because that part needs complicated math.
It easy to say in abstract that some AGI might become UFAI, but it's hard to do the assessment for any individual proposal.