I want to bring up some questions that I find crucial to consider about technology in the present day. To contrast with Friendly AI, these questions are about our interaction with technological tools rather than developing a technology that we trust on its own with superhuman intelligence.
1. How are computational tools affecting how we perceive, think, and act?
The inspiration for this post is Bret Victor's new talk, The Humane Representation of Thought. I highly recommend it. In particular, you may want to pause and reflect on the first part before seeing his sketch of solutions in the second. In a nutshell, we have a certain range of human capacities. The use of... (read 590 more words →)
This brings to mind the infamous case of Google censoring search results in China according to the government's will. That's an example of a deliberate human action, but examples will increasingly be "algorithmic byproduct" with zero human intervention. Unlike humans the algorithm can't questioned or intimidated by the media or taken to a court of law.
Legally and professionally, I suppose the product team could be taken responsible, but I definitely think there needs to be a push for more scrutinizable computation. (There have been discussion along these lines in terms of computer security. Sometimes open source is cited as a solution, but it hasn't necessary helped--e.g. Heartbleed.)