Q: What are some of those open problems in Friendly AI theory?
A: ... When extrapolated, will the values of two different humans converge? Will the values of all humans converge? Would the values of all sentient beings converge? ...
I don't think the question about sentient beings should be considered open.
eg Clippy. Clippy's values wouldn't converge with ours, or with an otherwise similar AI that preferred thumb tacks. So the general case is most certainly 'no'.
Yesterday I sat down with Lukeprog for a few hours and we produced this ten-page interview for the Singularity Institute blog. This interview contains information about the Singularity Institute's technical research program and recent staff changes that hasn't been announced anywhere else! We hope you find it informative.
http://singinst.org/blog/2011/09/15/interview-with-new-singularity-institute-research-fellow-luke-muehlhuaser-september-2011/