Less Wrong is a community blog devoted to refining the art of human rationality. Please visit our About page for more information.

[Link] New program can beat Alpha Go, didn't need input from human games

6 Post author: NancyLebovitz 18 October 2017 08:01PM

Comments (14)

Comment author: gwern 20 October 2017 01:45:08AM 3 points [-]

If anyone wants more details, I have extensive discussion & excerpts from the paper & DM QAs at https://www.reddit.com/r/reinforcementlearning/comments/778vbk/mastering_the_game_of_go_without_human_knowledge/

Comment author: Mitchell_Porter 19 October 2017 09:31:45PM 3 points [-]

A voice tells me that we're out of time. The future of the world will now be decided at Deep Mind, or by some other group at their level.

Comment author: IlyaShpitser 26 October 2017 02:34:18PM *  3 points [-]

You should probably stop listening to random voices.


More seriously, do you want to make a concrete bet on something?

Comment author: Mitchell_Porter 29 October 2017 08:28:11PM 0 points [-]

How much are you willing to lose?

Comment author: IlyaShpitser 30 October 2017 02:42:38PM *  1 point [-]

Let's say 100 dollars, but the amount is largely symbolic. The function of the bet is to try to clarify what specifically you are worried about. I am happy to do less -- whatever is comfortable.

Comment author: Mitchell_Porter 31 October 2017 03:50:11AM 0 points [-]

Wake up! In three days, that AI evolved from knowing nothing, to comprehensively beating an earlier AI which had been trained on a distillation of the best human experience. Do you think there's a force in the world that can stand against that kind of strategic intelligence?

Comment author: IlyaShpitser 31 October 2017 04:19:46AM *  1 point [-]

So, a concrete bet then? What specifically are you worried about? In the form of a falsifiable claim, please.


edit: I am trying to make you feel better, the real way. The empiricist way.

Comment author: Mitchell_Porter 01 November 2017 09:19:15PM 0 points [-]

Just answer the question.

Comment author: IlyaShpitser 01 November 2017 09:43:20PM 1 point [-]
Comment author: Mitchell_Porter 01 November 2017 10:28:48PM 0 points [-]

And you're the tax collector? Answer the question.

Comment author: whpearson 02 November 2017 05:08:11PM *  0 points [-]

A brief reply.

Strategy is nothing without knowledge of the terrain.

Knowledge of the terrain might be hard to get reliably

Therefore there might be some time between AGI being developed and it being able to reliably acquire the knowledge. If these people that develop it are friendly they might decide to distribute it to other people to make it harder for any one project to take off.

Comment author: Mitchell_Porter 06 November 2017 12:54:48PM 0 points [-]

Knowledge of the terrain might be hard to get reliably

Knowing that the world is made of atoms should take an AI a long way.

If these people that develop [AGI] are friendly they might decide to distribute it to other people to make it harder for any one project to take off.

I hold to the classic definition of friendly AI as being AI with friendly values, which retains them (or even improves them) as it surpasses human intelligence and otherwise self-modifies. As far as I'm concerned, AlphaGo Zero demonstrates that raw problem-solving ability has crossed a dangerous threshold. We need to know what sort of "values" and "laws" should govern the choices of intelligent agents with such power.

Comment author: Kawoomba 22 October 2017 09:15:10AM 0 points [-]

... and there is only one choice I'd expect them to make, in other words, no actual decision at all.

Comment author: Manfred 18 October 2017 10:59:35PM 1 point [-]

Interesting that resnets still seem state of the art. I was expecting them to have been replaced by something more heterogeneous by now. But I might be overrating the usefulness of discrete composition because it's easy to understand.