LESSWRONG
LW

All of jared's Comments + Replies

A one-question Turing test for GPT-3
jared370

I also tried asking GPT-3 with a small change to the question and got some good answers.  

Question: What food would you use to prop a book open and why would that work? 

Answer: A hardcover book can be propped open by using a can of food. The weight of the can will keep the pages of the book open

 

And

Question: What fruit would you use to prop a book open and why would that work? 

Answer: A banana would work to prop a book open because the curved shape of the fruit would hold the pages of the book open.

Reply
Daniel Kokotajlo*260

Before reading your comment, I tried designing a good prompt too, and got the same answer as you (can of food) on my first and only try:

Even the best modern AIs still struggle with common sense reasoning. To illustrate, I ran a little experiment with a friend of mine and with GPT-3, OpenAI's new model. I explained to them that I was asking them a series of weird questions designed to test their common sense reasoning abilities, and that I wanted them to answer straightforwardly and to the best of their ability. Here are the results: Question 1: If your h
... (read more)
Reply