LESSWRONG
LW

All of brockmanmatt's Comments + Replies

Ah, sorry, I forgot to add a link to how to evolve the labels. There's a couple different methods in http://gptprompts.wikidot.com/context-stuffing if that helps.

$1000 bounty for OpenAI to show whether GPT3 was "deliberately" pretending to be stupider than it is

brockmanmatt5y*40

I don't think it's a BPE issue but not sure. I'd guess it's closer to the parity issue. It has a hard time implicitly counting in general.

edit: thanks, i know how to link now.

4ESRogs5y

If you select some text that you want to be a link, then a little UI element should pop up that allows you to paste in the URL.

$1000 bounty for OpenAI to show whether GPT3 was "deliberately" pretending to be stupider than it is

brockmanmatt5y70

It seems to just do really bad with parentheses on their own. It can fix them with like... f(f(f(x))) but not '((())' type situations (I'm just using the beta).

Code: https://gist.github.com/brockmanmatt/aea4fc4a962188f85d83db761bf0ac50

4ESRogs5y

Interesting. I'd think this might be due to the BPE issue Gwern has written about. But it looked like Arthur added spaces in order to get around that, and you've got spaces in some of your examples too, so that's not a full explanation. EDIT: Oh, lol, he cites you in that section: