FYI if you want to use o1-like reasoning, you need to check off "Deep Think".

It's predictably censored on CCP-sensitive topics.

(In a different chat.) After the second question, it typed two lines (something like "There have been several attempts to compare Winnie the Pooh to a public individual...") and then overwrote it with "Sorry...".

Astronaut.io

https://gwern.net/doc/existential-risk/2011-05-10-givewell-holdenkarnofskyjaantallinn.doc

glitch tokens are my favorite example

I directionally agree with the core argument of this post.

The elephant(s) in the room according to me:

• What is an algorithm? (inb4 a physical process that can be interpreted/modeled as implementing computation)
• How do you distinguish (hopefully, in a principled way) between (a) an algorithm changing; (b) you being confused about what algorithm the thing is actually running and in reality being more nuanced so that what "naively" seems like a change of the algorithm is "actually" a reparametrization of the algorithm?

I haven't read the examples in this post super carefully, so perhaps you discuss this somewhere in the examples (though I don't think so because the examples don't seem to me like the place to include such discussion).

Thanks for the post! I expected some mumbo jumbo but it turned out to be an interesting intuition pump.

Based on my attending Oliver's talk, this may be relevant/useful:

https://en.wikipedia.org/wiki/X_Club

I too have reservations about points 1 and 3 but not providing sufficient references or justifications doesn't imply they're not on SL1.