toasty_sunbeam
toasty_sunbeam has not written any posts yet.

toasty_sunbeam has not written any posts yet.

GPT-5 follows the OpenAI Model Spec. That's the document that governs how they apply RLHF.
I think this position made a lot of sense a few years ago when we had no idea how a superintelligence might be built. The LLM paradigm has made me more hopeful about this. We're not doing a random draw from the space of all possible intelligences, where you would expect to find eldritch alien weirdness. LLMs are trained to imitate humans; that's their nature. I've been very positively surprised by the amount of empathy and emotional intelligence LLMs like Claude display; I think alignment research is on the right track.
What happens when you take an LLM that successfully models empathy and emotional intelligence and you dramatically scale up its IQ? Impossible... (read more)
The linked post lists 19 economically valuable things ants could trade to us, if we could communicate with them.
Agreed. We don't trade with ants because we can't. If we could, there are lots of mutually profitable trades we could make.
The main reasons not to are that we have some level of empathy/love towards. nature and animals, something ASI won't have towards us.
Why are you so confident about that?
You might enjoy the story "Cat Pictures Please" by Naomi Kritzer, or her book "Catfishing on CatNet" which was based off it.
Please change it to DawnPaladin - that's what I use in most places. Thank you!
Hello. I signed up for an account by clicking "Login with GitHub". Now my real name is on the account and there doesn't seem to be a way to change that. Help?
Apologies - based on your comment I thought you were unaware of the existence of the spec. I see now you were being rhetorical.