tl;dr: Some subagents are more closely managed, which makes them to an extent instruments of the superagent, giving rise to what looks like instrumental/terminal goals. Selection on trust avoids the difficulties that normally come with this, like inability to do open-ended truth-seeking and free-ranging agency. (reply to Richard Ngo on...
You have more context on your ability to make use of funds than fits into a specific numerical ask.[1] You want to give funders good information, and the natural type-signature for this is a utility function over money - how much good you think you can do with different funding...
This reading will have mild spoilers, so feel free to close your ears and gently hum until I raise my hand if you’re strongly averse, but the extracts chosen should more whet than spoil your appetite. The Comet King from the book Scott Alexander's UNSONG is one of the most...
TL;DR: Figure out what needs doing and do it, don't wait on approval from fellowships or jobs. If you... * Have short timelines * Have been struggling to get into a position in AI safety * Are able to self-motivate your efforts * Have a sufficient financial safety net ......
[CW: Retrocausality, omnicide, philosophy] Alternate format: Talk to this post and its sources Three decades ago a strange philosopher was pouring ideas onto paper in a stimulant-fueled frenzy. He wrote that ‘nothing human makes it out of the near-future’ as techno-capital acceleration sheds its biological bootloader and instantiates itself as...
Edit: Consider using the SVGs from the wiki page. Ever wanted to say Scout Mindset to someone on a chat platform, but didn't want to have to type 13 characters? Or wanted your server to have magically better epistemics because of a few images? The LW Reactions Pack is here...
> We call for a prohibition on the development of superintelligence, not lifted before there is > > 1. broad scientific consensus that it will be done safely and controllably, and > 2. strong public buy-in. Sign on the main website or Eko[1]. 1. ^ Looks like the latter is...