All of Negidius's Comments + Replies

Isn't this more like the government taking more in taxes from poor people to give to rich people? The argument is that the policy is benefiting people who are already better off at the expense of people who are already worse off.

1TAG
Maybe, but it still doesn't make sense. Being better off in lifespan can't be directly traded off against being better off in terms of money ... you can't sell.extra life years...and the aim is not to give everyone the same total sum in the first place.

I agree, and I have long intended to write something similar. Protecting AI from humans is just as important as protecting humans from AI, and I think it's concerning that AI organizations don't seem to take that aspect seriously.

Successful alignment as it's sometimes envisioned could be at least as bad, oppressive and dangerous as the worst-case scenario for unaligned AI (both scenarios likely a faith worse than extinction for either the AIs or humans), but I think the likelihood of successful alignment is quite low.

My uneducated guess is that we will end... (read more)

2Alex Beyman
>"Perhaps AIs would treat humans like humans currently treat wildlife and insects, and we will live mostly separate lives, with the AI polluting our habitat and occasionally demolishing a city to make room for its infrastructure, etc." Planetary surfaces are actually not a great habitat for AI. Earth in particular has a lot of moisture, weather, ice, mud, etc. that poses challenges for mechanical self replication. The asteroid belt is much more ideal. I hope this will mean AI and human habitats won't overlap, and that AI would not want the Earth's minerals simply because the same minerals are available without the difficulty of entering/exiting powerful gravity wells.