An AI system replicating itself seems very unlikely because AI labs are hopefully and presumably protecting against that in particular. However, there are many other dangerous things an AI system could do that aren't self-replication and are often worse. It also seems that if that does happen, we are doomed since AI labs are trying their hardest to prevent that, and if they fail to prevent that, we have a self-replicating non-aligned AI, and so we are screwed.
I am reading Planecrash (https://www.projectlawful.com/boards/215), and it seems surprising that Keltham would not think of his mind being read after being informed of gods that purportedly can do so. This appears to be his biggest flaw so far that I can truly blame him for (lacking cultural understanding in many ways is easily excused by being an alien).
Second thought: what should someone going into the second semester of their second year of college for CS, math, and EE be doing? I have personally elected to continue to do college (it is paid for for me). Still, it is very possible this is not the action that increases EV the most (and almost certainly is not, although by being something that many people do, it is also probably not that bad). I am very willing to listen if anyone has some advice on that front.
Third thought: I could donate $1000 to Lightcone without much difficulty. It would be a very significant expenditure for me, but should I do it? (My useful net worth is ~$10000).
I do not use satellite view either, but my reason is mostly to do with the higher data usage (I'm on a pay-as-you-go plan). Even still, I don't think that there are many advantages to the satellite view especially considering the fact that roads can be obscured, and you still see the shapes of houses, traffic lights, and stop signs on Google Maps even without satellite view. Perhaps I am biased because I grew up in a place where there are trees everywhere, but it doesn't seem very useful to me.
Thank you for your advice, I donated $500. I expect to be a millionaire with high confidence (most situations where I am not are awful for humanity). "Owe" isn't how I would describe what I am doing; it's like any other donation to me. I want the best outcome for humanity.