Yeah, cow's milk is good. I actually did say that in the post, but it was kinda hidden at the end of the bullet point of me recommending beef in general.
Fair enough. There are some for profits where profit and impact are more related than others.
But it's also quite likely your evals are not actually evaluating anything to do with x-risks or s-risks, and so it just feels like it's making progress, but isn't.
I'm assuming here people are trying to prevent AI from killing everyone. If you have other goals, this doesn't apply.
there are an extremely large number of NGOs with passionate people who do not remotely move the needle on whatever problem they are trying to solve. I think it's the modal outcome for a new nonprofit
I'd say this is the same thing for AI for-profits from the perspective of AI notkilleveryoneism. Probably, the modal outcome is slightly increasing the odds AI kills everyone. At least the non-profits the modal outcome is not doing anything, rather than making things worse.
Sure, but you get feedback for whether it helps customers with their immediate problems. You don't get feedback on whether it helps with AI safety.
It's the direction vs speed thing again. You'll get good at building widgets that sell. You won't get good at AI notkilleveryoneism.
Such a good post! I think it'd be be received well on the EA Forum too. Obviously applicable to EA in a million different ways.
Can't tell you how many times I've had to stare into the abyss of a crucial consideration or study result showing that maybe the thing I'd been working on didn't help or was even maybe net negative.
Don't know much about accumulated heavy metals, but they're really low on the food chain, so they're a priori going to have less of those than those higher up the food chain.
You can see their nutritional profile here. Sky high in B12, great at omega-3s and iron.
I also predict they'll be good at a wide variety of things we don't know we need yet, since they're as close to a "whole food" as you can get. You're eating almost the whole animal, instead of just a part of it.
Thank you for writing this! Gave me a great concept I'm going to use going forward.
The Grok suggesting organ harvesting of illegals surprised me, so I tried to replicate it.
It did not replicate.
It gave really reasonable answers, including trying to help countries of origin to be more prosperous and stable and making merit-based paths to legal status.
I mean, it still said stuff like using covert operations to stabilize countries, which is pretty dark arts, but very far away from organ harvesting and public executions.
Quick response dashed off without sources:
Again, I don't put crazy high odds. I'd probably put the odds that an oak tree is conscious at about the same probability I put on a worm being conscious.
I recommend reading The Hidden Life of Trees for an infodump about all of the crazy things trees do if you're curious about this sort of thing.