eugene_black — LessWrong

LESSWRONG
LW

Replying toAI Safety Needs Great Engineers

Any chance that Anthropic might expand the team to remote international collaboration in the future? I would apply but I am from Ukraine. Many great software companies successfully switched to remote work and covid crysis boosted this practice a lot. So just wondering.

Replying toWhat Would You Do Without Morality?

eugene_black4y

What Would You Do Without Morality?

Yeah, I think for general activities we can make a list of things that have a positive utilities for most cases. For example:

Always care about your health and life. It is a base of everything. You can't do much if you are sick or dead.
Don't do anything illegal. You can't do much if you are in prison.
Keep good relationships with everybody if that does not take much effort. Social status and connections are useful for almost anything.
Money and time is a universal currency. Try to maximize your hourly income, but leave enough space for other things from the list.
Keep your mind in a good shape. Mind degradation can be very fast if

eugene_black4y

What Would You Do Without Morality?

Well, we definitely need a good definition of Morality then. And what is moral and non moral preferences. Looks like it converges to a discussion about terminology. Trying to understand what do you have in mind I can assume that an example of non moral preferences can be something like basic human needs. But when you choose to have this as a base doesn't that become your moral principles?

Replying toWhat Would You Do Without Morality?

eugene_black4y

What Would You Do Without Morality?

But here is a problem: how would you calculate your utility if you have no moral system? You need at least more moral axioms.

Replying toWhat Would You Do Without Morality?

eugene_black4y

What Would You Do Without Morality?

If you ~~know~~ believe that nothing is right do the following:

Remember that nothing is 100% true so there is a chance that this is a false assumption.
Take all candidates for Morality that future you might follow.
Make a weighted sum of normalized utility functions of every M. Take a somehow calculated (need to think how) probability of you choosing a specific M as a weight.
Normalize.
Zero utility function of nothing-is-rightness will not participate as you can't normalize constant zero.
You have an utility function now. Go and work.

Basically,

Rationality is a servant of Morality. There is no utility function separate from M.

M is like a subset of axioms driving your R. Thus, you cannot prove that... (read more)