I don't know what you're asking. The answer is either trivial or mu depending on what you mean by specific form. I think if you could articulate what you're asking you wouldn't have to ask it.

The VNM axiom isn't about road trips, a utility function is allowed to value different things at different times because the time component distinguishes those things. You aren't addressing VNM utility here. You're writing about a misunderstanding of it that you had.
You die if you have VNM cycles. A superior trader eats you (People feel like they can simply stop communicating with the sharps and retire to a simple life in the hills, but this is a very costly solution and I'd prefer to find a real one). You stop existing. This is kind of a much more essential category of instrumental vice than like "I don't equate money to utility" type stuff (which I wouldn't call a vice).

One criticism of decision theory that you could explore is that many practical philosophy enjoyers would find it difficult write utility functions that compose scripted components (like "I want A, then B, then C, then A") with nonscripted components ("I will always instantly trade X for Y, and Y for Z"), that we may need higher level abstractions on top of the basics to help people to stop conflating ABC with XYZ... but... is it really going to be complicated? That one doesn't seem like it's going to be complicated to me.

What does seem difficult is expressing constrained indifference about utility function changes. Something that seems to be common in humans (eg, I'm indifferent to the change/annihilation of my values if it's being done by beautiful and cool things like love, literary fiction, or reason, but I hate it if it's being done by ugly or stupid or hostile things.) and is needed for ASI alignment (corrigibility), but it seems tricky to define a utility function that permits it. (though again I don't know whether it turns out to be tricky in practice)

A utility function that enjoys moving between those places isn't the same as a utility function with cycles, which would trade unlimited time money for tickets to them that it never cashes.

The argument against this is that is also going to be somewhat instrumental in flavour but more along the lines of like, that's a known attracter that few who matter want to be in.

In a world that has ASI, a much better way of maintaining the integrity of the audit system by building it to be intelligent enough to tell whether it's being fooled, and with a desire of its own to stay neutral. Which I guess is like being multistakeholder, since you both will have signed off on its design.

But in such a world, the audit system would be a feature of the brain of the local authorities. You would co-design yourselves in such a way that you have the ability to make binding promises (or if you're precious about your design, co-design your factories in such a way that they have the ability to verify that your design can make binding promises (or co-design your factory factories to ...)). This makes you a better/viable at all trading partner. You have the option of not using it except when it benefits you. But having it means that they can simply ask you whether your galaxy contains any optimal 17 square packings, and you send them an attestation that no when you need to pack 17 squares you're using the socially acceptable symmetrical, suboptimal packings, and if it has a certain signature then they know you weren't capable of faking this message.

You really don't want to lack this ability.

But starting from the outset with little shared resources and (obviously) allowing establishment of shared projects using their resources by agreement between the stakeholders doesn't seem much different from some de novo process of establishing such shared projects with no direct involvement of individuals

You're speaking as if we're starting with strict borders and considering renegotiating, for most of the resources in the universe and also on the planet this is not the case, ownership of space is a taboo, ownership over ocean resources is shared, at least on the nation level. It's as if humans have shame, sense the absurdity of it all, and on some level fear enclosed futures. I think shared ownership (which is not really ownership) is a more likely default, shared at least between more than one person, if not a population.

But to the point, I don't think we know that the two starting points lead to equivalent outcomes. My thesis is generally that it's very likely that transparency (then coordination) physically wins out under basically any natural starting conditions, but even if the possibility that some coordination problems are permanent is very small, I'd prefer if we avoided the risk. But I also notice that there may be some governance outcomes that make shared start much less feasible than walled start.

Ownership is the ability to fully exclude others from, or if you wish, dispose of, an object. Ownership is an extremely dumb negotiation outcome for any object larger than a sparrow. It's something that humans think is fine and eternal because of how dumb humans are. We simply aren't able to do better, but better deals are easily imaginable.

As an example of why you wouldn't want to pay the premium (which would be high) of full ownership over a galaxy: If you have sole ownership of something, then you can exclude others from knowing what you're doing with it, so you could be running torture simulations in there, which would bother other people a lot, just because it isn't in my yard doesn't mean it's not affecting my utility function, so you would have to pay an insane premium for that kind of deal. You'd prefer to at least cede a limited degree of ownership by maintaining constrained auditing systems that prove to your counterparties that you're not using the galaxy to produce (much) suffering without proving anything else, and they'd be willing to let you have it for much less, in that case.

And in a sense we're already part of the way to this. You can buy an animal, but in a way you don't completely own it, you aren't allowed to torture it (though for the aforementioned humans being dumb issues you can still totally do it because we don't have the attentional or bureaucratic bandwidth to enforce those laws in most situations in which they'd be necessary). If you mistreat it, it can be taken away from you. You could say that this weaker form of ownership is simply what you meant to begin with, but I'm saying that there are sharing schemes that're smarter than this in the same way that this is smarter than pure ownership. Lets say your dog looks a lot like a famous dog from an anime you've never seen and never want to see. But a lot of other people saw it. So they want to have it cosplay as that for halloween, while you don't really want to do it at all. Obviously going along with it is a better negotiation outcome, society in theory (and sometimes in practice) would have subsidised your dog if they had an assurance that you'd fulfil this wish. But it wont, or can't afford to. So you don't do it. And everyone is worse off, because of how extraordinarily high the transaction costs are for things as stupid as humans.

By episode 8, I find it to be more of a depiction of extinctionist boddhisatvism than a depiction of a credible mode of AI, though the former is still sometimes relevant around these parts.

The virus is a form of violence that converts humans into very nice and happy people at the modest expense of estranging them from most of their desires, and in so doing eventually destroying most of what they used to value. A rejection of any passion strong enough to move a person to defend the things they love from those who'd tread on them, to an extent that they can no longer really claim to have love.

but thought that people won't have a good reason to fill out their trust weights

Yeah, I notice that using a transitive quality as the endorsement criterion, and making votes public, produces an incentive for a person to give useful endorsements: Failing to issue informative endorsements would indicate them as not having this transitive quality and so not being worthy of endorsement themselves.
We can also make it prominent in a person's profile if, for instance, they've strongly endorsed themselves, or if they've only endorsed a few people without also doing any abstention endorsements (which redistribute trust back to the current distribution). Some will have an excuse for doing this, most will be able to do better.

I wonder if it's good to pre-fill the trust weights (e.g. based on AF upvotes history), to make it easier for users (and motivate those who strongly disagree with their defaults)

True. Doing that by default, and also doing some of the aforementioned abstention endorsements by default, would address accidental overconfident votes pretty well.

(Also, howdy, I should probably help with this, I was R&Ding web of trust systems for a while before realising there didn't seem to be healthy enough hosts for them (they can misbehave if placed in the wrong situations), so I switched to working on extensible social software/forums, to build better hosts. It wasn't clear to me that the alignment community needed this kind of thing, but I guess it probably does at this point.)

Collective LessWrong Value:
If everyone who used LessWrong would pay the same amount you do for the website, how much would you pay? (In USD)

Should probably say "Per year"

Also it's a very tricky question because it seems to assume that we can start charging people without decreasing the number of users, in which case the price should probably be extremely high, higher than any online service has ever costed, due to the fact that it's almost never possible to charge what a public information good, or its impacts, are worth (it's worth a lot).

How month long vacations would you trade for a new sportscar? If you'd trade months of vacation for one sportscar, write 2, if you'd trade one month of vacation for two cars, write 0.5.

Many typos here. Also I hate it. Which sportscar. Why not just give a dollar value. My mind compulsively goes to the tesla roadster which'll probably have cold gas thrusters and so is likely to value a lot more than the average sportscar. The answer will also be conflated with how much people like their work. Some people like their work enough that they'll have to give a negative answer, or they might just answer incorrectly based on varying interpretations of what a vacation is, can you work during a vacation if you want to? I'd say not really, but I'm guessing that's not what you intended.

(previously posted as a root comment)