All of solipsist's Comments + Replies

Which (possibly all) of the VNM axioms do you think are not appropriate as part of a formulation of rational behavior?

I think the Peano natural numbers is a reasonable model for the number of steins I own (with the possible exception that if my steins fill up the universe a successor number of steins might not exist). But I don't think the Peano axioms are a good model for how much beer I drink. It is not the case that all quantities of beer can be expressed as successors to 0 beer, so beer does not follow the axiom of induction.

I think ZFC axioms are a ... (read more)

0Lumifer
I don't think that rational behaviour as understood on LW (basically, instrumental rationality) has anything to do with VNM axioms. In particular, I do not think that the VNM model is an adequate model of human decision-making once you go beyong toy examples.

Can you by chance pin down your disagreement to a particular axiom? You're modus tollensing where I expected you would modus ponens.

0Lumifer
You are looking at the wrong meta level. When I say "VNM doesn't offer any formulation of rational behavior" I'm not disagreeing with any particular axiom. It's like I'm saying that an orange is not an apple and you respond by asking me what kind of apples I dislike.

I didn't follow everything, but does this attempt to address self-fulfilling prophecies? Assume the oracle has good track record and releases its information publicly. If I ask it "What are the chances Russia and the US will engage in nuclear war in the next 6 months?", answers of "0.001" and "0.8" are probably both accurate.

0Stuart_Armstrong
The self-fulfillment is addressed by the v_E term - the AI acts as if its predictions were never read.

What what sorts of output strings are you missing?

Calculating Kolmogorov complexities is hard because because it is hard differentiate between programs that run a long time and halt and programs that run a long time and never halt.

If God gave you a 1.01 MB text file and told you "This program computes BB(1000000)", then you could easily write a program to find the Kolmogorov complexity of any string less then 1 MB.

kolmogorov_map = defaultdict(lambda x : infinity)

for all strings *p* less than 1000000:

    run *p* for at most BB(1000000) steps
... (read more)

Eh, don't take it personally. I'm guessing commenters are implicitly taking the title question as a challenge and are pouncing to poke holes in your argument. I thought your essay was well written and thought provoking. Keep posting!

Don't know, not the original author. What do you think the chances are than an email on the third page of your inbox will ever get a reply? Inbox purgatory seems to me like a way to give up on something without having to admit it yourself.

If my inbox has more than 40 or 50 items in it I feel demoralized and find it harder to work through newer items, so the easiest way for me to stay at steady-state is to keep my inbox at zero or close to it.

Counterpoint: I've kept to an empty inbox for many years, but know people with ever-growing inboxes whom I consider more organized and responsive. I've never declared email bankruptcy during my professional life and don't know the consequences.

And nothing in here says anything about how to deal with that situation.

I read the advice as:

If you still have unresolved emails from 2015 in your inbox then keeping emails in your inbox isn't causing them to get resolved. Accept that, get a clean slate, and move on.

Make a folder called "old inbox" and put all your old emails there. Now you have an empty inbox! The costs of putting your old emails out of sight are less than the benefits of keeping an empty inbox going forward.

0gjm
I do not believe the intention of the advice given is that emails in your inbox that you feel require some reponse, but that you don't see how to deal with completely in a few minutes, should be archived and forgotten. (Perhaps I misunderstood?)

HLS students of any skin color have high IQs as measured by standardized tests. The school's 25th percentile LSAT score is 170, which is 97.5th percentile for the subset of college graduates who take the LSAT. 44% of HLS students are people of color.

1Lumifer
When I see funny terms like "people of color" (or, say, "gun deaths"), I get suspicious. A little bit of digging, and... Black students constitute 10-12% of HLS students. Most of the "people of color" are Asians.

The book to read is Reasons and Persons by Derek Parfit.

1gjm
Seconded -- it's a wonderful book -- with the caveat that it's long and dense and small-print and may be intimidating to the easily intimidated. [EDITED to add:] But it's long and dense because there's a lot in it, not because it's wordy and confusingly written; Parfit writes more clearly than most philosophers.

If love your simulation as you love yourself, they will love you as they love themselves (and if you don't, they won't). You can choose to have enemies or allies with your own actions.

You and a thousand simulations of you play a game where pressing a button gives the presser $500 but takes $1 from each of the other players. Do you press the button?

0Usul
I don't play, craps is the only sucker bet I enjoy engaging in. But if coerced to play, I press with non-sims. Don't press with sims. But not out of love, out of an intimate knowledge of my opponent's expected actions. Out of my status as a reliable predictor in this unique circumstance.

What do you mean by "commit suicide" here? Memorize the results of 5 more coins?

1Gurkenglas
No, that would do nothing to the anthropic weights of each subtree. I meant ending your life as part of the thought experiment. Why would memorizing numbers do anything special?

Spit balling hacks around this:

  • Weigh hypotheses based on how many steps it takes for them to be computed on a dovetailing of all Turing machines. This would probably put too much weight on programs that are large but fast to compute.

  • Weigh hypotheses on how much space it takes to compute them. So dovetail all turing machines of size up to n limited to n bits of space for at most 2^n steps. This has the nice property that the prior is, like the hypotheses, space limited (using about twice as much space as the hypothesis).

  • Find some quantum algorithm

... (read more)

I also found the answer to a question I've been researching for ~3 years.

Boy, did you ever! Congratulations!

I'm not sure if coin flips are quantumly random, or just hard enough to predict. Feels like coins would still work as well in a Newtonian universe. I tried to go with something that something that is clearly caused by quantum effects, like measuring if electron is either polarized up or down or down. Luckily, there's an app for that.

2Lumifer
I don't see any reason for physical coin flips to be provide quantum randomness. This is a better source.

I set up an experiment to test quantum anthropics.

Flip four quantum coins. If they all came up heads, stop. If any of them came up tails, flip 5 more coins and (using mnemonics) think really hard about the exact coin flip sequence. If I find myself in a universe where first four coins came up all heads, then with p < 0.0625, quantum weirdness kept me from finding myself in one of the universes the state of my consciousness split me 512-ways.

I got access to a quantum random number generator, resolved to do the experiment, called a friend and told them I was about to do the experiment, and... chickened out and didn't do the experiment.

I do not know how to interpret these results :-/

-2Gurkenglas
Here's how I predict your setup to work, and shame on you for chickening out: http://sketchtoy.com/66313589 You start doing the experiment, you flip four coins, 15/16 of you memorize a sequence, 15*32 of you memorized pairwise probably different sequences. In the end, you have a probability of 15/16 to find yourself having memorized a sequence. If QI works and half of you who find a tails in a first four coins commit suicide, start-experiment-you only has a 15/17 chance to find themselves having found tails and failed to kill themselves.
3Algernoq
I love this forum. If I understand the experiment, your theory is that quantum weirdness makes it more likely to see four heads in a row because you resolved to flip many more coins if you don't. Sounds fun. I'll flip four coins (actually use a string of 0's and 1's that's 4 bits long). If I don't get four heads, I'll generate a 10-digit sequence and memorize it. Let's explore this frontier! I did it. It didn't work. My new favorite number is 1 1 0 0 0 0 0 0 0 1. Reality hack failed. Let's try again. If I don't get 4 heads, I'll memorize a 20-digit number. It didn't work. My other new favorite number is 1 0 1 1 0 1 0 0 0 0 1 1 0 1 1 1 1 1 1 1. I wonder if there's a better way to test this theory.

Minor naming feedback. You switched from calling something "supervised learning" to "reinforcement learning". The first images that come to my mind when I hear "reinforcement learning" are TD-Gammon and reward signals. So, when I read "reinforcement learning", I first think of a computer getting smarter through iterative navel-gazing, then think of a computer trying to wirehead itself, then stumble to the meaning I think you intend. I am a lay reader.

Other answers I've considered:

o) Simpler universes are more likely, but complicated universes vastly outnumber simple ones. It's rare to be at the mode, even though the mode is the most common place to be.

p) Beings in simple universes don't ask this question because their universe is simple. We are asking this question, therefore we are not in a simple universe.

2') You don't spend time pondering questions you can quickly answer. If you discover yourself thinking about a philosophy problem, you should expect to be on the stupider end of entities capable of thinking about that problem.

Oh! So you're saying the spectrum of the acoustic noise at a given temperature will be the spectrum of black body radiation! Yes, I could definitely believe that. That is high-frequency indeed.

0passive_fist
Sort of. Blackbody radiation is electromagnetic in nature, however under some ideal assumptions you can assume that the molecules emitting that radiation are also vibrating at roughly the same spectrum. 'vibrating', though, can mean a lot of different things; this is related to the microscopic properties of the substance and its degrees of freedom. In an ideal gas, it's taken to mean the particle collision frequency spread (but not necessarily the frequency of particle collisions). If you consider heat to be composed of a disordered collection of phonons, then you could definitely say that this is 'sound', but it's probably neater to draw a distinction between thermal phonons (high-entropy, low free energy) and acoustic phonons.
0Lumifer
Black-body radiation is electromagnetic radiation, so I'm a bit confused how that's connected with acoustic noise. As to molecule collisions, I'm not sure vibrations at sufficiently high frequency can be called "acoustic" at all.

Essentially, an air molecule doesn't have enough energy to register at your hearing sensors, that is, to move your eardrum (or cochlear hairs).

Though, now that I'm thinking about it, if the white noise generator I bought to help me sleep is really good at producing white noise with uniform power at high enough frequencies, an air molecule would have enough energy to move my eardrums. I would also be on fire.

And if my white noise generator is really really good at producing white noise with power uniform across all frequencies, the noise's mass-energy will cause my bedroom to collapse into a black hole and I will be unable to leave a 5 star review on Amazon.

0passive_fist
Yes white noise is an ideal that can never be realized in reality, like a perfectly rigid object, or a frictionless wheel, or an absolute zero freezer. White noise would carry infinite power.

Do you happen know a back-of-the-envelope way to get that 30 THz figure?

2passive_fist
https://en.wikipedia.org/wiki/Wien%27s_displacement_law

Why can I hear noise (white noise / pink noise / brown noise), but not hear temperatures?

EDIT FOR CLARIFICATION Air temperature is caused by air molecules moving randomly at high speed, white noise is caused by air molecules moving randomly at high speed, what's the difference? Why does white noise fill the room with sound instead of just raising the temperature slightly?

My hand-wavy-sounds-like-science-technobable guess is that temperature does fill the air with sound, but most of the energy of that sound is at far too high frequencies for my eardrums to... (read more)

You can't hear temperatures because if the temperatures of air were high enough to make enough noise for you to hear, you would be incinerated.

http://physics.stackexchange.com/questions/110540/how-loud-is-the-thermal-motion-of-air-molecules goes over this. There is a lot of error in that thread, but the parts that are right show up a few times and calculate the white noise sound level of room temperature air at about -20 dB SPL. SPL of 0 dB is the approximate threshold of human hearing. dB is a logarithmic scale such that every 10 dB increase is a 10X... (read more)

6Lumifer
This is wrong. What you hear is sound waves, that is, rarefaction/compression zones in the air, pressure differentials. They are a phenomenon at a different scale than molecules. In particular, the energy involved is different. "White noise" means the frequencies are uniformly distributed. Essentially, an air molecule doesn't have enough energy to register at your hearing sensors, that is, to move your eardrum (or cochlear hairs).
7passive_fist
The peak frequency of thermal noise at room temperature is far higher than 5 GHz, it's actually closer to 30 THz. I'm not exactly sure about the biology here and whether Brownian motion of air molecules excites the hair cells in your cochlea. I'm guessing that it does, but even so, the range of frequencies you can hear (20-20,000 Hz) carries only a very, very tiny fraction of the thermal energy. Someone should do the calculations; my guess is that it's far below the detection threshold. Another thing to keep in mind is that at equilibrium, you have thermal excitation everywhere. You might as well ask why you don't hear or see or smell the thermal excitation in your own brain.
1OrphanWilde
To clarify what I believe is the question: Why can't solipsist hear brownian motion? The question is pretty good; Brown Noise derives its name from brownian motion, or rather the discoverer of such, as it is the frequency (or set of frequency) that brownian motion produces. I'd -guess- the answer is that the motion all cancels out on the average, approximately, and the remaining statistical noise isn't energetic enough to be perceived.
0polymathwannabe
The way a sense organ interacts with temperature follows a different mechanism from perception of sound.
0Lumifer
What does "hear temperature" mean?

Well, I don't know. Some of the US is near Mexico, but most of it isn't. In Europe the farthest you can get from a border to foreign speaking country is perhaps southern Italy. The four US states which border Mexico are each bigger than Italy. Germany is a bigish country in Europe area-wise, but it's less than 3.7% the size of the US. The Mercator projection makes an optical illusion -- the US is huge.

Yeah, your explanation sounds absolutely correct. But before you think "silly monoglot Americans", remember that London is closer to Istanbul than New York is to Mexico. Countries where people don't mostly speak English are thousands of kilometers away from most Americans.

-1username2
Just because they have an excuse that geography made them silly monoglots doesn't mean they aren't silly monoglots :p
0polymathwannabe
Those are suspiciously convenient examples. A more relevant comparison would be: Los Angeles is closer to Tijuana than London is to Paris.

Asset allocation (what portion of your money is in stocks and bonds) is very important, depends on your age, and will get out of whack unless you rebalance. So use a Vanguard Target Retirement Date fund.

0Lumifer
There are more financial assets than just stocks and bonds.

Although the Linux kernel and modern CPUs are piecewise-understandable, whereas neural networks are not.

7IlyaShpitser
Lots of neural networks at an individual vertex level are a logistic regression model, or something similar, -- I think I understand those pretty well. Similarly: "I think I understand 16-bit adders pretty well."

Is it for reasons similar to the Strawman Chompsky view in this essay by Peter Norvig?

0[anonymous]
Yeah. Maybe Norvig is right and it's much easier to implement Google Translate with what I call "voodoo" than without it. That's a good point, I need to think some more.

Here's how I read your question.

  1. Many machine learning techniques work, but in ways we don't really understand.
  2. If (1), I shouldn't study machine learning

I agree with (1). Could you explain (2)? Is it that you would want to use neural networks etc. to gain insight about other concrete problems, and question their usefulness as a tool in that regard? Is it that you would not like to use a magical back box as part of a production system?

EDIT I'm using "machine learning" here to mean the sort of fuzzy blackbox techniques that don't have easy interpretations, not techniques like logistic regression where it is clearer what they do

It sounds like you do not understand what your experiments are doing. That's pretty much why I'm not studying electromagnetism.

-- Letter from James Clerk Maxwell to Michael Faraday, in the setup of a Steam Punk universe I just now invented

1solipsist
Here's how I read your question. 1. Many machine learning techniques work, but in ways we don't really understand. 2. If (1), I shouldn't study machine learning I agree with (1). Could you explain (2)? Is it that you would want to use neural networks etc. to gain insight about other concrete problems, and question their usefulness as a tool in that regard? Is it that you would not like to use a magical back box as part of a production system? EDIT I'm using "machine learning" here to mean the sort of fuzzy blackbox techniques that don't have easy interpretations, not techniques like logistic regression where it is clearer what they do

The Snowden / Manning leaks (from what I've heard) suggest this issue is the third or forth priority of US intelligence organizations. One presumes that the US intelligence organizations do not consider it in their interests to advertise this fact.

I think the article was making a stronger statement: programming isn't the best way to learn programming (at least at first). Sounds bonkers to me, but I don't trust my pedagogic intuitions.

If you're at the state where the worst thing about a proof is that it relies on the axiom of choice, you're practically at the finish line (at least compared to here). Once proofs has been discovered, mathematicians have a pretty good track record of whittling them down to rest on fewer assumptions. From my (uninformed dilettante's) perspective, it's not worth limiting your toolset until you've found some solution to your problem. Any solution, even ones which rest on unproven conjectures, will teach you a lot.

0JoshuaZ
Ah, yes, I think that makes sense. And obviously a proof of say Friendliness in ZFC is a lot better than no proof at all.

I would think it faster to search for proofs of any kind, then simplify to an elementary/constructive/machine verifiable proof.

0JoshuaZ
What do you mean?

Do you know, offhand, if Baysian networks have been extended with complex numbers as probabilities, or (reaching here) if you can do belief propagation by passing around qubits instead of bits? I'm not sure what I mean by either of these thing but I'm throwing keywords out there to see if anything sticks.

0IlyaShpitser
Yes they have, but there is no single generalization. I am not even sure what conditioning should mean. Scott A is a better guy to ask.

I don't think the consensus of physicists is good enough for you to place that much faith in it. As I understand modern day cosmology, the consensus view holds that universe once grew by a factor of 10^78 for no reason. Would you pass up a 1 penny to $10,000,000,000 bet that cosmologists of the future will believe creating 10^100 happy humans is physically possible?

what criteria do you use to rule out solutions?

I don't know :-(. Certainly I like physics as a darn good heuristic, but I don't think I should reject bets with super-exponentially good od... (read more)

Relativity seems totally, insanely physically impossible to me. That doesn't mean that taking a trillion to one bet on the Michelson Morley experiment wouldn't have been a good idea.

1IlyaShpitser
May I recommend Feynman's lectures then? I am not sure what the point is. Aristotle was a smart guy, but his physics intuition was pretty awful. I think we are in a good enough state now that I am comfortable using physical principles to rule things out. Arguably quantum mechanics is a better example here than relativity. But I think a lot of what makes QM weird isn't about physics but about the underlying probability theory being non-standard (similarly to how complex numbers are kinda weird). So, e.g. Bell violations say there is no hidden variable DAG model underlying QM -- but hidden variable DAG models are defined on classical probabilities, and amplitudes aren't classical probabilities. Our intuitive notion of "hidden variable" is somehow tied to classical probability. ---------------------------------------- It all has to bottom out somewhere -- what criteria do you use to rule out solutions? I think physics is in better shape today than basically any other empirical discipline.

In the U.S., what happens to people who cannot survive without assistance (like people without the dexterity to feed themselves, or even people without the ability to keep a job or fill out paperwork) who do not have a family or the means to trade for help? What, physically, keeps them from starving to death?

0Strange7
Some combination of Social Security Disability payments, caring friends and family, private-sector charities, and hospital emergency rooms that aren't allowed to check for ability to pay before providing treatment. It's a bad system with a lot of cracks to fall through, and a distressing number of poor people suffer miserable pointless deaths.
-1[anonymous]
There's some sense of a social safety net that catches people. Sometimes it doesn't catch them and they die.
4James_Miller
Most are elderly and are in nursing homes paid for by the federal government.

Thank you for writing this post. I've had the same intuition as you about stopping rules for over a year now, but have never taken time to sit down and work it out. I look forward to working through the comments!

What's a network topology based sandboxing mechanism?

8jimrandomh
A fancy way of saying "don't have a wire or path of wires leading to the internet".

Question: I have a strong sense of a "dominant" direction (often, but not always, west). This direction is self-apparent in virtually every memory or mental visualization of any location I can think of. So, for example, captain's chair on the USS enterprise "obviously" faces "east", and the library on Myst island is obviously on the north side. I'm not going to forget which direction is down, and I'm not going to forget which direction is (usually) west.

Does anyone else here have oriented spacial memories?

0Gunnar_Zarncke
There are (indigenous) languages/cultures which give directions in absolute (compass) terms instead of our usual left/right/front/back terms. I'd guess that implies that memory gets tagged with that a lot. I'd also guess that some people are more naturally predisposed to deal with that. Like you.
0Elo
Neat-o. I don't have any particularly strong sense of directions in my memories but I always know where I am in relation to other places I know. It will occasionally bother me when I walk into a maze-like building and lose my orientation. But I usually re-orientate when I leave such a building. I wonder if this is a branch of synaesthesia?

My understanding is that a Snowden-leaked 2008 NSA internal catalog contains airgap-hopping exploits by the dozen, and that the existence of successful attacks on air gapped networks (like Stuxnet) are documented and not controversial.

This understanding comes in large measure from a casual reading of Bruce Schneier's blog. I am not an security expert and my "you don't understand what you're talking about" reflexes are firing.

But moving to areas where I know more, I think e.g. if I tried writing a program to take as input the sounds of someone ty... (read more)

Oops! I misremembered. So8res' second post was for that tournament, but his first was two weeks earlier. Shouldn't have put words in his mouth, sorry!

solipsist130

I am not close to an expert in security, but my reading of one is that yes, the NSA et. al. can get into any system they want to, even if it is air gapped.

Dilettanting:

  • It is really really hard to produce code without bugs. (I don't know a good analogy for writing code without bugs -- writing laws without any loopholes, where all conceivable case law had to be thought of in advance?)
  • The market doesn't support secure software. The expensive part isn't writing the software -- it's inspecting for defects meticulously until you become confident enough that
... (read more)
0kpreid
This is not a fundamental fact about computation. Rather it arises from operating system architectures (isolation per "user") that made some sense back when people mostly ran programs they wrote or could reasonably trust, on data they supplied, but don't fit today's world of networked computers. If interactions between components are limited to the interfaces those components deliberately expose to each other, then the attacker's problem is no longer to find one broken component and win, but to find a path of exploitability through the graph of components that reaches the valuable one. This limiting can, with proper design, be done in a way which does not require the tedious design and maintenance of allow/deny policies as some approaches (firewalls, SELinux, etc.) do.
2hg00
Great info... but even air-gapped stuff? Really?
8Zubon
Additional note to #3: humans are often the weakest part of your security. If I want to get into a system, all I need to do is convince someone to give me a password, share their access, etc. That also means your system is not only as insecure as your most insecure piece of hardware/software but also as your most insecure user (with relevant privileges). One person who can be convinced that I am from their IT department, and I am in. Additional note to #4: but if I am willing to forego those benefits in favor of the ones I just mentioned, the human element of security becomes even weaker. If I am holding food in my hands and walking towards the door around start time, someone will hold the door for me. Great, I am in. Drop it off, look like I belong for a minute, find a cubicle with passwords on a sticky note. 5 minutes and I now have logins. The stronger your technological security, the weaker the human element tends to become. Tell people to use a 12-character pseudorandom password with an upper case, a lower case, a number, and a special character, never re-use, change every 90 days, and use a different password for every system? No one remembers that, and your chance of the password stickynote rises towards 100%. Assume all the technological problems were solved, and you still have insecure systems go long as anyone can use them.
2James_Miller
Thanks! As an economist I love your third reason.

In addition to current posters, these tournaments generate external interest. I, and more importantly So8res, signed up for an account at LessWrong for one of these contests.

4tetronian2
Wow, I was not aware of that. I saw that the last one got some minor attention on Hacker News and Reddit, but I didn't think about the outreach angle. This actually gives me a lot of motivation to work on this year's tournament.

In fairness to Hal Abelson, the pontification I remember isn't in the lecture in question, and my annoyance is more directed at pretentious classmates and some other things edit and aimed at marketing style, rather than substance.

If I were to attempt to summarize the lecture in question, it would be "The Greeks named Geometry after measuring the earth, but hundreds of years later think of them as wrestling with more fundamental ideas about space. Hundreds of years from now, people won't think of computer science as writing C programs for silicon, so ... (read more)

0ChristianKl
People often choose to study computer science in the believe that computer science is about learning computer programming and the skills to be a good programmer. A lot of what Computer Science at places like MIT or Stanford is about is not about computer programming. Computer Science is learning about doing math proofs about how algorithms behave.
0IlyaShpitser
Interestingly different languages have different names for CS: e.g. "informatics", "cybernetics" (?), "theory of computation", etc.

If you tell a pre-industrial farmer about machines, they are likely to form confused ideas. "You want theses "combine harvesters" to be born fully grown? That may sound like a time saver, but I assure you from years of experience that these combine harvesters will never be obedient unless you train them from infancy".

I think the misconceptions people have with AI stems from a lack of familiarity with any intelligent agent besides humans, not from bad terminology. You're going to have trouble talking to foragers about industrial equip... (read more)

1IlyaShpitser
So you are taking issue with a computer scientist telling you what computer science is about? Do you also have issues with Feynman telling you what physics is about? This is a common LW thing, so I am going to say this explicitly: If you ignore/belittle experts in the relevant context, you fail rationality forever. ---------------------------------------- edit: This also falls in the category of "good advice" (very easy to give, very hard to implement). This is advice I would have loved to have given myself from 10 years ago (but also probably me from 10 years ago would have ignored it). " A young doctor's notebook" is a miniseries about how that does not work. I think a part of instrumental rationality is being ahead of the curve on natural personal growth stuff. It is hard :(.

Nice article. Minor note: the use of "launch a coup against the vice president" as the example of nice behavior added a surprising amount of cognitive burden for me. Stroop effect and all that.

4Stuart_Armstrong
Noted! I did need behaviour that was nice in one world and nasty in the others, so I couldn't choose anything unambiguously nice, but situationally nice. You can get some more abstract concepts like pressing a button that has different effects in the different worlds...
solipsist-10

With a 1,000 square kilometer industrial complex for the manufacture of slinkys and a million trained botanists.

0knb
The article makes it pretty clear they are not describing a mismatch scenario. In a mismatch you have simultaneous shortages and gluts, but the article never talks about shortages of X while there is a surplus of Y, only gluts.
-1Elo
Send them to me! slinkys that is! it's time to change the world for the better!
-1[anonymous]
Send them to me. Botanists, that is. It's time to change the world for the better.

So it has a current utility of (1-ε)10, and can increase this by reducing ε - hence by building even more paperclips.

I take ε to be the probability that something weird is happening like you're hallucinating your paperclips. Why would building more paperclips reduce ε? If you are dreaming, you're just making more dream paperclips.

I'm sure you'd spend your time with trying to find increasingly elaborate ways to probe for bugs in Descartes' demon's simulation. It is not clear to me why your increasingly paranoid bug probes would involve making paperclips.

2Stuart_Armstrong
It need not. The problem occurs for any measure that burns resources (and probing the universe for bugs in the Descartes demon would be spectacular at burning resources).
4[anonymous]
I agree that making more paperclips does not reduce ε, but an unsure AI might build more paperclips nonetheless. If x is the probability that any one paperclip is hallucinated, the AI will never be certain it has created 10 paperclips (or any for that matter) as long as x > 0. But it can increase the probability it has created 10 paperclips by making 3^^^3 of them. Bug probes may be a more efficient way to increase the probability, but that isn't certain.

For one, I cannot answer certain questions in the frame which my therapist imposes because I intellectually reject the assumptions that underlie them.

Examples? Just curious.

For another, I do not fully agree with the psychological establishment on what constitutes "healthy", adaptive, rational behaviour and would not like myself to adhere to even the closest variation on mental normality. There are areas of myself which I do not wish to display as "up for fixing", and do not allow interference other than my own in those areas. I co

... (read more)
0Dahlen
For instance, she asked me to list the positive and negative traits of the significant masculine and feminine models in my childhood, in order for her to tell me what kind of relationship I am subconsciously looking for. Problem is, 1) I don't remember people in my early life as strongly representative of their gender, because back then I didn't have a strong idea of gender, I just divided people into kids and adults rather than male and female; 2) just because some people might have been my parents or caretakers or elementary teachers doesn't mean I regard them as significant, just as more familiar than the rest; 3) to this day I don't ascribe much valence to traits, I don't view them as virtues or flaws, I consider them mostly neutral, with the potential of "positive" and "negative" expressions; 4) even so, back then I probably judged traits in a completely different light; 5) I really don't see what any of this has to do with my current attitude to relationships, given that I have changed a great deal in the meantime, and whatever ways in which I resemble my parents (including in the matter of taste in partners) could probably be attributed to genetics. So yeah, impossible question. The paragraph you quoted here doesn't have to do with any ways in which I've been evaluated by actual people in real life. I have read extensively on psychological topics, especially those related to personality types and disorders, psychological schools, advice, and so on. Many times I have recognized myself in descriptions of "how not to be like", while descriptions of healthy, adaptive traits & behaviors -- things like being warm-hearted, optimistic, and bereft of ideas about one's own exceptionality -- just didn't appeal to me. I expect my therapist and me don't really see eye-to-eye on "if it ain't broke, don't fix it". This could be true, yes. I don't go into therapy for any other reason than to maybe at some point stop feeling sad all the time, and yet there are enough other
Load More